Sep 28 14:46:43 devstack cinder-volume[76216]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 14:46:43 devstack cinder-volume[76216]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 14:46:43 devstack cinder-volume[76216]: we strongly recommend against using it for new projects. Sep 28 14:46:43 devstack cinder-volume[76216]: If you are already using Eventlet, we recommend migrating to a different Sep 28 14:46:43 devstack cinder-volume[76216]: framework. For more detail see Sep 28 14:46:43 devstack cinder-volume[76216]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 14:46:43 devstack cinder-volume[76216]: import eventlet # noqa Sep 28 14:46:46 devstack cinder-volume[76216]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76216) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 14:46:46 devstack cinder-volume[76216]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76216) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 14:46:46 devstack cinder-volume[76216]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76216) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 14:46:47 devstack cinder-volume[76216]: INFO dbcounter [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] Registered counter for database cinder Sep 28 14:46:47 devstack cinder-volume[76216]: DEBUG oslo_db.sqlalchemy.engines [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76216) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:46:47 devstack cinder-volume[76216]: DEBUG dbcounter [-] [76216] Writer thread running {{(pid=76216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 14:46:47 devstack cinder-volume[76216]: INFO cinder.rpc [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 14:46:47 devstack cinder-volume[76216]: INFO cinder.rpc [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_db.sqlalchemy.engines [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76216) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:46:48 devstack cinder-volume[76216]: INFO cinder.volume.manager [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] Determined volume DB was empty at startup. Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG cinder.volume.manager [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76216) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 14:46:48 devstack cinder-volume[76216]: INFO cinder.volume.manager [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 28 14:46:48 devstack cinder-volume[76216]: WARNING stevedore.named [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 14:46:48 devstack cinder-volume[76216]: WARNING castellan.key_manager [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 14:46:48 devstack cinder-volume[76216]: WARNING cinder.keymgr.conf_key_mgr [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG cinder.volume.drivers.lvm [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76216) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_concurrency.processutils [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_concurrency.processutils [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] CMD "cinder-rtstool verify" returned: 0 in 0.441s {{(pid=76216) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_db.sqlalchemy.engines [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76216) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:46:48 devstack cinder-volume[76216]: INFO cinder.rpc [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 28 14:46:48 devstack cinder-volume[76216]: INFO cinder.rpc [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 28 14:46:48 devstack cinder-volume[76216]: WARNING stevedore.named [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 14:46:48 devstack cinder-volume[76216]: WARNING castellan.key_manager [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 14:46:48 devstack cinder-volume[76216]: INFO cinder.volume.manager [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_db.sqlalchemy.engines [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76216) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:46:48 devstack cinder-volume[76216]: INFO oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] Starting 1 workers Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] Started child 76376 {{(pid=76216) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] Full set of CONF: {{(pid=76216) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] ******************************************************************************** {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] Configuration options gathered from: {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] ================================================================================ {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 14:46:48 devstack cinder-volume[76376]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] allow_availability_zone_fallback = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] allow_compression_on_image_upload = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] allowed_direct_url_schemes = [] {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] api_rate_limit = True {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] auth_strategy = keystone {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] az_cache_duration = 3600 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_availability_zone = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_host = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_name = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_stats_polling_interval = 60 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backup_api_class = cinder.backup.api.API {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backup_name_template = backup-%s {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backup_use_same_host = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backup_use_temp_snapshot = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] chap_password = **** {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] chap_username = {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] cinder_internal_tenant_project_id = 4d374c4d6193413188d9270a2d433ea5 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] cinder_internal_tenant_user_id = 0adb6f3061e447218ceb6a4acd86ea0e {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] cloned_volume_same_az = True {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] cluster = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] compression_format = gzip {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] compute_api_class = cinder.compute.nova.API {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] config_dir = [] {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] config_source = [] {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] control_exchange = openstack {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] debug = True {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] default_availability_zone = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] default_group_type = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] default_volume_type = lvmdriver-1 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] disk_geometry = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] driver_client_cert = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] driver_client_cert_key = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] driver_data_namespace = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] driver_ssl_cert_path = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] driver_ssl_cert_verify = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] driver_use_ssl = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] enable_force_upload = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] enable_new_services = True {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] enable_unsupported_driver = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] enforce_multipath_for_image_xfer = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] filter_function = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] glance_api_insecure = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] glance_api_servers = ['http://192.168.122.219/image'] {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] glance_api_ssl_compression = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] glance_ca_certificates_file = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] glance_catalog_info = image:glance:publicURL {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] glance_certfile = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] glance_keyfile = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] glance_num_retries = 3 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76376]: INFO cinder.volume.manager [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] glance_request_timeout = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] goodness_function = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] graceful_shutdown_timeout = 5 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] group_api_class = cinder.group.api.API {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] host = devstack {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] image_compress_on_upload = True {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] image_conversion_address_space_limit = 1 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] image_conversion_cpu_limit = 60 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] image_conversion_disable = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] image_introspection_address_space_limit = 1 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] image_introspection_cpu_limit = 60 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] image_upload_use_cinder_backend = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] image_upload_use_internal_tenant = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] image_volume_cache_enabled = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] image_volume_cache_max_count = 0 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] image_volume_cache_max_size_gb = 0 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] init_host_max_objects_retrieval = 0 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] instance_format = [instance: %(uuid)s] {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] iscsi_target_flags = {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] iscsi_write_cache = on {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] iser_helper = tgtadm {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] iser_ip_address = 192.168.122.219 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] iser_port = 3260 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] log_color = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] log_config_append = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] log_dir = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] log_file = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] log_options = True {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] log_rotate_interval = 1 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] log_rotate_interval_type = days {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] log_rotation_type = none {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] max_age = 0 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] max_logfile_count = 30 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] max_logfile_size_mb = 200 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] max_over_subscription_ratio = 20.0 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] message_reap_interval = 86400 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] message_ttl = 2592000 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] migration_create_volume_timeout_secs = 300 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] monkey_patch = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] monkey_patch_modules = [] {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] my_ip = 192.168.122.219 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] no_snapshot_gb_quota = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] num_iser_scan_tries = 3 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] num_shell_tries = 3 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] num_volume_device_scan_tries = 3 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] nvmeof_conn_info_version = 1 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] nvmet_ns_id = 10 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] nvmet_port_id = 1 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] osapi_max_limit = 1000 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] osapi_volume_ext_list = [] {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] osapi_volume_listen_port = 8776 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] osapi_volume_use_ssl = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] osapi_volume_workers = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] per_volume_size_limit = -1 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] periodic_fuzzy_delay = 60 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] periodic_interval = 60 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] public_endpoint = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] publish_errors = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] quota_backup_gigabytes = 1000 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] quota_backups = 10 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:46:48 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] quota_gigabytes = 1000 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] quota_groups = 10 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] quota_snapshots = 10 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] quota_volumes = 10 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] rate_limit_burst = 0 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] rate_limit_except_level = CRITICAL {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] rate_limit_interval = 0 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] reinit_driver_count = 3 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] replication_device = **** {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] report_discard_supported = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] report_interval = 120 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] reservation_clean_interval = 86400 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] reservation_expire = 86400 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] reserved_image_namespaces = [] {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] reserved_percentage = 0 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] rpc_response_timeout = 120 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] run_external_periodic_tasks = True {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] scst_target_driver = iscsi {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] scst_target_iqn_name = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] service_down_time = 720 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] shell_completion = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] snapshot_name_template = snapshot-%s {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] snapshot_same_host = True {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] split_loggers = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] state_path = /opt/stack/data/cinder {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] storage_availability_zone = nova {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] storage_protocol = iSCSI {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] syslog_log_facility = LOG_USER {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] target_helper = lioadm {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] target_ip_address = 192.168.122.219 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] target_port = 3260 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] target_protocol = iscsi {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] target_secondary_ip_addresses = [] {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] trace_flags = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] transport_url = **** {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] until_refresh = 0 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] use_chap_auth = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] use_default_quota_class = True {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] use_journal = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] use_json = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] use_multipath_for_image_xfer = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] use_stderr = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] use_syslog = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] verify_glance_signatures = enabled {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] volume_api_class = cinder.volume.api.API {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] volume_backend_name = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] volume_clear = zero {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] volume_clear_ionice = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] volume_clear_size = 0 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] volume_copy_bps_limit = 0 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] volume_dd_blocksize = 1M {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] volume_name_template = volume-%s {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:48 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] volume_service_inithost_offload = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] volume_usage_audit_period = month {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] zoning_mode = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_concurrency.disable_process_locking = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] keystone_authtoken.auth_section = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] keystone_authtoken.auth_type = password {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack sudo[76380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] keystone_authtoken.auth_version = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] keystone_authtoken.cache = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack sudo[76380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] keystone_authtoken.certfile = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] keystone_authtoken.include_service_catalog = True {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] keystone_authtoken.insecure = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] keystone_authtoken.interface = public {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] keystone_authtoken.keyfile = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] keystone_authtoken.memcache_password = **** {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] keystone_authtoken.memcache_username = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] keystone_authtoken.region_name = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] keystone_authtoken.service_type = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.219/identity {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] cache.backend = dogpile.cache.null {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] cache.backend_argument = **** {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] cache.backend_expiration_time = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] cache.config_prefix = cache.oslo {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] cache.debug_cache_backend = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] cache.enable_retry_client = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] cache.enable_socket_keepalive = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] cache.enabled = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] cache.expiration_time = 600 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] cache.hashclient_retry_attempts = 2 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] cache.memcache_dead_retry = 300 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] cache.memcache_pool_maxsize = 10 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] cache.memcache_sasl_enabled = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] cache.password = **** {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] cache.proxies = [] {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] cache.redis_db = 0 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] cache.redis_server = localhost:6379 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] cache.retry_attempts = 2 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] cache.retry_delay = 0.0 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] cache.socket_keepalive_count = 1 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] cache.socket_keepalive_idle = 1 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] cache.socket_keepalive_interval = 1 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] cache.socket_timeout = 1.0 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] cache.tls_allowed_ciphers = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] cache.tls_cafile = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] cache.tls_certfile = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] cache.tls_enabled = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] cache.tls_keyfile = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] cache.username = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] coordination.backend_url = **** {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] database.asyncio_connection = **** {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] database.asyncio_slave_connection = **** {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] database.backend = sqlalchemy {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] database.connection = **** {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] database.connection_debug = 0 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] database.connection_parameters = {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] database.connection_recycle_time = 3600 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] database.connection_trace = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] database.db_inc_retry_interval = True {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] database.db_max_retries = 20 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] database.db_max_retry_interval = 10 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] database.db_retry_interval = 1 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] database.max_overflow = 50 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] database.max_pool_size = 5 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] database.max_retries = 10 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] database.mysql_wsrep_sync_wait = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] database.pool_timeout = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] database.retry_interval = 10 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] database.slave_connection = **** {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] database.sqlite_synchronous = True {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] database.synchronous_reader = True {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] database.use_db_reconnect = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_messaging_tracing.insecure = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] profiler.connection_string = messaging:// {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] profiler.enabled = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] profiler.es_doc_type = notification {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] profiler.es_scroll_size = 10000 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] profiler.es_scroll_time = 2m {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] profiler.filter_error_trace = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] profiler.hmac_keys = **** {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] profiler.sentinel_service_name = mymaster {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] profiler.socket_timeout = 0.1 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] profiler.trace_requests = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] profiler.trace_sqlalchemy = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] profiler_jaeger.process_tags = {} {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] profiler_jaeger.service_name_prefix = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] profiler_otlp.service_name_prefix = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_policy.enforce_new_defaults = True {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_policy.policy_default_rule = default {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_policy.policy_file = policy.yaml {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] privsep_osbrick.group = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] privsep_osbrick.helper_command = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] privsep_osbrick.user = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] cinder_sys_admin.group = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] cinder_sys_admin.helper_command = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] cinder_sys_admin.user = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] service_user.auth_section = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] service_user.auth_type = password {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] service_user.cafile = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] service_user.certfile = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] service_user.collect_timing = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] service_user.insecure = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] service_user.keyfile = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] service_user.send_service_user_token = True {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] service_user.split_loggers = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] service_user.timeout = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] service_user.tls_ciphers = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] service_user.tls_min_version = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] glance.auth_section = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] glance.auth_type = password {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] glance.certfile = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] glance.collect_timing = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] glance.insecure = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] glance.keyfile = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] glance.region_name = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] glance.split_loggers = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] glance.timeout = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] glance.tls_ciphers = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] glance.tls_min_version = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.backend_availability_zone = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.chap_password = **** {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.chap_username = {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.disk_geometry = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.driver_client_cert = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.driver_client_cert_key = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.driver_data_namespace = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.driver_use_ssl = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.extra_capabilities = {} {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.filter_function = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.goodness_function = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.iscsi_target_flags = {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.iscsi_write_cache = on {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.iser_helper = tgtadm {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.iser_ip_address = 192.168.122.219 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.iser_port = 3260 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.lvm_share_target = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.lvm_type = auto {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.num_shell_tries = 3 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.replication_device = **** {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.report_discard_supported = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.reserved_percentage = 0 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.target_helper = tgtadm {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.target_ip_address = 192.168.122.219 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.target_port = 3260 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.target_protocol = iscsi {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.trace_flags = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.unique_fqdn_network = True {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.use_chap_auth = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.volume_backend_name = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.volume_clear = zero {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.volume_clear_ionice = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.volume_clear_size = 0 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_reports.file_event_handler = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_reports.log_dir = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.backend_host = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.chap_password = **** {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.chap_username = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.disk_geometry = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.driver_client_cert = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.extra_capabilities = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.filter_function = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.goodness_function = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.iser_helper = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.iser_ip_address = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.iser_port = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.lvm_share_target = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.lvm_type = auto {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.num_shell_tries = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.replication_device = **** {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.report_discard_supported = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.reserved_percentage = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.scst_target_driver = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.storage_protocol = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.target_helper = lioadm {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.target_ip_address = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.target_port = 3260 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack sudo[76380]: pam_unix(sudo:session): session closed for user root Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.trace_flags = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.use_chap_auth = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.volume_clear = zero {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.volume_clear_size = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] lvmdriver-1.volumes_dir = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_messaging_rabbit.ssl = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_messaging_notifications.driver = [] {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_messaging_notifications.retry = -1 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] key_manager.fixed_key = **** {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] barbican.barbican_api_version = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] barbican.barbican_endpoint = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] barbican.barbican_endpoint_type = public {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] barbican.barbican_region_name = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] barbican.cafile = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] barbican.certfile = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] barbican.collect_timing = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] barbican.insecure = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] barbican.keyfile = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] barbican.number_of_retries = 60 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] barbican.retry_delay = 1 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] barbican.send_service_user_token = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] barbican.split_loggers = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] barbican.timeout = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] barbican.tls_ciphers = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] barbican.tls_min_version = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] barbican.verify_ssl = True {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] barbican.verify_ssl_path = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] barbican_service_user.auth_section = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] barbican_service_user.auth_type = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] barbican_service_user.cafile = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] barbican_service_user.certfile = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] barbican_service_user.collect_timing = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] barbican_service_user.insecure = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] barbican_service_user.keyfile = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] barbican_service_user.split_loggers = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] barbican_service_user.timeout = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] barbican_service_user.tls_ciphers = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] barbican_service_user.tls_min_version = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] vault.approle_role_id = **** {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] vault.approle_secret_id = **** {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] vault.auth_method = approle {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] vault.auth_path = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] vault.kv_mountpoint = secret {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] vault.kv_path = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] vault.kv_version = 2 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] vault.namespace = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack sudo[76383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] vault.root_token_id = **** {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] vault.ssl_ca_crt_file = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] vault.timeout = 60.0 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] vault.token_file = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] vault.token_role = None {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] vault.use_ssl = False {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:46:49 devstack sudo[76383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:46:49 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] ******************************************************************************** {{(pid=76216) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 14:46:49 devstack sudo[76383]: pam_unix(sudo:session): session closed for user root Sep 28 14:46:49 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.339s {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:46:49 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 14:46:49 devstack cinder-volume[76376]: INFO cinder.brick.local_dev.lvm [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 28 14:46:49 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:46:49 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:46:49 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:46:49 devstack sudo[76429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 14:46:49 devstack sudo[76429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:46:49 devstack sudo[76429]: pam_unix(sudo:session): session closed for user root Sep 28 14:46:49 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.310s {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:46:49 devstack cinder-volume[76376]: DEBUG cinder.brick.local_dev.lvm [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76376) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 28 14:46:49 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:46:49 devstack sudo[76558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:46:49 devstack sudo[76558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:46:50 devstack sudo[76558]: pam_unix(sudo:session): session closed for user root Sep 28 14:46:50 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.562s {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:46:50 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:46:50 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:46:50 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:46:50 devstack sudo[76755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:46:50 devstack sudo[76755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:46:50 devstack sudo[76755]: pam_unix(sudo:session): session closed for user root Sep 28 14:46:50 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.268s {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:46:50 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:46:50 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:46:50 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:46:50 devstack sudo[76853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 28 14:46:50 devstack sudo[76853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:46:51 devstack sudo[76853]: pam_unix(sudo:session): session closed for user root Sep 28 14:46:51 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.272s {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:46:51 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:46:51 devstack sudo[76937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 14:46:51 devstack sudo[76937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:46:51 devstack sudo[76937]: pam_unix(sudo:session): session closed for user root Sep 28 14:46:51 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.292s {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:46:51 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:46:51 devstack sudo[76997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 14:46:51 devstack sudo[76997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:46:51 devstack sudo[76997]: pam_unix(sudo:session): session closed for user root Sep 28 14:46:51 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.310s {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:46:51 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:46:51 devstack sudo[77079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:46:51 devstack sudo[77079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:46:51 devstack sudo[77079]: pam_unix(sudo:session): session closed for user root Sep 28 14:46:51 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:46:51 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:46:51 devstack sudo[77083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:46:51 devstack sudo[77083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:46:52 devstack sudo[77083]: pam_unix(sudo:session): session closed for user root Sep 28 14:46:52 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.306s {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:46:52 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:46:52 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:46:52 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:46:52 devstack sudo[77101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:46:52 devstack sudo[77101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:46:52 devstack sudo[77101]: pam_unix(sudo:session): session closed for user root Sep 28 14:46:52 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.360s {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:46:52 devstack cinder-volume[76376]: INFO cinder.volume.drivers.lvm [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 28 14:46:52 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:46:52 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:46:52 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:46:52 devstack sudo[77177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:46:52 devstack sudo[77177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:46:52 devstack sudo[77177]: pam_unix(sudo:session): session closed for user root Sep 28 14:46:52 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.294s {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:46:52 devstack cinder-volume[76376]: DEBUG cinder.volume.drivers.lvm [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] Updating volume stats {{(pid=76376) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 14:46:52 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:46:52 devstack sudo[77180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 14:46:52 devstack sudo[77180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:46:53 devstack sudo[77180]: pam_unix(sudo:session): session closed for user root Sep 28 14:46:53 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:46:53 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:46:53 devstack sudo[77189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:46:53 devstack sudo[77189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:46:53 devstack sudo[77189]: pam_unix(sudo:session): session closed for user root Sep 28 14:46:53 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:46:53 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:46:53 devstack sudo[77192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:46:53 devstack sudo[77192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:46:53 devstack sudo[77192]: pam_unix(sudo:session): session closed for user root Sep 28 14:46:53 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.283s {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:46:53 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:46:53 devstack sudo[77195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:46:53 devstack sudo[77195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:46:54 devstack sudo[77195]: pam_unix(sudo:session): session closed for user root Sep 28 14:46:54 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:46:54 devstack cinder-volume[76376]: INFO cinder.volume.driver [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] Driver hasn't implemented _init_vendor_properties() Sep 28 14:46:54 devstack cinder-volume[76376]: DEBUG cinder.volume.driver [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76376) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 14:46:54 devstack cinder-volume[76376]: DEBUG oslo_db.sqlalchemy.engines [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76376) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:46:54 devstack cinder-volume[76376]: DEBUG dbcounter [-] [76376] Writer thread running {{(pid=76376) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 14:46:54 devstack cinder-volume[76376]: DEBUG cinder.db.api [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] Building query based on filter {{(pid=76376) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 14:46:54 devstack cinder-volume[76376]: DEBUG cinder.image.image_utils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76376) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 14:46:54 devstack cinder-volume[76376]: INFO cinder.keymgr.migration [None req-279e67f0-0541-4bc2-822a-d4430a01497c None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 14:46:54 devstack cinder-volume[76376]: DEBUG cinder.volume.drivers.lvm [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] Updating volume stats {{(pid=76376) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 14:46:54 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:46:54 devstack sudo[77199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 14:46:54 devstack sudo[77199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:46:54 devstack sudo[77199]: pam_unix(sudo:session): session closed for user root Sep 28 14:46:54 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.242s {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:46:54 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:46:54 devstack sudo[77202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:46:54 devstack sudo[77202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:46:54 devstack sudo[77202]: pam_unix(sudo:session): session closed for user root Sep 28 14:46:54 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:46:54 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:46:54 devstack sudo[77207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:46:54 devstack sudo[77207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:46:55 devstack sudo[77207]: pam_unix(sudo:session): session closed for user root Sep 28 14:46:55 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.274s {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:46:55 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:46:55 devstack sudo[77210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:46:55 devstack sudo[77210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:46:55 devstack sudo[77210]: pam_unix(sudo:session): session closed for user root Sep 28 14:46:55 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:46:55 devstack cinder-volume[76376]: DEBUG cinder.manager [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] Notifying Schedulers of capabilities ... {{(pid=76376) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:46:55 devstack cinder-volume[76376]: INFO cinder.volume.manager [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] Driver initialization completed successfully. Sep 28 14:46:55 devstack cinder-volume[76376]: INFO cinder.manager [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] Initiating service 2 cleanup Sep 28 14:46:55 devstack cinder-volume[76376]: INFO cinder.manager [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] Service 2 cleanup completed. Sep 28 14:46:55 devstack cinder-volume[76376]: DEBUG cinder.service [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] Creating RPC server for service cinder-volume {{(pid=76376) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 14:46:55 devstack cinder-volume[76376]: DEBUG cinder.service [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76376) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 14:46:55 devstack cinder-volume[76376]: INFO cinder.volume.manager [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 28 14:46:55 devstack cinder-volume[76376]: DEBUG cinder.volume.drivers.lvm [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] Updating volume stats {{(pid=76376) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 14:46:55 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:46:55 devstack sudo[77214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 14:46:55 devstack sudo[77214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:46:55 devstack sudo[77214]: pam_unix(sudo:session): session closed for user root Sep 28 14:46:55 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:46:55 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:46:55 devstack sudo[77217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:46:55 devstack sudo[77217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:46:56 devstack sudo[77217]: pam_unix(sudo:session): session closed for user root Sep 28 14:46:56 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.293s {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:46:56 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:46:56 devstack sudo[77222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:46:56 devstack sudo[77222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:46:56 devstack sudo[77222]: pam_unix(sudo:session): session closed for user root Sep 28 14:46:56 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.271s {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:46:56 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:46:56 devstack sudo[77225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:46:56 devstack sudo[77225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:46:56 devstack sudo[77225]: pam_unix(sudo:session): session closed for user root Sep 28 14:46:56 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:46:56 devstack cinder-volume[76376]: INFO cinder.volume.manager [None req-4a5762f9-36c1-4732-913f-c8c0ffb8e15f None None] Driver post RPC initialization completed successfully. Sep 28 14:46:58 devstack cinder-volume[76216]: DEBUG dbcounter [-] [76216] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76216) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:47:06 devstack cinder-volume[76376]: DEBUG dbcounter [-] [76376] Writing DB stats cinder:SELECT=3 {{(pid=76376) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:47:06 devstack cinder-volume[76376]: DEBUG dbcounter [-] [76376] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76376) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:47:43 devstack cinder-volume[76376]: DEBUG oslo_service.periodic_task [None req-c9a06a58-27cc-438e-9d14-c06fe5abfde0 None None] Running periodic task VolumeManager._thread_info {{(pid=76376) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:47:43 devstack cinder-volume[76376]: DEBUG cinder.volume.manager [None req-c9a06a58-27cc-438e-9d14-c06fe5abfde0 None None] thread count: 6 {{(pid=76376) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 14:47:43 devstack cinder-volume[76376]: DEBUG cinder.volume.manager [None req-c9a06a58-27cc-438e-9d14-c06fe5abfde0 None None] thread info: [<_MainThread(MainThread, started 126469675372672)>, , , , , ] {{(pid=76376) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 14:48:43 devstack cinder-volume[76376]: DEBUG oslo_service.periodic_task [None req-c9a06a58-27cc-438e-9d14-c06fe5abfde0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76376) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:48:43 devstack cinder-volume[76376]: DEBUG cinder.volume.drivers.lvm [None req-c9a06a58-27cc-438e-9d14-c06fe5abfde0 None None] Updating volume stats {{(pid=76376) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 14:48:43 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-c9a06a58-27cc-438e-9d14-c06fe5abfde0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:48:43 devstack sudo[82343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 14:48:43 devstack sudo[82343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:48:43 devstack sudo[82343]: pam_unix(sudo:session): session closed for user root Sep 28 14:48:43 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-c9a06a58-27cc-438e-9d14-c06fe5abfde0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.323s {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:48:43 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-c9a06a58-27cc-438e-9d14-c06fe5abfde0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:48:43 devstack sudo[82348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:48:43 devstack sudo[82348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:48:44 devstack sudo[82348]: pam_unix(sudo:session): session closed for user root Sep 28 14:48:44 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-c9a06a58-27cc-438e-9d14-c06fe5abfde0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:48:44 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-c9a06a58-27cc-438e-9d14-c06fe5abfde0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:48:44 devstack sudo[82351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:48:44 devstack sudo[82351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:48:44 devstack sudo[82351]: pam_unix(sudo:session): session closed for user root Sep 28 14:48:44 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-c9a06a58-27cc-438e-9d14-c06fe5abfde0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.286s {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:48:44 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-c9a06a58-27cc-438e-9d14-c06fe5abfde0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:48:44 devstack sudo[82354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:48:44 devstack sudo[82354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:48:44 devstack sudo[82354]: pam_unix(sudo:session): session closed for user root Sep 28 14:48:44 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-c9a06a58-27cc-438e-9d14-c06fe5abfde0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:48:44 devstack cinder-volume[76376]: DEBUG cinder.manager [None req-c9a06a58-27cc-438e-9d14-c06fe5abfde0 None None] Notifying Schedulers of capabilities ... {{(pid=76376) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:48:44 devstack cinder-volume[76376]: DEBUG oslo_service.periodic_task [None req-c9a06a58-27cc-438e-9d14-c06fe5abfde0 None None] Running periodic task VolumeManager._thread_info {{(pid=76376) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:48:44 devstack cinder-volume[76376]: DEBUG cinder.volume.manager [None req-c9a06a58-27cc-438e-9d14-c06fe5abfde0 None None] thread count: 6 {{(pid=76376) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 14:48:44 devstack cinder-volume[76376]: DEBUG cinder.volume.manager [None req-c9a06a58-27cc-438e-9d14-c06fe5abfde0 None None] thread info: [<_MainThread(MainThread, started 126469675372672)>, , , , , ] {{(pid=76376) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 14:49:06 devstack cinder-volume[76376]: DEBUG dbcounter [-] [76376] Writing DB stats cinder:SELECT=1 {{(pid=76376) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:49:06 devstack cinder-volume[76376]: DEBUG dbcounter [-] [76376] Writing DB stats cinder:UPDATE=1 {{(pid=76376) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:49:43 devstack cinder-volume[76376]: DEBUG oslo_service.periodic_task [None req-c9a06a58-27cc-438e-9d14-c06fe5abfde0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76376) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:49:43 devstack cinder-volume[76376]: DEBUG cinder.volume.drivers.lvm [None req-c9a06a58-27cc-438e-9d14-c06fe5abfde0 None None] Updating volume stats {{(pid=76376) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 14:49:43 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-c9a06a58-27cc-438e-9d14-c06fe5abfde0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:49:43 devstack sudo[84111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 14:49:43 devstack sudo[84111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:49:43 devstack sudo[84111]: pam_unix(sudo:session): session closed for user root Sep 28 14:49:43 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-c9a06a58-27cc-438e-9d14-c06fe5abfde0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:49:43 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-c9a06a58-27cc-438e-9d14-c06fe5abfde0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:49:43 devstack sudo[84114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:49:43 devstack sudo[84114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:49:44 devstack sudo[84114]: pam_unix(sudo:session): session closed for user root Sep 28 14:49:44 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-c9a06a58-27cc-438e-9d14-c06fe5abfde0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:49:44 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-c9a06a58-27cc-438e-9d14-c06fe5abfde0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:49:44 devstack sudo[84119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:49:44 devstack sudo[84119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:49:44 devstack sudo[84119]: pam_unix(sudo:session): session closed for user root Sep 28 14:49:44 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-c9a06a58-27cc-438e-9d14-c06fe5abfde0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:49:44 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-c9a06a58-27cc-438e-9d14-c06fe5abfde0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:49:44 devstack sudo[84131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:49:44 devstack sudo[84131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:49:44 devstack sudo[84131]: pam_unix(sudo:session): session closed for user root Sep 28 14:49:44 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-c9a06a58-27cc-438e-9d14-c06fe5abfde0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:49:44 devstack cinder-volume[76376]: DEBUG cinder.manager [None req-c9a06a58-27cc-438e-9d14-c06fe5abfde0 None None] Notifying Schedulers of capabilities ... {{(pid=76376) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:49:44 devstack cinder-volume[76376]: DEBUG oslo_service.periodic_task [None req-c9a06a58-27cc-438e-9d14-c06fe5abfde0 None None] Running periodic task VolumeManager._thread_info {{(pid=76376) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:49:44 devstack cinder-volume[76376]: DEBUG cinder.volume.manager [None req-c9a06a58-27cc-438e-9d14-c06fe5abfde0 None None] thread count: 6 {{(pid=76376) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 14:49:44 devstack cinder-volume[76376]: DEBUG cinder.volume.manager [None req-c9a06a58-27cc-438e-9d14-c06fe5abfde0 None None] thread info: [<_MainThread(MainThread, started 126469675372672)>, , , , , ] {{(pid=76376) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 14:50:43 devstack cinder-volume[76376]: DEBUG oslo_service.periodic_task [None req-c9a06a58-27cc-438e-9d14-c06fe5abfde0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76376) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:50:43 devstack cinder-volume[76376]: DEBUG cinder.volume.drivers.lvm [None req-c9a06a58-27cc-438e-9d14-c06fe5abfde0 None None] Updating volume stats {{(pid=76376) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 14:50:43 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-c9a06a58-27cc-438e-9d14-c06fe5abfde0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:50:43 devstack sudo[85464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 14:50:43 devstack sudo[85464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:50:43 devstack sudo[85464]: pam_unix(sudo:session): session closed for user root Sep 28 14:50:43 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-c9a06a58-27cc-438e-9d14-c06fe5abfde0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:50:43 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-c9a06a58-27cc-438e-9d14-c06fe5abfde0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:50:43 devstack sudo[85470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:50:43 devstack sudo[85470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:50:44 devstack sudo[85470]: pam_unix(sudo:session): session closed for user root Sep 28 14:50:44 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-c9a06a58-27cc-438e-9d14-c06fe5abfde0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:50:44 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-c9a06a58-27cc-438e-9d14-c06fe5abfde0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:50:44 devstack sudo[85473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:50:44 devstack sudo[85473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:50:44 devstack sudo[85473]: pam_unix(sudo:session): session closed for user root Sep 28 14:50:44 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-c9a06a58-27cc-438e-9d14-c06fe5abfde0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.248s {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:50:44 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-c9a06a58-27cc-438e-9d14-c06fe5abfde0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:50:44 devstack sudo[85476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:50:44 devstack sudo[85476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:50:44 devstack sudo[85476]: pam_unix(sudo:session): session closed for user root Sep 28 14:50:44 devstack cinder-volume[76376]: DEBUG oslo_concurrency.processutils [None req-c9a06a58-27cc-438e-9d14-c06fe5abfde0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.242s {{(pid=76376) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:50:44 devstack cinder-volume[76376]: DEBUG cinder.manager [None req-c9a06a58-27cc-438e-9d14-c06fe5abfde0 None None] Notifying Schedulers of capabilities ... {{(pid=76376) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:50:44 devstack cinder-volume[76376]: DEBUG oslo_service.periodic_task [None req-c9a06a58-27cc-438e-9d14-c06fe5abfde0 None None] Running periodic task VolumeManager._thread_info {{(pid=76376) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:50:44 devstack cinder-volume[76376]: DEBUG cinder.volume.manager [None req-c9a06a58-27cc-438e-9d14-c06fe5abfde0 None None] thread count: 6 {{(pid=76376) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 14:50:44 devstack cinder-volume[76376]: DEBUG cinder.volume.manager [None req-c9a06a58-27cc-438e-9d14-c06fe5abfde0 None None] thread info: [<_MainThread(MainThread, started 126469675372672)>, , , , , ] {{(pid=76376) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 14:51:06 devstack cinder-volume[76376]: DEBUG dbcounter [-] [76376] Writing DB stats cinder:SELECT=1 {{(pid=76376) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:51:06 devstack cinder-volume[76376]: DEBUG dbcounter [-] [76376] Writing DB stats cinder:UPDATE=1 {{(pid=76376) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:51:18 devstack cinder-volume[76216]: INFO oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] Caught SIGTERM, stopping children Sep 28 14:51:18 devstack cinder-volume[76216]: DEBUG oslo_concurrency.lockutils [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] Acquiring lock "singleton_lock" {{(pid=76216) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 14:51:18 devstack cinder-volume[76216]: DEBUG oslo_concurrency.lockutils [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] Acquired lock "singleton_lock" {{(pid=76216) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 14:51:18 devstack cinder-volume[76216]: DEBUG oslo_concurrency.lockutils [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] Releasing lock "singleton_lock" {{(pid=76216) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 14:51:18 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] Stop services. {{(pid=76216) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 28 14:51:18 devstack cinder-volume[76216]: DEBUG oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] Killing children. {{(pid=76216) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 28 14:51:18 devstack cinder-volume[76216]: INFO oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] Waiting on 1 children to exit Sep 28 14:51:20 devstack cinder-volume[76376]: DEBUG oslo_concurrency.lockutils [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] Acquiring lock "singleton_lock" {{(pid=76376) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 14:51:20 devstack cinder-volume[76376]: DEBUG oslo_concurrency.lockutils [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] Acquired lock "singleton_lock" {{(pid=76376) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 14:51:20 devstack cinder-volume[76376]: DEBUG oslo_concurrency.lockutils [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] Releasing lock "singleton_lock" {{(pid=76376) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 14:51:20 devstack cinder-volume[76376]: WARNING amqp [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 14:51:20 devstack cinder-volume[76376]: WARNING amqp [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 14:51:20 devstack cinder-volume[76216]: INFO oslo_service.backend._eventlet.service [None req-182c5cdf-171c-4a1f-af00-eb1d87fcf345 None None] Child 76376 exited with status 0 Sep 28 14:51:20 devstack cinder-volume[86283]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 14:51:20 devstack cinder-volume[86283]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 14:51:20 devstack cinder-volume[86283]: we strongly recommend against using it for new projects. Sep 28 14:51:20 devstack cinder-volume[86283]: If you are already using Eventlet, we recommend migrating to a different Sep 28 14:51:20 devstack cinder-volume[86283]: framework. For more detail see Sep 28 14:51:20 devstack cinder-volume[86283]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 14:51:20 devstack cinder-volume[86283]: import eventlet # noqa Sep 28 14:51:22 devstack cinder-volume[86283]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86283) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 14:51:22 devstack cinder-volume[86283]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86283) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 14:51:22 devstack cinder-volume[86283]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86283) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 14:51:23 devstack cinder-volume[86283]: INFO dbcounter [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] Registered counter for database cinder Sep 28 14:51:23 devstack cinder-volume[86283]: DEBUG oslo_db.sqlalchemy.engines [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86283) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:51:23 devstack cinder-volume[86283]: DEBUG dbcounter [-] [86283] Writer thread running {{(pid=86283) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 14:51:23 devstack cinder-volume[86283]: INFO cinder.rpc [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 14:51:23 devstack cinder-volume[86283]: INFO cinder.rpc [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_db.sqlalchemy.engines [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86283) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:51:24 devstack cinder-volume[86283]: INFO cinder.volume.manager [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] Determined volume DB was empty at startup. Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG cinder.volume.manager [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86283) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 14:51:24 devstack cinder-volume[86283]: INFO cinder.volume.manager [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 28 14:51:24 devstack cinder-volume[86283]: WARNING stevedore.named [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 14:51:24 devstack cinder-volume[86283]: WARNING castellan.key_manager [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 14:51:24 devstack cinder-volume[86283]: WARNING cinder.keymgr.conf_key_mgr [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 14:51:24 devstack cinder-volume[86283]: INFO cinder.volume.manager [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_db.sqlalchemy.engines [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86283) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:51:24 devstack cinder-volume[86283]: INFO oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] Starting 1 workers Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] Started child 86498 {{(pid=86283) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] Full set of CONF: {{(pid=86283) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] ******************************************************************************** {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] Configuration options gathered from: {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] ================================================================================ {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] allow_availability_zone_fallback = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86498]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] allow_compression_on_image_upload = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] allowed_direct_url_schemes = [] {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] api_rate_limit = True {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] auth_strategy = keystone {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_availability_zone = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_host = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_name = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_stats_polling_interval = 60 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backup_api_class = cinder.backup.api.API {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backup_name_template = backup-%s {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backup_use_same_host = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backup_use_temp_snapshot = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] chap_password = **** {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] chap_username = {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] cinder_internal_tenant_project_id = 4d374c4d6193413188d9270a2d433ea5 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] cinder_internal_tenant_user_id = 0adb6f3061e447218ceb6a4acd86ea0e {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] cluster = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] compression_format = gzip {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] compute_api_class = cinder.compute.nova.API {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] config_dir = [] {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] config_source = [] {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] control_exchange = openstack {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] debug = True {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] default_availability_zone = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] default_group_type = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] default_volume_type = QuobyteHD {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] disk_geometry = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] driver_client_cert = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] driver_client_cert_key = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] driver_data_namespace = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] driver_ssl_cert_path = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] driver_ssl_cert_verify = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] driver_use_ssl = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] enable_new_services = True {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] enable_unsupported_driver = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] enabled_backends = ['QuobyteHD'] {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] enforce_multipath_for_image_xfer = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] filter_function = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] glance_api_insecure = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] glance_api_servers = ['http://192.168.122.219/image'] {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] glance_api_ssl_compression = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] glance_ca_certificates_file = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] glance_catalog_info = image:glance:publicURL {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] glance_certfile = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] glance_keyfile = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] glance_num_retries = 3 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] glance_request_timeout = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] goodness_function = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] graceful_shutdown_timeout = 5 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] group_api_class = cinder.group.api.API {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] host = devstack {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] image_compress_on_upload = True {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] image_conversion_address_space_limit = 1 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] image_conversion_cpu_limit = 60 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] image_conversion_disable = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] image_introspection_address_space_limit = 1 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] image_introspection_cpu_limit = 60 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] image_upload_use_cinder_backend = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] image_upload_use_internal_tenant = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] image_volume_cache_enabled = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] image_volume_cache_max_count = 0 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] image_volume_cache_max_size_gb = 0 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] init_host_max_objects_retrieval = 0 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] instance_format = [instance: %(uuid)s] {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] iscsi_target_flags = {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] iscsi_write_cache = on {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] iser_helper = tgtadm {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] iser_ip_address = 192.168.122.219 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] iser_port = 3260 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] log_color = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] log_config_append = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] log_dir = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] log_file = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] log_options = True {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] log_rotate_interval = 1 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] log_rotate_interval_type = days {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] log_rotation_type = none {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] max_age = 0 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] max_logfile_count = 30 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] max_logfile_size_mb = 200 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] max_over_subscription_ratio = 20.0 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] message_reap_interval = 86400 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] message_ttl = 2592000 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] migration_create_volume_timeout_secs = 300 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] monkey_patch = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] monkey_patch_modules = [] {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] my_ip = 192.168.122.219 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] no_snapshot_gb_quota = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] num_iser_scan_tries = 3 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] num_shell_tries = 3 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] num_volume_device_scan_tries = 3 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] nvmeof_conn_info_version = 1 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] nvmet_ns_id = 10 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] nvmet_port_id = 1 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86498]: INFO cinder.volume.manager [None req-2e50cb25-69e3-4e15-a68c-02c3f05d8f56 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] osapi_max_limit = 1000 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] osapi_volume_ext_list = [] {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86498]: DEBUG cinder.volume.drivers.remotefs [None req-2e50cb25-69e3-4e15-a68c-02c3f05d8f56 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86498) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] osapi_volume_listen_port = 8776 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] osapi_volume_use_ssl = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] osapi_volume_workers = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] per_volume_size_limit = -1 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] periodic_fuzzy_delay = 60 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] periodic_interval = 60 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] public_endpoint = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] publish_errors = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] quota_backup_gigabytes = 1000 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] quota_backups = 10 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] quota_gigabytes = 1000 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] quota_groups = 10 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] quota_snapshots = 10 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] quota_volumes = 10 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] rate_limit_burst = 0 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] rate_limit_except_level = CRITICAL {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] rate_limit_interval = 0 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] reinit_driver_count = 3 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] replication_device = **** {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] report_discard_supported = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] report_interval = 120 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] reservation_clean_interval = 86400 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] reservation_expire = 86400 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] reserved_image_namespaces = [] {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] reserved_percentage = 0 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] rpc_response_timeout = 120 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] run_external_periodic_tasks = True {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] scst_target_driver = iscsi {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] scst_target_iqn_name = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] service_down_time = 720 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] shell_completion = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] snapshot_name_template = snapshot-%s {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] split_loggers = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] state_path = /opt/stack/data/cinder {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] storage_availability_zone = nova {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] storage_protocol = iSCSI {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] syslog_log_facility = LOG_USER {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] target_helper = lioadm {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] target_ip_address = 192.168.122.219 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] target_port = 3260 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] target_protocol = iscsi {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] target_secondary_ip_addresses = [] {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] trace_flags = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] transport_url = **** {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] until_refresh = 0 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] use_chap_auth = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] use_default_quota_class = True {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] use_journal = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] use_json = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] use_multipath_for_image_xfer = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] use_stderr = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] use_syslog = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] verify_glance_signatures = enabled {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] volume_api_class = cinder.volume.api.API {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] volume_backend_name = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] volume_clear = zero {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] volume_clear_ionice = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] volume_clear_size = 0 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] volume_copy_bps_limit = 0 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] volume_dd_blocksize = 1M {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] volume_name_template = volume-%s {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] volume_service_inithost_offload = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] volume_usage_audit_period = month {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] zoning_mode = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_concurrency.disable_process_locking = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] keystone_authtoken.auth_section = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] keystone_authtoken.auth_type = password {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] keystone_authtoken.auth_version = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] keystone_authtoken.cache = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] keystone_authtoken.certfile = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] keystone_authtoken.include_service_catalog = True {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] keystone_authtoken.insecure = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] keystone_authtoken.interface = public {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] keystone_authtoken.keyfile = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] keystone_authtoken.memcache_password = **** {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] keystone_authtoken.memcache_username = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] keystone_authtoken.region_name = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] keystone_authtoken.service_type = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.219/identity {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] cache.backend = dogpile.cache.null {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] cache.backend_argument = **** {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] cache.backend_expiration_time = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] cache.config_prefix = cache.oslo {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] cache.debug_cache_backend = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] cache.enable_retry_client = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] cache.enable_socket_keepalive = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] cache.enabled = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] cache.expiration_time = 600 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] cache.hashclient_retry_attempts = 2 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] cache.memcache_dead_retry = 300 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] cache.memcache_pool_maxsize = 10 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] cache.memcache_sasl_enabled = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] cache.password = **** {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] cache.proxies = [] {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] cache.redis_db = 0 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] cache.redis_server = localhost:6379 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] cache.retry_attempts = 2 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] cache.retry_delay = 0.0 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] cache.socket_keepalive_count = 1 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] cache.socket_keepalive_idle = 1 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] cache.socket_keepalive_interval = 1 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] cache.socket_timeout = 1.0 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] cache.tls_allowed_ciphers = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] cache.tls_cafile = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] cache.tls_certfile = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] cache.tls_enabled = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] cache.tls_keyfile = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] cache.username = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] coordination.backend_url = **** {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] database.asyncio_connection = **** {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] database.asyncio_slave_connection = **** {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] database.backend = sqlalchemy {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] database.connection = **** {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] database.connection_debug = 0 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] database.connection_parameters = {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] database.connection_recycle_time = 3600 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] database.connection_trace = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] database.db_inc_retry_interval = True {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] database.db_max_retries = 20 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] database.db_max_retry_interval = 10 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] database.db_retry_interval = 1 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] database.max_overflow = 50 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] database.max_pool_size = 5 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] database.max_retries = 10 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] database.mysql_wsrep_sync_wait = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] database.pool_timeout = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] database.retry_interval = 10 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] database.slave_connection = **** {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] database.sqlite_synchronous = True {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] database.synchronous_reader = True {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] database.use_db_reconnect = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_messaging_tracing.insecure = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] profiler.connection_string = messaging:// {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] profiler.enabled = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] profiler.es_doc_type = notification {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] profiler.es_scroll_size = 10000 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] profiler.es_scroll_time = 2m {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] profiler.filter_error_trace = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] profiler.hmac_keys = **** {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] profiler.sentinel_service_name = mymaster {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] profiler.socket_timeout = 0.1 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] profiler.trace_requests = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] profiler.trace_sqlalchemy = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] profiler_jaeger.process_tags = {} {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] profiler_jaeger.service_name_prefix = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] profiler_otlp.service_name_prefix = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_policy.enforce_new_defaults = True {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_policy.policy_default_rule = default {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_policy.policy_file = policy.yaml {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] privsep_osbrick.group = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] privsep_osbrick.helper_command = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] privsep_osbrick.user = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] cinder_sys_admin.group = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] cinder_sys_admin.helper_command = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] cinder_sys_admin.user = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] service_user.auth_section = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] service_user.auth_type = password {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] service_user.cafile = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] service_user.certfile = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] service_user.collect_timing = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] service_user.insecure = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] service_user.keyfile = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] service_user.send_service_user_token = True {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] service_user.split_loggers = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] service_user.timeout = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] service_user.tls_ciphers = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] service_user.tls_min_version = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] glance.auth_section = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] glance.auth_type = password {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] glance.certfile = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] glance.collect_timing = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] glance.insecure = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] glance.keyfile = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] glance.region_name = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] glance.split_loggers = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] glance.timeout = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] glance.tls_ciphers = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] glance.tls_min_version = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.backend_availability_zone = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.chap_password = **** {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.chap_username = {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.disk_geometry = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.driver_client_cert = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.driver_client_cert_key = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.driver_data_namespace = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.driver_use_ssl = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.extra_capabilities = {} {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.filter_function = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.goodness_function = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.iscsi_target_flags = {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.iscsi_write_cache = on {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.iser_helper = tgtadm {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.iser_ip_address = 192.168.122.219 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.iser_port = 3260 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.nas_host = {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.nas_login = admin {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.nas_mount_options = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.nas_password = **** {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.nas_private_key = {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.nas_share_path = {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.num_shell_tries = 3 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.quobyte_volume_url = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.replication_device = **** {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.report_discard_supported = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.reserved_percentage = 0 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.target_helper = tgtadm {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.target_ip_address = 192.168.122.219 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.target_port = 3260 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.target_protocol = iscsi {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.trace_flags = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.unique_fqdn_network = True {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.use_chap_auth = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.volume_backend_name = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.volume_clear = zero {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.volume_clear_ionice = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.volume_clear_size = 0 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_reports.file_event_handler = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_reports.log_dir = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.backend_availability_zone = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.backend_host = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.chap_password = **** {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.chap_username = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86498]: DEBUG cinder.volume.drivers.quobyte [None req-2e50cb25-69e3-4e15-a68c-02c3f05d8f56 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86498) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.chiscsi_conf = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.disk_geometry = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.driver_client_cert = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.driver_data_namespace = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.driver_use_ssl = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.extra_capabilities = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.filter_function = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.goodness_function = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.iser_helper = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.iser_ip_address = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.iser_port = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.iser_target_prefix = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.nas_host = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.nas_login = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.nas_mount_options = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.nas_password = **** {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86498]: WARNING cinder.volume.drivers.quobyte [None req-2e50cb25-69e3-4e15-a68c-02c3f05d8f56 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.nas_private_key = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86498]: WARNING cinder.volume.drivers.quobyte [None req-2e50cb25-69e3-4e15-a68c-02c3f05d8f56 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.nas_share_path = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.nas_ssh_port = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.num_shell_tries = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.nvmet_port_id = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86498]: DEBUG oslo_concurrency.processutils [None req-2e50cb25-69e3-4e15-a68c-02c3f05d8f56 None None] Running cmd (subprocess): mount.quobyte {{(pid=86498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.replication_device = **** {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.report_discard_supported = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.reserved_percentage = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.scst_target_driver = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.storage_protocol = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.target_helper = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.target_ip_address = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.target_port = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.target_prefix = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.target_protocol = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.trace_flags = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.use_chap_auth = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.volume_clear = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.volume_clear_size = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] QuobyteHD.volumes_dir = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_messaging_rabbit.ssl = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_messaging_notifications.driver = [] {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_messaging_notifications.retry = -1 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] key_manager.fixed_key = **** {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] barbican.barbican_api_version = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] barbican.barbican_endpoint = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] barbican.barbican_endpoint_type = public {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] barbican.barbican_region_name = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] barbican.cafile = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] barbican.certfile = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] barbican.collect_timing = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] barbican.insecure = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] barbican.keyfile = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] barbican.number_of_retries = 60 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] barbican.retry_delay = 1 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] barbican.send_service_user_token = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] barbican.split_loggers = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] barbican.timeout = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] barbican.tls_ciphers = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] barbican.tls_min_version = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] barbican.verify_ssl = True {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] barbican.verify_ssl_path = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] barbican_service_user.auth_section = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] barbican_service_user.auth_type = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] barbican_service_user.cafile = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] barbican_service_user.certfile = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] barbican_service_user.collect_timing = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] barbican_service_user.insecure = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] barbican_service_user.keyfile = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] barbican_service_user.split_loggers = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] barbican_service_user.timeout = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] barbican_service_user.tls_ciphers = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] barbican_service_user.tls_min_version = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] vault.approle_role_id = **** {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] vault.approle_secret_id = **** {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] vault.auth_method = approle {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] vault.auth_path = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] vault.kv_mountpoint = secret {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] vault.kv_path = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] vault.kv_version = 2 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] vault.namespace = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] vault.root_token_id = **** {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] vault.ssl_ca_crt_file = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] vault.timeout = 60.0 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] vault.token_file = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] vault.token_role = None {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] vault.use_ssl = False {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:24 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] ******************************************************************************** {{(pid=86283) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 14:51:24 devstack quobyte-client[86502]: Reading configuration file: /etc/quobyte/client.cfg Sep 28 14:51:24 devstack quobyte-client[86502]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 28 14:51:24 devstack cinder-volume[86498]: DEBUG oslo_concurrency.processutils [None req-2e50cb25-69e3-4e15-a68c-02c3f05d8f56 None None] CMD "mount.quobyte" returned: 1 in 0.109s {{(pid=86498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:51:24 devstack cinder-volume[86498]: DEBUG oslo_concurrency.lockutils [None req-2e50cb25-69e3-4e15-a68c-02c3f05d8f56 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:51:24 devstack cinder-volume[86498]: DEBUG oslo_concurrency.lockutils [None req-2e50cb25-69e3-4e15-a68c-02c3f05d8f56 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:51:24 devstack cinder-volume[86498]: DEBUG cinder.volume.drivers.quobyte [None req-2e50cb25-69e3-4e15-a68c-02c3f05d8f56 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=86498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:51:24 devstack cinder-volume[86498]: INFO cinder.volume.drivers.quobyte [None req-2e50cb25-69e3-4e15-a68c-02c3f05d8f56 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 ... Sep 28 14:51:24 devstack cinder-volume[86498]: DEBUG oslo_concurrency.processutils [None req-2e50cb25-69e3-4e15-a68c-02c3f05d8f56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb -c /etc/quobyte/client-cinder.cfg {{(pid=86498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:51:24 devstack sudo[86504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb -c /etc/quobyte/client-cinder.cfg Sep 28 14:51:24 devstack sudo[86504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:51:25 devstack sudo[86504]: pam_unix(sudo:session): session closed for user root Sep 28 14:51:25 devstack cinder-volume[86498]: DEBUG oslo_concurrency.processutils [None req-2e50cb25-69e3-4e15-a68c-02c3f05d8f56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.390s {{(pid=86498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:51:25 devstack cinder-volume[86498]: INFO cinder.volume.drivers.quobyte [None req-2e50cb25-69e3-4e15-a68c-02c3f05d8f56 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 succeeded Sep 28 14:51:25 devstack cinder-volume[86498]: DEBUG cinder.volume.drivers.quobyte [None req-2e50cb25-69e3-4e15-a68c-02c3f05d8f56 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=86498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:51:25 devstack cinder-volume[86498]: DEBUG oslo_concurrency.lockutils [None req-2e50cb25-69e3-4e15-a68c-02c3f05d8f56 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.405s {{(pid=86498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:51:25 devstack cinder-volume[86498]: DEBUG oslo_concurrency.processutils [None req-2e50cb25-69e3-4e15-a68c-02c3f05d8f56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=86498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:51:25 devstack sudo[86603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 14:51:25 devstack sudo[86603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:51:25 devstack sudo[86603]: pam_unix(sudo:session): session closed for user root Sep 28 14:51:25 devstack cinder-volume[86498]: DEBUG oslo_concurrency.processutils [None req-2e50cb25-69e3-4e15-a68c-02c3f05d8f56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.251s {{(pid=86498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:51:25 devstack cinder-volume[86498]: INFO cinder.volume.driver [None req-2e50cb25-69e3-4e15-a68c-02c3f05d8f56 None None] Driver hasn't implemented _init_vendor_properties() Sep 28 14:51:25 devstack cinder-volume[86498]: DEBUG cinder.volume.driver [None req-2e50cb25-69e3-4e15-a68c-02c3f05d8f56 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.2063941955566, 'free_capacity_gb': 1775.2063941955566, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86498) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 14:51:25 devstack cinder-volume[86498]: DEBUG oslo_db.sqlalchemy.engines [None req-2e50cb25-69e3-4e15-a68c-02c3f05d8f56 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86498) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:51:25 devstack cinder-volume[86498]: DEBUG dbcounter [-] [86498] Writer thread running {{(pid=86498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 14:51:25 devstack cinder-volume[86498]: DEBUG cinder.db.api [None req-2e50cb25-69e3-4e15-a68c-02c3f05d8f56 None None] Building query based on filter {{(pid=86498) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 14:51:25 devstack cinder-volume[86498]: DEBUG cinder.image.image_utils [None req-2e50cb25-69e3-4e15-a68c-02c3f05d8f56 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86498) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 14:51:25 devstack cinder-volume[86498]: INFO cinder.keymgr.migration [None req-65c6dc2e-85c6-42b1-ac43-8a8673a78875 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 14:51:25 devstack cinder-volume[86498]: DEBUG oslo_concurrency.lockutils [None req-2e50cb25-69e3-4e15-a68c-02c3f05d8f56 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:51:25 devstack cinder-volume[86498]: DEBUG oslo_concurrency.lockutils [None req-2e50cb25-69e3-4e15-a68c-02c3f05d8f56 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:51:25 devstack cinder-volume[86498]: DEBUG cinder.volume.drivers.quobyte [None req-2e50cb25-69e3-4e15-a68c-02c3f05d8f56 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=86498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:51:25 devstack cinder-volume[86498]: DEBUG cinder.volume.drivers.quobyte [None req-2e50cb25-69e3-4e15-a68c-02c3f05d8f56 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=86498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:51:25 devstack cinder-volume[86498]: DEBUG oslo_concurrency.lockutils [None req-2e50cb25-69e3-4e15-a68c-02c3f05d8f56 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:51:25 devstack cinder-volume[86498]: DEBUG oslo_concurrency.processutils [None req-2e50cb25-69e3-4e15-a68c-02c3f05d8f56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=86498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:51:25 devstack sudo[86606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 14:51:25 devstack sudo[86606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:51:25 devstack sudo[86606]: pam_unix(sudo:session): session closed for user root Sep 28 14:51:25 devstack cinder-volume[86498]: DEBUG oslo_concurrency.processutils [None req-2e50cb25-69e3-4e15-a68c-02c3f05d8f56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.253s {{(pid=86498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:51:25 devstack cinder-volume[86498]: DEBUG cinder.manager [None req-2e50cb25-69e3-4e15-a68c-02c3f05d8f56 None None] Notifying Schedulers of capabilities ... {{(pid=86498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:51:25 devstack cinder-volume[86498]: INFO cinder.volume.manager [None req-2e50cb25-69e3-4e15-a68c-02c3f05d8f56 None None] Driver initialization completed successfully. Sep 28 14:51:25 devstack cinder-volume[86498]: INFO cinder.manager [None req-2e50cb25-69e3-4e15-a68c-02c3f05d8f56 None None] Initiating service 3 cleanup Sep 28 14:51:25 devstack cinder-volume[86498]: INFO cinder.manager [None req-2e50cb25-69e3-4e15-a68c-02c3f05d8f56 None None] Service 3 cleanup completed. Sep 28 14:51:25 devstack cinder-volume[86498]: DEBUG cinder.service [None req-2e50cb25-69e3-4e15-a68c-02c3f05d8f56 None None] Creating RPC server for service cinder-volume {{(pid=86498) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 14:51:25 devstack cinder-volume[86498]: DEBUG cinder.service [None req-2e50cb25-69e3-4e15-a68c-02c3f05d8f56 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86498) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 14:51:25 devstack cinder-volume[86498]: INFO cinder.volume.manager [None req-2e50cb25-69e3-4e15-a68c-02c3f05d8f56 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 28 14:51:25 devstack cinder-volume[86498]: DEBUG oslo_concurrency.lockutils [None req-2e50cb25-69e3-4e15-a68c-02c3f05d8f56 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:51:25 devstack cinder-volume[86498]: DEBUG oslo_concurrency.lockutils [None req-2e50cb25-69e3-4e15-a68c-02c3f05d8f56 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:51:25 devstack cinder-volume[86498]: DEBUG cinder.volume.drivers.quobyte [None req-2e50cb25-69e3-4e15-a68c-02c3f05d8f56 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=86498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:51:25 devstack cinder-volume[86498]: DEBUG cinder.volume.drivers.quobyte [None req-2e50cb25-69e3-4e15-a68c-02c3f05d8f56 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=86498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:51:25 devstack cinder-volume[86498]: DEBUG oslo_concurrency.lockutils [None req-2e50cb25-69e3-4e15-a68c-02c3f05d8f56 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:51:25 devstack cinder-volume[86498]: DEBUG oslo_concurrency.processutils [None req-2e50cb25-69e3-4e15-a68c-02c3f05d8f56 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=86498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:51:25 devstack sudo[86609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 14:51:25 devstack sudo[86609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:51:26 devstack sudo[86609]: pam_unix(sudo:session): session closed for user root Sep 28 14:51:26 devstack cinder-volume[86498]: DEBUG oslo_concurrency.processutils [None req-2e50cb25-69e3-4e15-a68c-02c3f05d8f56 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.254s {{(pid=86498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:51:26 devstack cinder-volume[86498]: INFO cinder.volume.manager [None req-2e50cb25-69e3-4e15-a68c-02c3f05d8f56 None None] Driver post RPC initialization completed successfully. Sep 28 14:51:30 devstack cinder-volume[86498]: DEBUG oslo_concurrency.lockutils [None req-8e3e1511-d690-482f-bb53-36ec0134f2c9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:51:30 devstack cinder-volume[86498]: DEBUG oslo_concurrency.lockutils [None req-8e3e1511-d690-482f-bb53-36ec0134f2c9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:51:30 devstack cinder-volume[86498]: DEBUG cinder.volume.drivers.quobyte [None req-8e3e1511-d690-482f-bb53-36ec0134f2c9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=86498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:51:30 devstack cinder-volume[86498]: DEBUG cinder.volume.drivers.quobyte [None req-8e3e1511-d690-482f-bb53-36ec0134f2c9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=86498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:51:30 devstack cinder-volume[86498]: DEBUG oslo_concurrency.lockutils [None req-8e3e1511-d690-482f-bb53-36ec0134f2c9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:51:30 devstack cinder-volume[86498]: DEBUG oslo_concurrency.processutils [None req-8e3e1511-d690-482f-bb53-36ec0134f2c9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=86498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:51:30 devstack sudo[86740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 14:51:30 devstack sudo[86740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:51:30 devstack sudo[86740]: pam_unix(sudo:session): session closed for user root Sep 28 14:51:30 devstack cinder-volume[86498]: DEBUG oslo_concurrency.processutils [None req-8e3e1511-d690-482f-bb53-36ec0134f2c9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.241s {{(pid=86498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:51:30 devstack cinder-volume[86498]: DEBUG cinder.manager [None req-8e3e1511-d690-482f-bb53-36ec0134f2c9 None None] Notifying Schedulers of capabilities ... {{(pid=86498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:51:31 devstack cinder-volume[86283]: INFO oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] Caught SIGTERM, stopping children Sep 28 14:51:31 devstack cinder-volume[86283]: DEBUG oslo_concurrency.lockutils [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] Acquiring lock "singleton_lock" {{(pid=86283) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 14:51:31 devstack cinder-volume[86283]: DEBUG oslo_concurrency.lockutils [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] Acquired lock "singleton_lock" {{(pid=86283) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 14:51:31 devstack cinder-volume[86283]: DEBUG oslo_concurrency.lockutils [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] Releasing lock "singleton_lock" {{(pid=86283) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 14:51:31 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] Stop services. {{(pid=86283) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 28 14:51:31 devstack cinder-volume[86283]: DEBUG oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] Killing children. {{(pid=86283) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 28 14:51:31 devstack cinder-volume[86283]: INFO oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] Waiting on 1 children to exit Sep 28 14:51:34 devstack cinder-volume[86498]: DEBUG oslo_concurrency.lockutils [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] Acquiring lock "singleton_lock" {{(pid=86498) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 14:51:34 devstack cinder-volume[86498]: DEBUG oslo_concurrency.lockutils [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] Acquired lock "singleton_lock" {{(pid=86498) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 14:51:34 devstack cinder-volume[86498]: DEBUG oslo_concurrency.lockutils [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] Releasing lock "singleton_lock" {{(pid=86498) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 14:51:34 devstack cinder-volume[86498]: WARNING amqp [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 14:51:34 devstack cinder-volume[86498]: WARNING amqp [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 14:51:34 devstack cinder-volume[86283]: INFO oslo_service.backend._eventlet.service [None req-9fda6b1a-f1fb-478b-b559-301fc885eb35 None None] Child 86498 exited with status 0 Sep 28 14:51:34 devstack cinder-volume[86817]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 14:51:34 devstack cinder-volume[86817]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 14:51:34 devstack cinder-volume[86817]: we strongly recommend against using it for new projects. Sep 28 14:51:34 devstack cinder-volume[86817]: If you are already using Eventlet, we recommend migrating to a different Sep 28 14:51:34 devstack cinder-volume[86817]: framework. For more detail see Sep 28 14:51:34 devstack cinder-volume[86817]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 14:51:34 devstack cinder-volume[86817]: import eventlet # noqa Sep 28 14:51:37 devstack cinder-volume[86817]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86817) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 14:51:37 devstack cinder-volume[86817]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86817) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 14:51:38 devstack cinder-volume[86817]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86817) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 14:51:39 devstack cinder-volume[86817]: INFO dbcounter [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] Registered counter for database cinder Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_db.sqlalchemy.engines [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86817) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG dbcounter [-] [86817] Writer thread running {{(pid=86817) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 14:51:39 devstack cinder-volume[86817]: INFO cinder.rpc [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 14:51:39 devstack cinder-volume[86817]: INFO cinder.rpc [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_db.sqlalchemy.engines [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86817) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:51:39 devstack cinder-volume[86817]: INFO cinder.volume.manager [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] Determined volume DB was empty at startup. Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG cinder.volume.manager [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86817) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 14:51:39 devstack cinder-volume[86817]: WARNING stevedore.named [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 14:51:39 devstack cinder-volume[86817]: WARNING castellan.key_manager [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 14:51:39 devstack cinder-volume[86817]: WARNING cinder.keymgr.conf_key_mgr [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 14:51:39 devstack cinder-volume[86817]: INFO cinder.volume.manager [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_db.sqlalchemy.engines [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86817) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:51:39 devstack cinder-volume[86817]: INFO oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] Starting 1 workers Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] Started child 87116 {{(pid=86817) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] Full set of CONF: {{(pid=86817) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] ******************************************************************************** {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] Configuration options gathered from: {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] ================================================================================ {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] allow_availability_zone_fallback = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] allow_compression_on_image_upload = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] allowed_direct_url_schemes = [] {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] api_rate_limit = True {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] auth_strategy = keystone {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_availability_zone = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_host = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_name = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_stats_polling_interval = 60 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backup_api_class = cinder.backup.api.API {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backup_name_template = backup-%s {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backup_use_same_host = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backup_use_temp_snapshot = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[87116]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] chap_password = **** {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] chap_username = {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] cinder_internal_tenant_project_id = 4d374c4d6193413188d9270a2d433ea5 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] cinder_internal_tenant_user_id = 0adb6f3061e447218ceb6a4acd86ea0e {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] cluster = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] compression_format = gzip {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] compute_api_class = cinder.compute.nova.API {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] config_dir = [] {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] config_source = [] {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] control_exchange = openstack {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] debug = True {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] default_availability_zone = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] default_group_type = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] default_volume_type = QuobyteHD {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] disk_geometry = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] driver_client_cert = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] driver_client_cert_key = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] driver_data_namespace = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] driver_ssl_cert_path = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] driver_ssl_cert_verify = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] driver_use_ssl = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] enable_new_services = True {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] enable_unsupported_driver = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] enabled_backends = ['QuobyteHD'] {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] enforce_multipath_for_image_xfer = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] filter_function = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] glance_api_insecure = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] glance_api_servers = ['http://192.168.122.219/image'] {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] glance_api_ssl_compression = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] glance_ca_certificates_file = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] glance_catalog_info = image:glance:publicURL {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] glance_certfile = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] glance_keyfile = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] glance_num_retries = 3 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] glance_request_timeout = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] goodness_function = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] graceful_shutdown_timeout = 5 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] group_api_class = cinder.group.api.API {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] host = devstack {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] image_compress_on_upload = True {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] image_conversion_address_space_limit = 1 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] image_conversion_cpu_limit = 60 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] image_conversion_disable = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] image_introspection_address_space_limit = 1 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] image_introspection_cpu_limit = 60 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] image_upload_use_cinder_backend = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] image_upload_use_internal_tenant = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] image_volume_cache_enabled = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] image_volume_cache_max_count = 0 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] image_volume_cache_max_size_gb = 0 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] init_host_max_objects_retrieval = 0 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] instance_format = [instance: %(uuid)s] {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] iscsi_target_flags = {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] iscsi_write_cache = on {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] iser_helper = tgtadm {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] iser_ip_address = 192.168.122.219 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] iser_port = 3260 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] log_color = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] log_config_append = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] log_dir = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] log_file = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] log_options = True {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] log_rotate_interval = 1 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] log_rotate_interval_type = days {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] log_rotation_type = none {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] max_age = 0 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] max_logfile_count = 30 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] max_logfile_size_mb = 200 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] max_over_subscription_ratio = 20.0 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] message_reap_interval = 86400 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] message_ttl = 2592000 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] migration_create_volume_timeout_secs = 300 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] monkey_patch = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] monkey_patch_modules = [] {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] my_ip = 192.168.122.219 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] no_snapshot_gb_quota = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] num_iser_scan_tries = 3 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] num_shell_tries = 3 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] num_volume_device_scan_tries = 3 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] nvmeof_conn_info_version = 1 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] nvmet_ns_id = 10 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] nvmet_port_id = 1 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-8fc0392c-c455-47e2-8b3a-d4fb72635dfa None None] Starting volume driver QuobyteDriver (1.2.1) Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] osapi_max_limit = 1000 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] osapi_volume_ext_list = [] {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-8fc0392c-c455-47e2-8b3a-d4fb72635dfa None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87116) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] osapi_volume_listen_port = 8776 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] osapi_volume_use_ssl = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] osapi_volume_workers = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] per_volume_size_limit = -1 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] periodic_fuzzy_delay = 60 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] periodic_interval = 60 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] public_endpoint = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] publish_errors = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] quota_backup_gigabytes = 1000 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] quota_backups = 10 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] quota_gigabytes = 1000 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] quota_groups = 10 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] quota_snapshots = 10 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] quota_volumes = 10 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] rate_limit_burst = 0 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] rate_limit_except_level = CRITICAL {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] rate_limit_interval = 0 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] reinit_driver_count = 3 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] replication_device = **** {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] report_discard_supported = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] report_interval = 120 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] reservation_clean_interval = 86400 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] reservation_expire = 86400 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] reserved_image_namespaces = [] {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] reserved_percentage = 0 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] rpc_response_timeout = 120 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] run_external_periodic_tasks = True {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] scst_target_driver = iscsi {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] scst_target_iqn_name = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] service_down_time = 720 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] shell_completion = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] snapshot_name_template = snapshot-%s {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] split_loggers = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] state_path = /opt/stack/data/cinder {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] storage_availability_zone = nova {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] storage_protocol = iSCSI {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] syslog_log_facility = LOG_USER {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] target_helper = lioadm {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] target_ip_address = 192.168.122.219 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] target_port = 3260 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] target_protocol = iscsi {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] target_secondary_ip_addresses = [] {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] trace_flags = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] transport_url = **** {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] until_refresh = 0 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] use_chap_auth = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] use_default_quota_class = True {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] use_journal = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] use_json = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] use_multipath_for_image_xfer = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] use_stderr = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] use_syslog = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] verify_glance_signatures = enabled {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] volume_api_class = cinder.volume.api.API {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] volume_backend_name = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] volume_clear = zero {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] volume_clear_ionice = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] volume_clear_size = 0 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] volume_copy_bps_limit = 0 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] volume_dd_blocksize = 1M {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] volume_name_template = volume-%s {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] volume_service_inithost_offload = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] volume_usage_audit_period = month {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] zoning_mode = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_concurrency.disable_process_locking = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] keystone_authtoken.auth_section = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] keystone_authtoken.auth_type = password {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] keystone_authtoken.auth_version = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] keystone_authtoken.cache = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] keystone_authtoken.certfile = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] keystone_authtoken.include_service_catalog = True {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] keystone_authtoken.insecure = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] keystone_authtoken.interface = public {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] keystone_authtoken.keyfile = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] keystone_authtoken.memcache_password = **** {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] keystone_authtoken.memcache_username = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] keystone_authtoken.region_name = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] keystone_authtoken.service_type = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.219/identity {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] cache.backend = dogpile.cache.null {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] cache.backend_argument = **** {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] cache.backend_expiration_time = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] cache.config_prefix = cache.oslo {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] cache.debug_cache_backend = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] cache.enable_retry_client = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] cache.enable_socket_keepalive = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] cache.enabled = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] cache.expiration_time = 600 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] cache.hashclient_retry_attempts = 2 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] cache.memcache_dead_retry = 300 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] cache.memcache_pool_maxsize = 10 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] cache.memcache_sasl_enabled = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] cache.password = **** {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] cache.proxies = [] {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] cache.redis_db = 0 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] cache.redis_server = localhost:6379 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] cache.retry_attempts = 2 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] cache.retry_delay = 0.0 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] cache.socket_keepalive_count = 1 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] cache.socket_keepalive_idle = 1 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] cache.socket_keepalive_interval = 1 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] cache.socket_timeout = 1.0 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] cache.tls_allowed_ciphers = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] cache.tls_cafile = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] cache.tls_certfile = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] cache.tls_enabled = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] cache.tls_keyfile = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] cache.username = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] coordination.backend_url = **** {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] database.asyncio_connection = **** {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] database.asyncio_slave_connection = **** {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] database.backend = sqlalchemy {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] database.connection = **** {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] database.connection_debug = 0 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] database.connection_parameters = {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] database.connection_recycle_time = 3600 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] database.connection_trace = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] database.db_inc_retry_interval = True {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] database.db_max_retries = 20 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] database.db_max_retry_interval = 10 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] database.db_retry_interval = 1 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] database.max_overflow = 50 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] database.max_pool_size = 5 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] database.max_retries = 10 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] database.mysql_wsrep_sync_wait = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] database.pool_timeout = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] database.retry_interval = 10 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] database.slave_connection = **** {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] database.sqlite_synchronous = True {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] database.synchronous_reader = True {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] database.use_db_reconnect = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_messaging_tracing.insecure = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] profiler.connection_string = messaging:// {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] profiler.enabled = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] profiler.es_doc_type = notification {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] profiler.es_scroll_size = 10000 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] profiler.es_scroll_time = 2m {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] profiler.filter_error_trace = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] profiler.hmac_keys = **** {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] profiler.sentinel_service_name = mymaster {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] profiler.socket_timeout = 0.1 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] profiler.trace_requests = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] profiler.trace_sqlalchemy = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] profiler_jaeger.process_tags = {} {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] profiler_jaeger.service_name_prefix = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] profiler_otlp.service_name_prefix = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_policy.enforce_new_defaults = True {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_policy.policy_default_rule = default {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8fc0392c-c455-47e2-8b3a-d4fb72635dfa None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87116) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.quobyte [None req-8fc0392c-c455-47e2-8b3a-d4fb72635dfa None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_policy.policy_file = policy.yaml {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.quobyte [None req-8fc0392c-c455-47e2-8b3a-d4fb72635dfa None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8fc0392c-c455-47e2-8b3a-d4fb72635dfa None None] Running cmd (subprocess): mount.quobyte {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] privsep_osbrick.group = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] privsep_osbrick.helper_command = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] privsep_osbrick.user = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] cinder_sys_admin.group = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] cinder_sys_admin.helper_command = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] cinder_sys_admin.user = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] service_user.auth_section = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] service_user.auth_type = password {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] service_user.cafile = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] service_user.certfile = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] service_user.collect_timing = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] service_user.insecure = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] service_user.keyfile = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] service_user.send_service_user_token = True {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] service_user.split_loggers = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] service_user.timeout = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] service_user.tls_ciphers = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] service_user.tls_min_version = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] glance.auth_section = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] glance.auth_type = password {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] glance.certfile = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] glance.collect_timing = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] glance.insecure = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] glance.keyfile = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] glance.region_name = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] glance.split_loggers = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] glance.timeout = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] glance.tls_ciphers = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] glance.tls_min_version = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.backend_availability_zone = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.chap_password = **** {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.chap_username = {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.disk_geometry = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.driver_client_cert = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.driver_client_cert_key = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.driver_data_namespace = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.driver_use_ssl = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.extra_capabilities = {} {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.filter_function = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.goodness_function = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.iscsi_target_flags = {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.iscsi_write_cache = on {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.iser_helper = tgtadm {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.iser_ip_address = 192.168.122.219 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.iser_port = 3260 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.nas_host = {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.nas_login = admin {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.nas_mount_options = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.nas_password = **** {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.nas_private_key = {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.nas_share_path = {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.num_shell_tries = 3 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.quobyte_volume_url = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.replication_device = **** {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.report_discard_supported = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.reserved_percentage = 0 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.target_helper = tgtadm {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.target_ip_address = 192.168.122.219 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.target_port = 3260 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.target_protocol = iscsi {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.trace_flags = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.unique_fqdn_network = True {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.use_chap_auth = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.volume_backend_name = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.volume_clear = zero {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.volume_clear_ionice = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.volume_clear_size = 0 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_reports.file_event_handler = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_reports.log_dir = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.backend_availability_zone = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.backend_host = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.chap_password = **** {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.chap_username = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.chiscsi_conf = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.disk_geometry = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.driver_client_cert = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.driver_data_namespace = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.driver_use_ssl = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.extra_capabilities = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.filter_function = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.goodness_function = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.iser_helper = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.iser_ip_address = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.iser_port = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.iser_target_prefix = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.nas_host = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.nas_login = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.nas_mount_options = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.nas_password = **** {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.nas_private_key = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.nas_share_path = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.nas_ssh_port = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.num_shell_tries = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.nvmet_port_id = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.replication_device = **** {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.report_discard_supported = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.reserved_percentage = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.scst_target_driver = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.storage_protocol = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.target_helper = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.target_ip_address = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.target_port = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.target_prefix = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.target_protocol = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.trace_flags = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.use_chap_auth = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.volume_clear = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.volume_clear_size = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] QuobyteHD.volumes_dir = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack quobyte-client[87117]: Reading configuration file: /etc/quobyte/client.cfg Sep 28 14:51:39 devstack quobyte-client[87117]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8fc0392c-c455-47e2-8b3a-d4fb72635dfa None None] CMD "mount.quobyte" returned: 1 in 0.093s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8fc0392c-c455-47e2-8b3a-d4fb72635dfa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_messaging_rabbit.ssl = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_messaging_notifications.driver = [] {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_messaging_notifications.retry = -1 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8fc0392c-c455-47e2-8b3a-d4fb72635dfa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8fc0392c-c455-47e2-8b3a-d4fb72635dfa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] key_manager.fixed_key = **** {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] barbican.barbican_api_version = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] barbican.barbican_endpoint = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] barbican.barbican_endpoint_type = public {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] barbican.barbican_region_name = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] barbican.cafile = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] barbican.certfile = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] barbican.collect_timing = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] barbican.insecure = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] barbican.keyfile = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] barbican.number_of_retries = 60 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] barbican.retry_delay = 1 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] barbican.send_service_user_token = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] barbican.split_loggers = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] barbican.timeout = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] barbican.tls_ciphers = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] barbican.tls_min_version = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] barbican.verify_ssl = True {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] barbican.verify_ssl_path = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] barbican_service_user.auth_section = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] barbican_service_user.auth_type = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] barbican_service_user.cafile = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] barbican_service_user.certfile = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] barbican_service_user.collect_timing = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] barbican_service_user.insecure = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] barbican_service_user.keyfile = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] barbican_service_user.split_loggers = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] barbican_service_user.timeout = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] barbican_service_user.tls_ciphers = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] barbican_service_user.tls_min_version = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] vault.approle_role_id = **** {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] vault.approle_secret_id = **** {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] vault.auth_method = approle {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] vault.auth_path = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] vault.kv_mountpoint = secret {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] vault.kv_path = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] vault.kv_version = 2 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] vault.namespace = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] vault.root_token_id = **** {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] vault.ssl_ca_crt_file = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] vault.timeout = 60.0 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] vault.token_file = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] vault.token_role = None {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] vault.use_ssl = False {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:51:39 devstack cinder-volume[86817]: DEBUG oslo_service.backend._eventlet.service [None req-c5f7ae34-6c83-4e81-bb36-d2a1b78a15c6 None None] ******************************************************************************** {{(pid=86817) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 14:51:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8fc0392c-c455-47e2-8b3a-d4fb72635dfa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:51:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8fc0392c-c455-47e2-8b3a-d4fb72635dfa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:51:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8fc0392c-c455-47e2-8b3a-d4fb72635dfa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:51:39 devstack sudo[87125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 14:51:39 devstack sudo[87125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:51:40 devstack sudo[87125]: pam_unix(sudo:session): session closed for user root Sep 28 14:51:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8fc0392c-c455-47e2-8b3a-d4fb72635dfa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.239s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:51:40 devstack cinder-volume[87116]: INFO cinder.volume.driver [None req-8fc0392c-c455-47e2-8b3a-d4fb72635dfa None None] Driver hasn't implemented _init_vendor_properties() Sep 28 14:51:40 devstack cinder-volume[87116]: DEBUG cinder.volume.driver [None req-8fc0392c-c455-47e2-8b3a-d4fb72635dfa None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.2063941955566, 'free_capacity_gb': 1775.2063941955566, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87116) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 14:51:40 devstack cinder-volume[87116]: DEBUG oslo_db.sqlalchemy.engines [None req-8fc0392c-c455-47e2-8b3a-d4fb72635dfa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87116) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:51:40 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writer thread running {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 14:51:40 devstack cinder-volume[87116]: DEBUG cinder.db.api [None req-8fc0392c-c455-47e2-8b3a-d4fb72635dfa None None] Building query based on filter {{(pid=87116) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 14:51:40 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-8fc0392c-c455-47e2-8b3a-d4fb72635dfa None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87116) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 14:51:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8fc0392c-c455-47e2-8b3a-d4fb72635dfa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:51:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8fc0392c-c455-47e2-8b3a-d4fb72635dfa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:51:40 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8fc0392c-c455-47e2-8b3a-d4fb72635dfa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:51:40 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8fc0392c-c455-47e2-8b3a-d4fb72635dfa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:51:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8fc0392c-c455-47e2-8b3a-d4fb72635dfa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:51:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8fc0392c-c455-47e2-8b3a-d4fb72635dfa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:51:40 devstack cinder-volume[87116]: INFO cinder.keymgr.migration [None req-3b384d18-9228-4827-aa8b-aee6de9229e8 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 14:51:40 devstack sudo[87139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 14:51:40 devstack sudo[87139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:51:40 devstack sudo[87139]: pam_unix(sudo:session): session closed for user root Sep 28 14:51:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8fc0392c-c455-47e2-8b3a-d4fb72635dfa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.235s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:51:40 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-8fc0392c-c455-47e2-8b3a-d4fb72635dfa None None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:51:40 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-8fc0392c-c455-47e2-8b3a-d4fb72635dfa None None] Driver initialization completed successfully. Sep 28 14:51:40 devstack cinder-volume[87116]: INFO cinder.manager [None req-8fc0392c-c455-47e2-8b3a-d4fb72635dfa None None] Initiating service 3 cleanup Sep 28 14:51:40 devstack cinder-volume[87116]: INFO cinder.manager [None req-8fc0392c-c455-47e2-8b3a-d4fb72635dfa None None] Service 3 cleanup completed. Sep 28 14:51:40 devstack cinder-volume[87116]: DEBUG cinder.service [None req-8fc0392c-c455-47e2-8b3a-d4fb72635dfa None None] Creating RPC server for service cinder-volume {{(pid=87116) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 14:51:40 devstack cinder-volume[87116]: DEBUG cinder.service [None req-8fc0392c-c455-47e2-8b3a-d4fb72635dfa None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87116) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 14:51:40 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-8fc0392c-c455-47e2-8b3a-d4fb72635dfa None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 28 14:51:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8fc0392c-c455-47e2-8b3a-d4fb72635dfa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:51:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8fc0392c-c455-47e2-8b3a-d4fb72635dfa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:51:40 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8fc0392c-c455-47e2-8b3a-d4fb72635dfa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:51:40 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8fc0392c-c455-47e2-8b3a-d4fb72635dfa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:51:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8fc0392c-c455-47e2-8b3a-d4fb72635dfa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:51:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8fc0392c-c455-47e2-8b3a-d4fb72635dfa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:51:40 devstack sudo[87150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 14:51:40 devstack sudo[87150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:51:40 devstack sudo[87150]: pam_unix(sudo:session): session closed for user root Sep 28 14:51:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8fc0392c-c455-47e2-8b3a-d4fb72635dfa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.238s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:51:40 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-8fc0392c-c455-47e2-8b3a-d4fb72635dfa None None] Driver post RPC initialization completed successfully. Sep 28 14:51:49 devstack cinder-volume[86817]: DEBUG dbcounter [-] [86817] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86817) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:51:50 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=2 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:51:50 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:52:16 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running periodic task VolumeManager._thread_info {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:52:16 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] thread count: 6 {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 14:52:16 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] thread info: [<_MainThread(MainThread, started 135146735652992)>, , , , , ] {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 14:52:59 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-d33464be-3459-446d-8bb7-e9ff3db9a924 tempest-DeleteServersTestJSON-322719617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 14:52:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d33464be-3459-446d-8bb7-e9ff3db9a924 tempest-DeleteServersTestJSON-322719617 None] Flow 'volume_create_manager' (2ecbd807-046c-4b3c-9c29-f68f8f0bd7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:52:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d33464be-3459-446d-8bb7-e9ff3db9a924 tempest-DeleteServersTestJSON-322719617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d14255c-e452-4d6b-ae87-6f0c51cb4643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:52:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d33464be-3459-446d-8bb7-e9ff3db9a924 tempest-DeleteServersTestJSON-322719617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d14255c-e452-4d6b-ae87-6f0c51cb4643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1257257069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70dc7054-b2cb-48b0-ac16-64db2e0e527c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea0d4efaaa494f4985b52510c5acf2fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:52:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:52:59Z,use_quota=True,user_id='283a512251ff44c195b44d0011548f22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:52:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d33464be-3459-446d-8bb7-e9ff3db9a924 tempest-DeleteServersTestJSON-322719617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2b0f179-9a65-43b0-b56f-e24038a77d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:52:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d33464be-3459-446d-8bb7-e9ff3db9a924 tempest-DeleteServersTestJSON-322719617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2b0f179-9a65-43b0-b56f-e24038a77d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:52:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d33464be-3459-446d-8bb7-e9ff3db9a924 tempest-DeleteServersTestJSON-322719617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07d5ffa6-001f-4094-b1bd-f896bedae103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:52:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d33464be-3459-446d-8bb7-e9ff3db9a924 tempest-DeleteServersTestJSON-322719617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07d5ffa6-001f-4094-b1bd-f896bedae103) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70dc7054-b2cb-48b0-ac16-64db2e0e527c', 'volume_name': 'volume-70dc7054-b2cb-48b0-ac16-64db2e0e527c', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:52:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d33464be-3459-446d-8bb7-e9ff3db9a924 tempest-DeleteServersTestJSON-322719617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3876e03b-4b4c-4fb7-ab14-ffc1cc0f7b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:52:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d33464be-3459-446d-8bb7-e9ff3db9a924 tempest-DeleteServersTestJSON-322719617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3876e03b-4b4c-4fb7-ab14-ffc1cc0f7b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:52:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d33464be-3459-446d-8bb7-e9ff3db9a924 tempest-DeleteServersTestJSON-322719617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03bc8e05-6250-4c40-9c6a-b6ba3202e410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:52:59 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-d33464be-3459-446d-8bb7-e9ff3db9a924 tempest-DeleteServersTestJSON-322719617 None] Volume 70dc7054-b2cb-48b0-ac16-64db2e0e527c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70dc7054-b2cb-48b0-ac16-64db2e0e527c', 'volume_size': 1} Sep 28 14:52:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d33464be-3459-446d-8bb7-e9ff3db9a924 tempest-DeleteServersTestJSON-322719617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:52:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d33464be-3459-446d-8bb7-e9ff3db9a924 tempest-DeleteServersTestJSON-322719617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:52:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d33464be-3459-446d-8bb7-e9ff3db9a924 tempest-DeleteServersTestJSON-322719617 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1257257069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70dc7054-b2cb-48b0-ac16-64db2e0e527c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea0d4efaaa494f4985b52510c5acf2fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:52:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:52:59Z,use_quota=True,user_id='283a512251ff44c195b44d0011548f22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 14:52:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-d33464be-3459-446d-8bb7-e9ff3db9a924 tempest-DeleteServersTestJSON-322719617 None] Creating volume 70dc7054-b2cb-48b0-ac16-64db2e0e527c {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 14:52:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d33464be-3459-446d-8bb7-e9ff3db9a924 tempest-DeleteServersTestJSON-322719617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:52:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d33464be-3459-446d-8bb7-e9ff3db9a924 tempest-DeleteServersTestJSON-322719617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:52:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d33464be-3459-446d-8bb7-e9ff3db9a924 tempest-DeleteServersTestJSON-322719617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:52:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d33464be-3459-446d-8bb7-e9ff3db9a924 tempest-DeleteServersTestJSON-322719617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:52:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d33464be-3459-446d-8bb7-e9ff3db9a924 tempest-DeleteServersTestJSON-322719617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:52:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d33464be-3459-446d-8bb7-e9ff3db9a924 tempest-DeleteServersTestJSON-322719617 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 14:52:59 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-d33464be-3459-446d-8bb7-e9ff3db9a924 tempest-DeleteServersTestJSON-322719617 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 14:52:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d33464be-3459-446d-8bb7-e9ff3db9a924 tempest-DeleteServersTestJSON-322719617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-70dc7054-b2cb-48b0-ac16-64db2e0e527c 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:52:59 devstack sudo[87957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-70dc7054-b2cb-48b0-ac16-64db2e0e527c 1073741824 Sep 28 14:52:59 devstack sudo[87957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:00 devstack sudo[87957]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d33464be-3459-446d-8bb7-e9ff3db9a924 tempest-DeleteServersTestJSON-322719617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-70dc7054-b2cb-48b0-ac16-64db2e0e527c 1073741824" returned: 0 in 1.547s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d33464be-3459-446d-8bb7-e9ff3db9a924 tempest-DeleteServersTestJSON-322719617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-70dc7054-b2cb-48b0-ac16-64db2e0e527c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:01 devstack sudo[88282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-70dc7054-b2cb-48b0-ac16-64db2e0e527c Sep 28 14:53:01 devstack sudo[88282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:01 devstack sudo[88282]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d33464be-3459-446d-8bb7-e9ff3db9a924 tempest-DeleteServersTestJSON-322719617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-70dc7054-b2cb-48b0-ac16-64db2e0e527c" returned: 0 in 0.570s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d33464be-3459-446d-8bb7-e9ff3db9a924 tempest-DeleteServersTestJSON-322719617 None] <== create_volume: return (2195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 14:53:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d33464be-3459-446d-8bb7-e9ff3db9a924 tempest-DeleteServersTestJSON-322719617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.203s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:53:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d33464be-3459-446d-8bb7-e9ff3db9a924 tempest-DeleteServersTestJSON-322719617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03bc8e05-6250-4c40-9c6a-b6ba3202e410) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70dc7054-b2cb-48b0-ac16-64db2e0e527c', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:53:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d33464be-3459-446d-8bb7-e9ff3db9a924 tempest-DeleteServersTestJSON-322719617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ebc9747-a20b-401e-af66-daa83d2b276a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:53:01 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-d33464be-3459-446d-8bb7-e9ff3db9a924 tempest-DeleteServersTestJSON-322719617 None] Volume volume-70dc7054-b2cb-48b0-ac16-64db2e0e527c (70dc7054-b2cb-48b0-ac16-64db2e0e527c): created successfully Sep 28 14:53:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d33464be-3459-446d-8bb7-e9ff3db9a924 tempest-DeleteServersTestJSON-322719617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ebc9747-a20b-401e-af66-daa83d2b276a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:53:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d33464be-3459-446d-8bb7-e9ff3db9a924 tempest-DeleteServersTestJSON-322719617 None] Flow 'volume_create_manager' (2ecbd807-046c-4b3c-9c29-f68f8f0bd7e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:53:01 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-d33464be-3459-446d-8bb7-e9ff3db9a924 tempest-DeleteServersTestJSON-322719617 None] Created volume successfully. Sep 28 14:53:05 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-42da7279-c6f1-485a-9879-6de50dfd64bd tempest-VolumesAdminNegativeTest-1424828015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 14:53:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-42da7279-c6f1-485a-9879-6de50dfd64bd tempest-VolumesAdminNegativeTest-1424828015 None] Flow 'volume_create_manager' (90e6e78a-3222-49a2-9310-6c72826e21cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:53:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-42da7279-c6f1-485a-9879-6de50dfd64bd tempest-VolumesAdminNegativeTest-1424828015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b02ce33-8495-4ecd-a08c-cae9b8b74ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:53:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-42da7279-c6f1-485a-9879-6de50dfd64bd tempest-VolumesAdminNegativeTest-1424828015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b02ce33-8495-4ecd-a08c-cae9b8b74ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:53:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1909580473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d28d70f-86d7-4a1d-8390-d05c31af2cce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16b381193cae43849802ae4c65d33327',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:53:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:53:05Z,use_quota=True,user_id='14b46c66c46644e38ab8f080f7e9b99b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:53:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-42da7279-c6f1-485a-9879-6de50dfd64bd tempest-VolumesAdminNegativeTest-1424828015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39b7362e-0a09-4d47-bdc7-68bd8496f489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:53:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-42da7279-c6f1-485a-9879-6de50dfd64bd tempest-VolumesAdminNegativeTest-1424828015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39b7362e-0a09-4d47-bdc7-68bd8496f489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:53:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-42da7279-c6f1-485a-9879-6de50dfd64bd tempest-VolumesAdminNegativeTest-1424828015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09f74dc4-4b03-45f8-8094-53527f7fbdf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:53:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-42da7279-c6f1-485a-9879-6de50dfd64bd tempest-VolumesAdminNegativeTest-1424828015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09f74dc4-4b03-45f8-8094-53527f7fbdf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d28d70f-86d7-4a1d-8390-d05c31af2cce', 'volume_name': 'volume-8d28d70f-86d7-4a1d-8390-d05c31af2cce', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:53:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-42da7279-c6f1-485a-9879-6de50dfd64bd tempest-VolumesAdminNegativeTest-1424828015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dbc2499-fc54-41c3-9bf6-641324dd1044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:53:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-42da7279-c6f1-485a-9879-6de50dfd64bd tempest-VolumesAdminNegativeTest-1424828015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dbc2499-fc54-41c3-9bf6-641324dd1044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:53:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-42da7279-c6f1-485a-9879-6de50dfd64bd tempest-VolumesAdminNegativeTest-1424828015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79d3589c-8697-4e95-91f4-e4b9d684edf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:53:05 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-42da7279-c6f1-485a-9879-6de50dfd64bd tempest-VolumesAdminNegativeTest-1424828015 None] Volume 8d28d70f-86d7-4a1d-8390-d05c31af2cce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d28d70f-86d7-4a1d-8390-d05c31af2cce', 'volume_size': 1} Sep 28 14:53:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-42da7279-c6f1-485a-9879-6de50dfd64bd tempest-VolumesAdminNegativeTest-1424828015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:53:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-42da7279-c6f1-485a-9879-6de50dfd64bd tempest-VolumesAdminNegativeTest-1424828015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:53:05 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-42da7279-c6f1-485a-9879-6de50dfd64bd tempest-VolumesAdminNegativeTest-1424828015 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:53:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1909580473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d28d70f-86d7-4a1d-8390-d05c31af2cce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16b381193cae43849802ae4c65d33327',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:53:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:53:05Z,use_quota=True,user_id='14b46c66c46644e38ab8f080f7e9b99b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 14:53:05 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-42da7279-c6f1-485a-9879-6de50dfd64bd tempest-VolumesAdminNegativeTest-1424828015 None] Creating volume 8d28d70f-86d7-4a1d-8390-d05c31af2cce {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 14:53:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-42da7279-c6f1-485a-9879-6de50dfd64bd tempest-VolumesAdminNegativeTest-1424828015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:53:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-42da7279-c6f1-485a-9879-6de50dfd64bd tempest-VolumesAdminNegativeTest-1424828015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:53:05 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-42da7279-c6f1-485a-9879-6de50dfd64bd tempest-VolumesAdminNegativeTest-1424828015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:53:05 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-42da7279-c6f1-485a-9879-6de50dfd64bd tempest-VolumesAdminNegativeTest-1424828015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:53:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-42da7279-c6f1-485a-9879-6de50dfd64bd tempest-VolumesAdminNegativeTest-1424828015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:53:05 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-42da7279-c6f1-485a-9879-6de50dfd64bd tempest-VolumesAdminNegativeTest-1424828015 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 14:53:05 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-42da7279-c6f1-485a-9879-6de50dfd64bd tempest-VolumesAdminNegativeTest-1424828015 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 14:53:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-42da7279-c6f1-485a-9879-6de50dfd64bd tempest-VolumesAdminNegativeTest-1424828015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8d28d70f-86d7-4a1d-8390-d05c31af2cce 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:05 devstack sudo[88379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8d28d70f-86d7-4a1d-8390-d05c31af2cce 1073741824 Sep 28 14:53:05 devstack sudo[88379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:06 devstack sudo[88379]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-42da7279-c6f1-485a-9879-6de50dfd64bd tempest-VolumesAdminNegativeTest-1424828015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8d28d70f-86d7-4a1d-8390-d05c31af2cce 1073741824" returned: 0 in 0.918s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-42da7279-c6f1-485a-9879-6de50dfd64bd tempest-VolumesAdminNegativeTest-1424828015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8d28d70f-86d7-4a1d-8390-d05c31af2cce {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:06 devstack sudo[88386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8d28d70f-86d7-4a1d-8390-d05c31af2cce Sep 28 14:53:06 devstack sudo[88386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:07 devstack sudo[88386]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-42da7279-c6f1-485a-9879-6de50dfd64bd tempest-VolumesAdminNegativeTest-1424828015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8d28d70f-86d7-4a1d-8390-d05c31af2cce" returned: 0 in 0.283s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:07 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-42da7279-c6f1-485a-9879-6de50dfd64bd tempest-VolumesAdminNegativeTest-1424828015 None] <== create_volume: return (1263ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 14:53:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-42da7279-c6f1-485a-9879-6de50dfd64bd tempest-VolumesAdminNegativeTest-1424828015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.266s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:53:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-42da7279-c6f1-485a-9879-6de50dfd64bd tempest-VolumesAdminNegativeTest-1424828015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79d3589c-8697-4e95-91f4-e4b9d684edf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d28d70f-86d7-4a1d-8390-d05c31af2cce', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:53:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-42da7279-c6f1-485a-9879-6de50dfd64bd tempest-VolumesAdminNegativeTest-1424828015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5797e0d3-619a-485e-a0db-af57054361cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:53:07 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-42da7279-c6f1-485a-9879-6de50dfd64bd tempest-VolumesAdminNegativeTest-1424828015 None] Volume volume-8d28d70f-86d7-4a1d-8390-d05c31af2cce (8d28d70f-86d7-4a1d-8390-d05c31af2cce): created successfully Sep 28 14:53:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-42da7279-c6f1-485a-9879-6de50dfd64bd tempest-VolumesAdminNegativeTest-1424828015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5797e0d3-619a-485e-a0db-af57054361cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:53:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-42da7279-c6f1-485a-9879-6de50dfd64bd tempest-VolumesAdminNegativeTest-1424828015 None] Flow 'volume_create_manager' (90e6e78a-3222-49a2-9310-6c72826e21cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:53:07 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-42da7279-c6f1-485a-9879-6de50dfd64bd tempest-VolumesAdminNegativeTest-1424828015 None] Created volume successfully. Sep 28 14:53:07 devstack cinder-volume[87116]: WARNING py.warnings [req-a5c8d768-7caa-41a4-93b8-eccfa5faef6b req-2aab9e87-b6dc-4a55-8a58-50fbd87a1ec0 tempest-DeleteServersTestJSON-322719617 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Sep 28 14:53:07 devstack cinder-volume[87116]: .first() Sep 28 14:53:07 devstack cinder-volume[87116]: Sep 28 14:53:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-a5c8d768-7caa-41a4-93b8-eccfa5faef6b req-2aab9e87-b6dc-4a55-8a58-50fbd87a1ec0 tempest-DeleteServersTestJSON-322719617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:53:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-a5c8d768-7caa-41a4-93b8-eccfa5faef6b req-2aab9e87-b6dc-4a55-8a58-50fbd87a1ec0 tempest-DeleteServersTestJSON-322719617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:53:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-a5c8d768-7caa-41a4-93b8-eccfa5faef6b req-2aab9e87-b6dc-4a55-8a58-50fbd87a1ec0 tempest-DeleteServersTestJSON-322719617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.042s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:53:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-a5c8d768-7caa-41a4-93b8-eccfa5faef6b req-2aab9e87-b6dc-4a55-8a58-50fbd87a1ec0 tempest-DeleteServersTestJSON-322719617 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1', 'name': 'volume-70dc7054-b2cb-48b0-ac16-64db2e0e527c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '384de292-63a3-4971-8fec-0b1ef53bfa5c', 'enforce_multipath': True} {{(pid=87116) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 14:53:07 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-a5c8d768-7caa-41a4-93b8-eccfa5faef6b req-2aab9e87-b6dc-4a55-8a58-50fbd87a1ec0 tempest-DeleteServersTestJSON-322719617 None] attachment_update completed successfully. Sep 28 14:53:07 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3a9ab318-8c78-4dbf-a030-30cc6f4559c0 tempest-VolumesAdminNegativeTest-1424828015 None] Acquiring lock "cinder-8d28d70f-86d7-4a1d-8390-d05c31af2cce-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:53:07 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3a9ab318-8c78-4dbf-a030-30cc6f4559c0 tempest-VolumesAdminNegativeTest-1424828015 None] Lock "cinder-8d28d70f-86d7-4a1d-8390-d05c31af2cce-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:53:08 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3a9ab318-8c78-4dbf-a030-30cc6f4559c0 tempest-VolumesAdminNegativeTest-1424828015 None] Acquiring lock "cinder-quobyte-8d28d70f-86d7-4a1d-8390-d05c31af2cce" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:53:08 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3a9ab318-8c78-4dbf-a030-30cc6f4559c0 tempest-VolumesAdminNegativeTest-1424828015 None] Lock "cinder-quobyte-8d28d70f-86d7-4a1d-8390-d05c31af2cce" acquired by "delete_volume" :: waited 0.028s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:53:08 devstack cinder-volume[87116]: INFO oslo.privsep.daemon [None req-3a9ab318-8c78-4dbf-a030-30cc6f4559c0 tempest-VolumesAdminNegativeTest-1424828015 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp3h7c5sp6/privsep.sock'] Sep 28 14:53:08 devstack sudo[88403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp3h7c5sp6/privsep.sock Sep 28 14:53:08 devstack sudo[88403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:09 devstack cinder-volume[87116]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 28 14:53:09 devstack cinder-volume[87116]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 14:53:09 devstack cinder-volume[87116]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 28 14:53:09 devstack cinder-volume[87116]: WARNING oslo.privsep.daemon [-] privsep log: Sep 28 14:53:09 devstack cinder-volume[87116]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 28 14:53:09 devstack cinder-volume[87116]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 28 14:53:09 devstack cinder-volume[87116]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 14:53:09 devstack cinder-volume[87116]: WARNING oslo.privsep.daemon [-] privsep log: Sep 28 14:53:09 devstack cinder-volume[87116]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 28 14:53:09 devstack sudo[88403]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:09 devstack cinder-volume[87116]: INFO oslo.privsep.daemon [None req-3a9ab318-8c78-4dbf-a030-30cc6f4559c0 tempest-VolumesAdminNegativeTest-1424828015 None] Spawned new privsep daemon via rootwrap Sep 28 14:53:09 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [None req-3a9ab318-8c78-4dbf-a030-30cc6f4559c0 tempest-VolumesAdminNegativeTest-1424828015 None] Accepted privsep connection to /tmp/tmp3h7c5sp6/privsep.sock {{(pid=87116) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 28 14:53:09 devstack cinder-volume[87116]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 28 14:53:09 devstack cinder-volume[87116]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 28 14:53:09 devstack cinder-volume[87116]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 28 14:53:09 devstack cinder-volume[87116]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88822 Sep 28 14:53:09 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[345cdc01-043d-41e7-a664-8efc6d827975]: (2,) {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:53:09 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f21943-a5ae-4123-98fe-f1e797cf8eb8]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:53:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3a9ab318-8c78-4dbf-a030-30cc6f4559c0 tempest-VolumesAdminNegativeTest-1424828015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8d28d70f-86d7-4a1d-8390-d05c31af2cce {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:09 devstack sudo[88824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8d28d70f-86d7-4a1d-8390-d05c31af2cce Sep 28 14:53:09 devstack sudo[88824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:10 devstack sudo[88824]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3a9ab318-8c78-4dbf-a030-30cc6f4559c0 tempest-VolumesAdminNegativeTest-1424828015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8d28d70f-86d7-4a1d-8390-d05c31af2cce" returned: 0 in 0.645s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3a9ab318-8c78-4dbf-a030-30cc6f4559c0 tempest-VolumesAdminNegativeTest-1424828015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8d28d70f-86d7-4a1d-8390-d05c31af2cce {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:10 devstack sudo[88834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8d28d70f-86d7-4a1d-8390-d05c31af2cce Sep 28 14:53:10 devstack sudo[88834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:10 devstack sudo[88834]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3a9ab318-8c78-4dbf-a030-30cc6f4559c0 tempest-VolumesAdminNegativeTest-1424828015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8d28d70f-86d7-4a1d-8390-d05c31af2cce" returned: 0 in 0.488s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:10 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3a9ab318-8c78-4dbf-a030-30cc6f4559c0 tempest-VolumesAdminNegativeTest-1424828015 None] Lock "cinder-quobyte-8d28d70f-86d7-4a1d-8390-d05c31af2cce" released by "delete_volume" :: held 2.861s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:53:10 devstack cinder-volume[87116]: WARNING cinder.quota [None req-3a9ab318-8c78-4dbf-a030-30cc6f4559c0 tempest-VolumesAdminNegativeTest-1424828015 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 14:53:10 devstack cinder-volume[87116]: WARNING cinder.quota [None req-3a9ab318-8c78-4dbf-a030-30cc6f4559c0 tempest-VolumesAdminNegativeTest-1424828015 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 14:53:11 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-3a9ab318-8c78-4dbf-a030-30cc6f4559c0 tempest-VolumesAdminNegativeTest-1424828015 None] Created reservations ['4f93026b-4e71-488a-972c-947dc648c38a', '2e23afd4-f792-46f2-96df-f6b4e8e42a15', 'ce52f945-7c28-4ea9-acdc-7dac3272f502', 'd4d9896d-91ed-41c8-af92-04f737a4a793'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 14:53:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3a9ab318-8c78-4dbf-a030-30cc6f4559c0 tempest-VolumesAdminNegativeTest-1424828015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:53:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3a9ab318-8c78-4dbf-a030-30cc6f4559c0 tempest-VolumesAdminNegativeTest-1424828015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:53:11 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3a9ab318-8c78-4dbf-a030-30cc6f4559c0 tempest-VolumesAdminNegativeTest-1424828015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:53:11 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3a9ab318-8c78-4dbf-a030-30cc6f4559c0 tempest-VolumesAdminNegativeTest-1424828015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:53:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3a9ab318-8c78-4dbf-a030-30cc6f4559c0 tempest-VolumesAdminNegativeTest-1424828015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:53:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3a9ab318-8c78-4dbf-a030-30cc6f4559c0 tempest-VolumesAdminNegativeTest-1424828015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:11 devstack sudo[88885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 14:53:11 devstack sudo[88885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:12 devstack sudo[88885]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3a9ab318-8c78-4dbf-a030-30cc6f4559c0 tempest-VolumesAdminNegativeTest-1424828015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.818s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:12 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-3a9ab318-8c78-4dbf-a030-30cc6f4559c0 tempest-VolumesAdminNegativeTest-1424828015 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:53:12 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-3a9ab318-8c78-4dbf-a030-30cc6f4559c0 tempest-VolumesAdminNegativeTest-1424828015 None] Deleted volume successfully. Sep 28 14:53:12 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3a9ab318-8c78-4dbf-a030-30cc6f4559c0 tempest-VolumesAdminNegativeTest-1424828015 None] Lock "cinder-8d28d70f-86d7-4a1d-8390-d05c31af2cce-delete_volume" released by "delete_volume" :: held 4.147s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:53:13 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-8c7921f8-0cc8-406d-8c54-7728c34772a0 req-97eed98f-6adb-4934-b643-9efc12ea997b tempest-DeleteServersTestJSON-322719617 None] Terminate volume connection completed successfully. Sep 28 14:53:13 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-8c7921f8-0cc8-406d-8c54-7728c34772a0 req-97eed98f-6adb-4934-b643-9efc12ea997b tempest-DeleteServersTestJSON-322719617 None] Deleting attachment 384de292-63a3-4971-8fec-0b1ef53bfa5c. {{(pid=87116) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 14:53:16 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-15f609e9-9c23-4939-8b7c-b719f6cbf7d7 tempest-DeleteServersTestJSON-322719617 None] Acquiring lock "cinder-70dc7054-b2cb-48b0-ac16-64db2e0e527c-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:53:16 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-15f609e9-9c23-4939-8b7c-b719f6cbf7d7 tempest-DeleteServersTestJSON-322719617 None] Lock "cinder-70dc7054-b2cb-48b0-ac16-64db2e0e527c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:53:16 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-15f609e9-9c23-4939-8b7c-b719f6cbf7d7 tempest-DeleteServersTestJSON-322719617 None] Acquiring lock "cinder-quobyte-70dc7054-b2cb-48b0-ac16-64db2e0e527c" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:53:16 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-15f609e9-9c23-4939-8b7c-b719f6cbf7d7 tempest-DeleteServersTestJSON-322719617 None] Lock "cinder-quobyte-70dc7054-b2cb-48b0-ac16-64db2e0e527c" acquired by "delete_volume" :: waited 0.039s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:53:16 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[85069371-b102-42c7-9e25-1ce4a522ed5b]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:53:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-15f609e9-9c23-4939-8b7c-b719f6cbf7d7 tempest-DeleteServersTestJSON-322719617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-70dc7054-b2cb-48b0-ac16-64db2e0e527c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:16 devstack sudo[88929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-70dc7054-b2cb-48b0-ac16-64db2e0e527c Sep 28 14:53:16 devstack sudo[88929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:16 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:53:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:53:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:53:16 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:53:16 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:53:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:53:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:17 devstack sudo[88933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 14:53:17 devstack sudo[88933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:17 devstack sudo[88929]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-15f609e9-9c23-4939-8b7c-b719f6cbf7d7 tempest-DeleteServersTestJSON-322719617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-70dc7054-b2cb-48b0-ac16-64db2e0e527c" returned: 0 in 0.589s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-15f609e9-9c23-4939-8b7c-b719f6cbf7d7 tempest-DeleteServersTestJSON-322719617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-70dc7054-b2cb-48b0-ac16-64db2e0e527c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:17 devstack sudo[88936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-70dc7054-b2cb-48b0-ac16-64db2e0e527c Sep 28 14:53:17 devstack sudo[88936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:17 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbfa3a63-97da-4b0f-8a12-07e96eab3127 tempest-AttachVolumeTestJSON-1945595936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 14:53:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bbfa3a63-97da-4b0f-8a12-07e96eab3127 tempest-AttachVolumeTestJSON-1945595936 None] Flow 'volume_create_manager' (00126d98-54a4-43da-8270-19c6bc298366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:53:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bbfa3a63-97da-4b0f-8a12-07e96eab3127 tempest-AttachVolumeTestJSON-1945595936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c2bc654-f4d2-42bc-a993-6c607c87c612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:53:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bbfa3a63-97da-4b0f-8a12-07e96eab3127 tempest-AttachVolumeTestJSON-1945595936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c2bc654-f4d2-42bc-a993-6c607c87c612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:53:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-5948445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dbf8d99-c922-4ab6-849c-203e7a015885,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='637e9096f3f847ca8ff2afd88c2d060d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:53:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:53:17Z,use_quota=True,user_id='46a45d5880354576bb4e53d961968613',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:53:17 devstack sudo[88936]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bbfa3a63-97da-4b0f-8a12-07e96eab3127 tempest-AttachVolumeTestJSON-1945595936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eea5aa4e-bb3c-472f-9f6c-94be58b7a14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:53:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bbfa3a63-97da-4b0f-8a12-07e96eab3127 tempest-AttachVolumeTestJSON-1945595936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eea5aa4e-bb3c-472f-9f6c-94be58b7a14a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:53:17 devstack sudo[88933]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bbfa3a63-97da-4b0f-8a12-07e96eab3127 tempest-AttachVolumeTestJSON-1945595936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eff19752-d4d9-4368-b62b-73449bd66d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:53:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bbfa3a63-97da-4b0f-8a12-07e96eab3127 tempest-AttachVolumeTestJSON-1945595936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eff19752-d4d9-4368-b62b-73449bd66d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dbf8d99-c922-4ab6-849c-203e7a015885', 'volume_name': 'volume-8dbf8d99-c922-4ab6-849c-203e7a015885', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:53:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bbfa3a63-97da-4b0f-8a12-07e96eab3127 tempest-AttachVolumeTestJSON-1945595936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aef496c-fa91-4936-907d-70111f245267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:53:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bbfa3a63-97da-4b0f-8a12-07e96eab3127 tempest-AttachVolumeTestJSON-1945595936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aef496c-fa91-4936-907d-70111f245267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:53:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bbfa3a63-97da-4b0f-8a12-07e96eab3127 tempest-AttachVolumeTestJSON-1945595936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35a47803-357e-438d-b633-3141516524f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:53:17 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-bbfa3a63-97da-4b0f-8a12-07e96eab3127 tempest-AttachVolumeTestJSON-1945595936 None] Volume 8dbf8d99-c922-4ab6-849c-203e7a015885: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dbf8d99-c922-4ab6-849c-203e7a015885', 'volume_size': 1} Sep 28 14:53:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bbfa3a63-97da-4b0f-8a12-07e96eab3127 tempest-AttachVolumeTestJSON-1945595936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:53:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bbfa3a63-97da-4b0f-8a12-07e96eab3127 tempest-AttachVolumeTestJSON-1945595936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:53:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-bbfa3a63-97da-4b0f-8a12-07e96eab3127 tempest-AttachVolumeTestJSON-1945595936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:53:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-5948445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dbf8d99-c922-4ab6-849c-203e7a015885,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='637e9096f3f847ca8ff2afd88c2d060d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:53:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:53:17Z,use_quota=True,user_id='46a45d5880354576bb4e53d961968613',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 14:53:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-bbfa3a63-97da-4b0f-8a12-07e96eab3127 tempest-AttachVolumeTestJSON-1945595936 None] Creating volume 8dbf8d99-c922-4ab6-849c-203e7a015885 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 14:53:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bbfa3a63-97da-4b0f-8a12-07e96eab3127 tempest-AttachVolumeTestJSON-1945595936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:53:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bbfa3a63-97da-4b0f-8a12-07e96eab3127 tempest-AttachVolumeTestJSON-1945595936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:53:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-bbfa3a63-97da-4b0f-8a12-07e96eab3127 tempest-AttachVolumeTestJSON-1945595936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:53:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-bbfa3a63-97da-4b0f-8a12-07e96eab3127 tempest-AttachVolumeTestJSON-1945595936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:53:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bbfa3a63-97da-4b0f-8a12-07e96eab3127 tempest-AttachVolumeTestJSON-1945595936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:53:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-bbfa3a63-97da-4b0f-8a12-07e96eab3127 tempest-AttachVolumeTestJSON-1945595936 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 14:53:17 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-bbfa3a63-97da-4b0f-8a12-07e96eab3127 tempest-AttachVolumeTestJSON-1945595936 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 14:53:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bbfa3a63-97da-4b0f-8a12-07e96eab3127 tempest-AttachVolumeTestJSON-1945595936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8dbf8d99-c922-4ab6-849c-203e7a015885 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.510s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-15f609e9-9c23-4939-8b7c-b719f6cbf7d7 tempest-DeleteServersTestJSON-322719617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-70dc7054-b2cb-48b0-ac16-64db2e0e527c" returned: 0 in 0.369s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:17 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:53:17 devstack sudo[88940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8dbf8d99-c922-4ab6-849c-203e7a015885 1073741824 Sep 28 14:53:17 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running periodic task VolumeManager._thread_info {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:53:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] thread count: 8 {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 14:53:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] thread info: [<_MainThread(MainThread, started 135146735652992)>, , , , , , , ] {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 14:53:17 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-15f609e9-9c23-4939-8b7c-b719f6cbf7d7 tempest-DeleteServersTestJSON-322719617 None] Lock "cinder-quobyte-70dc7054-b2cb-48b0-ac16-64db2e0e527c" released by "delete_volume" :: held 1.047s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:53:17 devstack sudo[88940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:17 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-15f609e9-9c23-4939-8b7c-b719f6cbf7d7 tempest-DeleteServersTestJSON-322719617 None] Created reservations ['b6adb025-330b-4643-80ec-51dd272c094f', '6bf91e75-bd53-40cb-be92-dc74b7640a65', 'cc930bd9-61a5-4a1b-959e-4cfe5763b0c8', '167167c6-fb4a-4548-b7ea-e7be6ec941ce'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 14:53:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-15f609e9-9c23-4939-8b7c-b719f6cbf7d7 tempest-DeleteServersTestJSON-322719617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:53:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-15f609e9-9c23-4939-8b7c-b719f6cbf7d7 tempest-DeleteServersTestJSON-322719617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:53:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-15f609e9-9c23-4939-8b7c-b719f6cbf7d7 tempest-DeleteServersTestJSON-322719617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:53:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-15f609e9-9c23-4939-8b7c-b719f6cbf7d7 tempest-DeleteServersTestJSON-322719617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:53:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-15f609e9-9c23-4939-8b7c-b719f6cbf7d7 tempest-DeleteServersTestJSON-322719617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:53:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-15f609e9-9c23-4939-8b7c-b719f6cbf7d7 tempest-DeleteServersTestJSON-322719617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:17 devstack sudo[88942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 14:53:17 devstack sudo[88942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:18 devstack sudo[88940]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bbfa3a63-97da-4b0f-8a12-07e96eab3127 tempest-AttachVolumeTestJSON-1945595936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8dbf8d99-c922-4ab6-849c-203e7a015885 1073741824" returned: 0 in 0.616s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:18 devstack sudo[88942]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-15f609e9-9c23-4939-8b7c-b719f6cbf7d7 tempest-DeleteServersTestJSON-322719617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.369s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:18 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-15f609e9-9c23-4939-8b7c-b719f6cbf7d7 tempest-DeleteServersTestJSON-322719617 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:53:18 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-15f609e9-9c23-4939-8b7c-b719f6cbf7d7 tempest-DeleteServersTestJSON-322719617 None] Deleted volume successfully. Sep 28 14:53:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bbfa3a63-97da-4b0f-8a12-07e96eab3127 tempest-AttachVolumeTestJSON-1945595936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8dbf8d99-c922-4ab6-849c-203e7a015885 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:18 devstack sudo[88951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8dbf8d99-c922-4ab6-849c-203e7a015885 Sep 28 14:53:18 devstack sudo[88951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:18 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-15f609e9-9c23-4939-8b7c-b719f6cbf7d7 tempest-DeleteServersTestJSON-322719617 None] Lock "cinder-70dc7054-b2cb-48b0-ac16-64db2e0e527c-delete_volume" released by "delete_volume" :: held 1.859s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:53:18 devstack sudo[88951]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bbfa3a63-97da-4b0f-8a12-07e96eab3127 tempest-AttachVolumeTestJSON-1945595936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8dbf8d99-c922-4ab6-849c-203e7a015885" returned: 0 in 0.262s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-bbfa3a63-97da-4b0f-8a12-07e96eab3127 tempest-AttachVolumeTestJSON-1945595936 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 14:53:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bbfa3a63-97da-4b0f-8a12-07e96eab3127 tempest-AttachVolumeTestJSON-1945595936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:53:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bbfa3a63-97da-4b0f-8a12-07e96eab3127 tempest-AttachVolumeTestJSON-1945595936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35a47803-357e-438d-b633-3141516524f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dbf8d99-c922-4ab6-849c-203e7a015885', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:53:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bbfa3a63-97da-4b0f-8a12-07e96eab3127 tempest-AttachVolumeTestJSON-1945595936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8629bbcb-c70f-4193-a64b-d191929979c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:53:18 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-bbfa3a63-97da-4b0f-8a12-07e96eab3127 tempest-AttachVolumeTestJSON-1945595936 None] Volume volume-8dbf8d99-c922-4ab6-849c-203e7a015885 (8dbf8d99-c922-4ab6-849c-203e7a015885): created successfully Sep 28 14:53:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bbfa3a63-97da-4b0f-8a12-07e96eab3127 tempest-AttachVolumeTestJSON-1945595936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8629bbcb-c70f-4193-a64b-d191929979c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:53:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bbfa3a63-97da-4b0f-8a12-07e96eab3127 tempest-AttachVolumeTestJSON-1945595936 None] Flow 'volume_create_manager' (00126d98-54a4-43da-8270-19c6bc298366) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:53:18 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-bbfa3a63-97da-4b0f-8a12-07e96eab3127 tempest-AttachVolumeTestJSON-1945595936 None] Created volume successfully. Sep 28 14:53:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-24c7b351-758b-4ebe-83a0-0f514fd2d529 req-315c5036-1211-4134-8382-fca38360b8a7 tempest-AttachVolumeTestJSON-1945595936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:53:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-24c7b351-758b-4ebe-83a0-0f514fd2d529 req-315c5036-1211-4134-8382-fca38360b8a7 tempest-AttachVolumeTestJSON-1945595936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:53:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-24c7b351-758b-4ebe-83a0-0f514fd2d529 req-315c5036-1211-4134-8382-fca38360b8a7 tempest-AttachVolumeTestJSON-1945595936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.044s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:53:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-24c7b351-758b-4ebe-83a0-0f514fd2d529 req-315c5036-1211-4134-8382-fca38360b8a7 tempest-AttachVolumeTestJSON-1945595936 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1', 'name': 'volume-8dbf8d99-c922-4ab6-849c-203e7a015885', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '117a784e-b8c0-4699-b623-47b2302dd2d6', 'enforce_multipath': True} {{(pid=87116) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 14:53:20 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-24c7b351-758b-4ebe-83a0-0f514fd2d529 req-315c5036-1211-4134-8382-fca38360b8a7 tempest-AttachVolumeTestJSON-1945595936 None] attachment_update completed successfully. Sep 28 14:53:30 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:UPDATE=26,cinder:SELECT=31,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:53:30 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=29,cinder:UPDATE=30,cinder:INSERT=6,cinder:DELETE=3 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:53:50 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:53:56 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-2a9ae97e-ed46-493e-899e-0f3ae3fb3ce8 req-0d37ba36-fdad-4878-a9f1-1c623abc987b tempest-AttachVolumeTestJSON-1945595936 None] Terminate volume connection completed successfully. Sep 28 14:53:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-2a9ae97e-ed46-493e-899e-0f3ae3fb3ce8 req-0d37ba36-fdad-4878-a9f1-1c623abc987b tempest-AttachVolumeTestJSON-1945595936 None] Deleting attachment 117a784e-b8c0-4699-b623-47b2302dd2d6. {{(pid=87116) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 14:54:05 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-a01f21db-1227-4e0d-93aa-fb9ab81bfab0 tempest-TaggedAttachmentsTest-879245329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 14:54:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a01f21db-1227-4e0d-93aa-fb9ab81bfab0 tempest-TaggedAttachmentsTest-879245329 None] Flow 'volume_create_manager' (75e3dfe6-88dc-4ba3-9a66-93914c62ad18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:54:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a01f21db-1227-4e0d-93aa-fb9ab81bfab0 tempest-TaggedAttachmentsTest-879245329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acbf6dcd-92cd-4441-abdb-7dc18d948ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:54:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a01f21db-1227-4e0d-93aa-fb9ab81bfab0 tempest-TaggedAttachmentsTest-879245329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acbf6dcd-92cd-4441-abdb-7dc18d948ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:54:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-301008627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e82f9e8a-469b-44ac-b470-e7b8799d0109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f91718ea52c5489db98e06c44a7b35af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:54:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:54:05Z,use_quota=True,user_id='9f1eab65b06f4b40a85aa70926186056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:54:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a01f21db-1227-4e0d-93aa-fb9ab81bfab0 tempest-TaggedAttachmentsTest-879245329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d864cfb3-27ad-4bfc-b5f5-fc117b3eec77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:54:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a01f21db-1227-4e0d-93aa-fb9ab81bfab0 tempest-TaggedAttachmentsTest-879245329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d864cfb3-27ad-4bfc-b5f5-fc117b3eec77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:54:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a01f21db-1227-4e0d-93aa-fb9ab81bfab0 tempest-TaggedAttachmentsTest-879245329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (782f935b-0693-4c85-862d-a5e6bae41f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:54:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a01f21db-1227-4e0d-93aa-fb9ab81bfab0 tempest-TaggedAttachmentsTest-879245329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (782f935b-0693-4c85-862d-a5e6bae41f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e82f9e8a-469b-44ac-b470-e7b8799d0109', 'volume_name': 'volume-e82f9e8a-469b-44ac-b470-e7b8799d0109', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:54:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a01f21db-1227-4e0d-93aa-fb9ab81bfab0 tempest-TaggedAttachmentsTest-879245329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a194f869-4278-4b85-98f3-115951c1d719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:54:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a01f21db-1227-4e0d-93aa-fb9ab81bfab0 tempest-TaggedAttachmentsTest-879245329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a194f869-4278-4b85-98f3-115951c1d719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:54:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a01f21db-1227-4e0d-93aa-fb9ab81bfab0 tempest-TaggedAttachmentsTest-879245329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (432a08ed-7458-42e4-a275-edf1908eb040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:54:05 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-a01f21db-1227-4e0d-93aa-fb9ab81bfab0 tempest-TaggedAttachmentsTest-879245329 None] Volume e82f9e8a-469b-44ac-b470-e7b8799d0109: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e82f9e8a-469b-44ac-b470-e7b8799d0109', 'volume_size': 1} Sep 28 14:54:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a01f21db-1227-4e0d-93aa-fb9ab81bfab0 tempest-TaggedAttachmentsTest-879245329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:54:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a01f21db-1227-4e0d-93aa-fb9ab81bfab0 tempest-TaggedAttachmentsTest-879245329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:54:05 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a01f21db-1227-4e0d-93aa-fb9ab81bfab0 tempest-TaggedAttachmentsTest-879245329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:54:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-301008627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e82f9e8a-469b-44ac-b470-e7b8799d0109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f91718ea52c5489db98e06c44a7b35af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:54:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:54:05Z,use_quota=True,user_id='9f1eab65b06f4b40a85aa70926186056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 14:54:05 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-a01f21db-1227-4e0d-93aa-fb9ab81bfab0 tempest-TaggedAttachmentsTest-879245329 None] Creating volume e82f9e8a-469b-44ac-b470-e7b8799d0109 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 14:54:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a01f21db-1227-4e0d-93aa-fb9ab81bfab0 tempest-TaggedAttachmentsTest-879245329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:54:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a01f21db-1227-4e0d-93aa-fb9ab81bfab0 tempest-TaggedAttachmentsTest-879245329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:54:05 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a01f21db-1227-4e0d-93aa-fb9ab81bfab0 tempest-TaggedAttachmentsTest-879245329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:54:05 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a01f21db-1227-4e0d-93aa-fb9ab81bfab0 tempest-TaggedAttachmentsTest-879245329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:54:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a01f21db-1227-4e0d-93aa-fb9ab81bfab0 tempest-TaggedAttachmentsTest-879245329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:54:05 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a01f21db-1227-4e0d-93aa-fb9ab81bfab0 tempest-TaggedAttachmentsTest-879245329 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 14:54:05 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-a01f21db-1227-4e0d-93aa-fb9ab81bfab0 tempest-TaggedAttachmentsTest-879245329 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 14:54:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a01f21db-1227-4e0d-93aa-fb9ab81bfab0 tempest-TaggedAttachmentsTest-879245329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e82f9e8a-469b-44ac-b470-e7b8799d0109 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:54:05 devstack sudo[90187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e82f9e8a-469b-44ac-b470-e7b8799d0109 1073741824 Sep 28 14:54:05 devstack sudo[90187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:54:06 devstack sudo[90187]: pam_unix(sudo:session): session closed for user root Sep 28 14:54:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a01f21db-1227-4e0d-93aa-fb9ab81bfab0 tempest-TaggedAttachmentsTest-879245329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e82f9e8a-469b-44ac-b470-e7b8799d0109 1073741824" returned: 0 in 0.661s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:54:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a01f21db-1227-4e0d-93aa-fb9ab81bfab0 tempest-TaggedAttachmentsTest-879245329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e82f9e8a-469b-44ac-b470-e7b8799d0109 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:54:06 devstack sudo[90204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e82f9e8a-469b-44ac-b470-e7b8799d0109 Sep 28 14:54:06 devstack sudo[90204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:54:06 devstack sudo[90204]: pam_unix(sudo:session): session closed for user root Sep 28 14:54:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a01f21db-1227-4e0d-93aa-fb9ab81bfab0 tempest-TaggedAttachmentsTest-879245329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e82f9e8a-469b-44ac-b470-e7b8799d0109" returned: 0 in 0.664s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:54:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a01f21db-1227-4e0d-93aa-fb9ab81bfab0 tempest-TaggedAttachmentsTest-879245329 None] <== create_volume: return (1462ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 14:54:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a01f21db-1227-4e0d-93aa-fb9ab81bfab0 tempest-TaggedAttachmentsTest-879245329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.465s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:54:06 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a01f21db-1227-4e0d-93aa-fb9ab81bfab0 tempest-TaggedAttachmentsTest-879245329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (432a08ed-7458-42e4-a275-edf1908eb040) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e82f9e8a-469b-44ac-b470-e7b8799d0109', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:54:06 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a01f21db-1227-4e0d-93aa-fb9ab81bfab0 tempest-TaggedAttachmentsTest-879245329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adad84a9-870a-4d7b-9ad7-b9fb2f67010b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:54:06 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-a01f21db-1227-4e0d-93aa-fb9ab81bfab0 tempest-TaggedAttachmentsTest-879245329 None] Volume volume-e82f9e8a-469b-44ac-b470-e7b8799d0109 (e82f9e8a-469b-44ac-b470-e7b8799d0109): created successfully Sep 28 14:54:06 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a01f21db-1227-4e0d-93aa-fb9ab81bfab0 tempest-TaggedAttachmentsTest-879245329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adad84a9-870a-4d7b-9ad7-b9fb2f67010b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:54:06 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a01f21db-1227-4e0d-93aa-fb9ab81bfab0 tempest-TaggedAttachmentsTest-879245329 None] Flow 'volume_create_manager' (75e3dfe6-88dc-4ba3-9a66-93914c62ad18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:54:06 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-a01f21db-1227-4e0d-93aa-fb9ab81bfab0 tempest-TaggedAttachmentsTest-879245329 None] Created volume successfully. Sep 28 14:54:16 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:54:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:54:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:54:16 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:54:16 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:54:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:54:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:54:16 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:54:16 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:54:17 devstack sudo[90398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 14:54:17 devstack sudo[90398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:54:17 devstack sudo[90398]: pam_unix(sudo:session): session closed for user root Sep 28 14:54:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.514s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:54:17 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:54:30 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-888b8317-50b1-4318-ab9a-4ea05284476e tempest-ServersNegativeTestJSON-1688336151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 14:54:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-888b8317-50b1-4318-ab9a-4ea05284476e tempest-ServersNegativeTestJSON-1688336151 None] Flow 'volume_create_manager' (901035f9-6ee1-4c71-8606-620368f6c445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:54:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-888b8317-50b1-4318-ab9a-4ea05284476e tempest-ServersNegativeTestJSON-1688336151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6178158-510c-4d08-b220-f298fdb69c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:54:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-888b8317-50b1-4318-ab9a-4ea05284476e tempest-ServersNegativeTestJSON-1688336151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6178158-510c-4d08-b220-f298fdb69c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:54:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1683343045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=338fd65f-39b0-4599-904d-0f2739c9b57c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9be0eaf6be14c299e1e70dd1f0d0011',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:54:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:54:30Z,use_quota=True,user_id='a169e71dff154b35a32afc5386a76ade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:54:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-888b8317-50b1-4318-ab9a-4ea05284476e tempest-ServersNegativeTestJSON-1688336151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a4cd68e-4cb8-4ea3-98d3-1c04bd1e33c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:54:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-888b8317-50b1-4318-ab9a-4ea05284476e tempest-ServersNegativeTestJSON-1688336151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a4cd68e-4cb8-4ea3-98d3-1c04bd1e33c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:54:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-888b8317-50b1-4318-ab9a-4ea05284476e tempest-ServersNegativeTestJSON-1688336151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da2b9057-82af-43df-af19-dbe73f84c59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:54:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-888b8317-50b1-4318-ab9a-4ea05284476e tempest-ServersNegativeTestJSON-1688336151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da2b9057-82af-43df-af19-dbe73f84c59a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '338fd65f-39b0-4599-904d-0f2739c9b57c', 'volume_name': 'volume-338fd65f-39b0-4599-904d-0f2739c9b57c', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:54:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-888b8317-50b1-4318-ab9a-4ea05284476e tempest-ServersNegativeTestJSON-1688336151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fc59336-e1a8-4d91-b80d-ab86765e0073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:54:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-888b8317-50b1-4318-ab9a-4ea05284476e tempest-ServersNegativeTestJSON-1688336151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fc59336-e1a8-4d91-b80d-ab86765e0073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:54:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-888b8317-50b1-4318-ab9a-4ea05284476e tempest-ServersNegativeTestJSON-1688336151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37c691a6-98f4-45cb-933b-ba23d71e8cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:54:30 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-888b8317-50b1-4318-ab9a-4ea05284476e tempest-ServersNegativeTestJSON-1688336151 None] Volume 338fd65f-39b0-4599-904d-0f2739c9b57c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-338fd65f-39b0-4599-904d-0f2739c9b57c', 'volume_size': 1} Sep 28 14:54:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-888b8317-50b1-4318-ab9a-4ea05284476e tempest-ServersNegativeTestJSON-1688336151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:54:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-888b8317-50b1-4318-ab9a-4ea05284476e tempest-ServersNegativeTestJSON-1688336151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:54:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-888b8317-50b1-4318-ab9a-4ea05284476e tempest-ServersNegativeTestJSON-1688336151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:54:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1683343045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=338fd65f-39b0-4599-904d-0f2739c9b57c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9be0eaf6be14c299e1e70dd1f0d0011',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:54:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:54:30Z,use_quota=True,user_id='a169e71dff154b35a32afc5386a76ade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 14:54:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-888b8317-50b1-4318-ab9a-4ea05284476e tempest-ServersNegativeTestJSON-1688336151 None] Creating volume 338fd65f-39b0-4599-904d-0f2739c9b57c {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 14:54:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-888b8317-50b1-4318-ab9a-4ea05284476e tempest-ServersNegativeTestJSON-1688336151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:54:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-888b8317-50b1-4318-ab9a-4ea05284476e tempest-ServersNegativeTestJSON-1688336151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:54:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-888b8317-50b1-4318-ab9a-4ea05284476e tempest-ServersNegativeTestJSON-1688336151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:54:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-888b8317-50b1-4318-ab9a-4ea05284476e tempest-ServersNegativeTestJSON-1688336151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:54:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-888b8317-50b1-4318-ab9a-4ea05284476e tempest-ServersNegativeTestJSON-1688336151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:54:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-888b8317-50b1-4318-ab9a-4ea05284476e tempest-ServersNegativeTestJSON-1688336151 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 14:54:30 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-888b8317-50b1-4318-ab9a-4ea05284476e tempest-ServersNegativeTestJSON-1688336151 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 14:54:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-888b8317-50b1-4318-ab9a-4ea05284476e tempest-ServersNegativeTestJSON-1688336151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-338fd65f-39b0-4599-904d-0f2739c9b57c 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:54:30 devstack sudo[90703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-338fd65f-39b0-4599-904d-0f2739c9b57c 1073741824 Sep 28 14:54:30 devstack sudo[90703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:54:31 devstack sudo[90703]: pam_unix(sudo:session): session closed for user root Sep 28 14:54:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-888b8317-50b1-4318-ab9a-4ea05284476e tempest-ServersNegativeTestJSON-1688336151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-338fd65f-39b0-4599-904d-0f2739c9b57c 1073741824" returned: 0 in 0.910s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:54:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-888b8317-50b1-4318-ab9a-4ea05284476e tempest-ServersNegativeTestJSON-1688336151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-338fd65f-39b0-4599-904d-0f2739c9b57c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:54:31 devstack sudo[90719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-338fd65f-39b0-4599-904d-0f2739c9b57c Sep 28 14:54:31 devstack sudo[90719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:54:31 devstack sudo[90719]: pam_unix(sudo:session): session closed for user root Sep 28 14:54:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-888b8317-50b1-4318-ab9a-4ea05284476e tempest-ServersNegativeTestJSON-1688336151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-338fd65f-39b0-4599-904d-0f2739c9b57c" returned: 0 in 0.430s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:54:31 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-888b8317-50b1-4318-ab9a-4ea05284476e tempest-ServersNegativeTestJSON-1688336151 None] <== create_volume: return (1455ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 14:54:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-888b8317-50b1-4318-ab9a-4ea05284476e tempest-ServersNegativeTestJSON-1688336151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.460s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:54:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-888b8317-50b1-4318-ab9a-4ea05284476e tempest-ServersNegativeTestJSON-1688336151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37c691a6-98f4-45cb-933b-ba23d71e8cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-338fd65f-39b0-4599-904d-0f2739c9b57c', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:54:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-888b8317-50b1-4318-ab9a-4ea05284476e tempest-ServersNegativeTestJSON-1688336151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1ff08a9-14d6-437c-bcae-2bf58e258ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:54:32 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-888b8317-50b1-4318-ab9a-4ea05284476e tempest-ServersNegativeTestJSON-1688336151 None] Volume volume-338fd65f-39b0-4599-904d-0f2739c9b57c (338fd65f-39b0-4599-904d-0f2739c9b57c): created successfully Sep 28 14:54:32 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-888b8317-50b1-4318-ab9a-4ea05284476e tempest-ServersNegativeTestJSON-1688336151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1ff08a9-14d6-437c-bcae-2bf58e258ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:54:32 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-888b8317-50b1-4318-ab9a-4ea05284476e tempest-ServersNegativeTestJSON-1688336151 None] Flow 'volume_create_manager' (901035f9-6ee1-4c71-8606-620368f6c445) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:54:32 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-888b8317-50b1-4318-ab9a-4ea05284476e tempest-ServersNegativeTestJSON-1688336151 None] Created volume successfully. Sep 28 14:54:35 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a216747-09c2-47c1-a347-ef1d74111013 tempest-ServersNegativeTestJSON-1688336151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 14:54:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6a216747-09c2-47c1-a347-ef1d74111013 tempest-ServersNegativeTestJSON-1688336151 None] Flow 'volume_create_manager' (a1c6fe63-1d95-4082-9177-631e3ce1cfbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:54:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6a216747-09c2-47c1-a347-ef1d74111013 tempest-ServersNegativeTestJSON-1688336151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a97078a-8e43-4b66-a6e5-f2bc7f96b440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:54:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6a216747-09c2-47c1-a347-ef1d74111013 tempest-ServersNegativeTestJSON-1688336151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a97078a-8e43-4b66-a6e5-f2bc7f96b440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1386038033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1549938e-ee8d-4955-a1ea-51ccb95f124d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9be0eaf6be14c299e1e70dd1f0d0011',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:54:35Z,use_quota=True,user_id='a169e71dff154b35a32afc5386a76ade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:54:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6a216747-09c2-47c1-a347-ef1d74111013 tempest-ServersNegativeTestJSON-1688336151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bce79718-b239-4d49-be5a-0afa9530d8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:54:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6a216747-09c2-47c1-a347-ef1d74111013 tempest-ServersNegativeTestJSON-1688336151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bce79718-b239-4d49-be5a-0afa9530d8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:54:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6a216747-09c2-47c1-a347-ef1d74111013 tempest-ServersNegativeTestJSON-1688336151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9442ffc4-a9bf-4a6a-a354-af1c3e31de04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:54:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6a216747-09c2-47c1-a347-ef1d74111013 tempest-ServersNegativeTestJSON-1688336151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9442ffc4-a9bf-4a6a-a354-af1c3e31de04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1549938e-ee8d-4955-a1ea-51ccb95f124d', 'volume_name': 'volume-1549938e-ee8d-4955-a1ea-51ccb95f124d', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:54:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6a216747-09c2-47c1-a347-ef1d74111013 tempest-ServersNegativeTestJSON-1688336151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91311eb5-d5c5-46c9-882b-2ab83d3c146a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:54:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6a216747-09c2-47c1-a347-ef1d74111013 tempest-ServersNegativeTestJSON-1688336151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91311eb5-d5c5-46c9-882b-2ab83d3c146a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:54:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6a216747-09c2-47c1-a347-ef1d74111013 tempest-ServersNegativeTestJSON-1688336151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d63ee0f6-ab8f-4499-a69b-0706d4ff3488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:54:35 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-6a216747-09c2-47c1-a347-ef1d74111013 tempest-ServersNegativeTestJSON-1688336151 None] Volume 1549938e-ee8d-4955-a1ea-51ccb95f124d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1549938e-ee8d-4955-a1ea-51ccb95f124d', 'volume_size': 1} Sep 28 14:54:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6a216747-09c2-47c1-a347-ef1d74111013 tempest-ServersNegativeTestJSON-1688336151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:54:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6a216747-09c2-47c1-a347-ef1d74111013 tempest-ServersNegativeTestJSON-1688336151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:54:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-6a216747-09c2-47c1-a347-ef1d74111013 tempest-ServersNegativeTestJSON-1688336151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1386038033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1549938e-ee8d-4955-a1ea-51ccb95f124d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9be0eaf6be14c299e1e70dd1f0d0011',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:54:35Z,use_quota=True,user_id='a169e71dff154b35a32afc5386a76ade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 14:54:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-6a216747-09c2-47c1-a347-ef1d74111013 tempest-ServersNegativeTestJSON-1688336151 None] Creating volume 1549938e-ee8d-4955-a1ea-51ccb95f124d {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 14:54:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6a216747-09c2-47c1-a347-ef1d74111013 tempest-ServersNegativeTestJSON-1688336151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:54:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6a216747-09c2-47c1-a347-ef1d74111013 tempest-ServersNegativeTestJSON-1688336151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:54:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-6a216747-09c2-47c1-a347-ef1d74111013 tempest-ServersNegativeTestJSON-1688336151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:54:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-6a216747-09c2-47c1-a347-ef1d74111013 tempest-ServersNegativeTestJSON-1688336151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:54:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6a216747-09c2-47c1-a347-ef1d74111013 tempest-ServersNegativeTestJSON-1688336151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:54:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-6a216747-09c2-47c1-a347-ef1d74111013 tempest-ServersNegativeTestJSON-1688336151 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 14:54:35 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-6a216747-09c2-47c1-a347-ef1d74111013 tempest-ServersNegativeTestJSON-1688336151 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 14:54:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6a216747-09c2-47c1-a347-ef1d74111013 tempest-ServersNegativeTestJSON-1688336151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1549938e-ee8d-4955-a1ea-51ccb95f124d 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:54:35 devstack sudo[90754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1549938e-ee8d-4955-a1ea-51ccb95f124d 1073741824 Sep 28 14:54:35 devstack sudo[90754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:54:36 devstack sudo[90754]: pam_unix(sudo:session): session closed for user root Sep 28 14:54:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6a216747-09c2-47c1-a347-ef1d74111013 tempest-ServersNegativeTestJSON-1688336151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1549938e-ee8d-4955-a1ea-51ccb95f124d 1073741824" returned: 0 in 0.836s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:54:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6a216747-09c2-47c1-a347-ef1d74111013 tempest-ServersNegativeTestJSON-1688336151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1549938e-ee8d-4955-a1ea-51ccb95f124d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:54:36 devstack sudo[90763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1549938e-ee8d-4955-a1ea-51ccb95f124d Sep 28 14:54:36 devstack sudo[90763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:54:37 devstack sudo[90763]: pam_unix(sudo:session): session closed for user root Sep 28 14:54:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6a216747-09c2-47c1-a347-ef1d74111013 tempest-ServersNegativeTestJSON-1688336151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1549938e-ee8d-4955-a1ea-51ccb95f124d" returned: 0 in 0.480s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:54:37 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-6a216747-09c2-47c1-a347-ef1d74111013 tempest-ServersNegativeTestJSON-1688336151 None] <== create_volume: return (1431ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 14:54:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6a216747-09c2-47c1-a347-ef1d74111013 tempest-ServersNegativeTestJSON-1688336151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.436s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:54:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6a216747-09c2-47c1-a347-ef1d74111013 tempest-ServersNegativeTestJSON-1688336151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d63ee0f6-ab8f-4499-a69b-0706d4ff3488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1549938e-ee8d-4955-a1ea-51ccb95f124d', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:54:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6a216747-09c2-47c1-a347-ef1d74111013 tempest-ServersNegativeTestJSON-1688336151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e73bf0e4-9f9c-4e83-a515-629084bf8e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:54:37 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-6a216747-09c2-47c1-a347-ef1d74111013 tempest-ServersNegativeTestJSON-1688336151 None] Volume volume-1549938e-ee8d-4955-a1ea-51ccb95f124d (1549938e-ee8d-4955-a1ea-51ccb95f124d): created successfully Sep 28 14:54:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6a216747-09c2-47c1-a347-ef1d74111013 tempest-ServersNegativeTestJSON-1688336151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e73bf0e4-9f9c-4e83-a515-629084bf8e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:54:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6a216747-09c2-47c1-a347-ef1d74111013 tempest-ServersNegativeTestJSON-1688336151 None] Flow 'volume_create_manager' (a1c6fe63-1d95-4082-9177-631e3ce1cfbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:54:37 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-6a216747-09c2-47c1-a347-ef1d74111013 tempest-ServersNegativeTestJSON-1688336151 None] Created volume successfully. Sep 28 14:54:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d10dd866-301d-4a9f-bcf0-85d70222bd70 tempest-ServersNegativeTestJSON-1688336151 None] Acquiring lock "cinder-1549938e-ee8d-4955-a1ea-51ccb95f124d-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:54:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d10dd866-301d-4a9f-bcf0-85d70222bd70 tempest-ServersNegativeTestJSON-1688336151 None] Lock "cinder-1549938e-ee8d-4955-a1ea-51ccb95f124d-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:54:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d10dd866-301d-4a9f-bcf0-85d70222bd70 tempest-ServersNegativeTestJSON-1688336151 None] Acquiring lock "cinder-quobyte-1549938e-ee8d-4955-a1ea-51ccb95f124d" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:54:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d10dd866-301d-4a9f-bcf0-85d70222bd70 tempest-ServersNegativeTestJSON-1688336151 None] Lock "cinder-quobyte-1549938e-ee8d-4955-a1ea-51ccb95f124d" acquired by "delete_volume" :: waited 0.033s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:54:38 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ab846f-13d9-4d58-8360-299510bf3034]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:54:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d10dd866-301d-4a9f-bcf0-85d70222bd70 tempest-ServersNegativeTestJSON-1688336151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1549938e-ee8d-4955-a1ea-51ccb95f124d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:54:38 devstack sudo[90772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1549938e-ee8d-4955-a1ea-51ccb95f124d Sep 28 14:54:38 devstack sudo[90772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:54:39 devstack sudo[90772]: pam_unix(sudo:session): session closed for user root Sep 28 14:54:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d10dd866-301d-4a9f-bcf0-85d70222bd70 tempest-ServersNegativeTestJSON-1688336151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1549938e-ee8d-4955-a1ea-51ccb95f124d" returned: 0 in 0.584s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:54:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d10dd866-301d-4a9f-bcf0-85d70222bd70 tempest-ServersNegativeTestJSON-1688336151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1549938e-ee8d-4955-a1ea-51ccb95f124d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:54:39 devstack sudo[90788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1549938e-ee8d-4955-a1ea-51ccb95f124d Sep 28 14:54:39 devstack sudo[90788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:54:39 devstack sudo[90788]: pam_unix(sudo:session): session closed for user root Sep 28 14:54:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d10dd866-301d-4a9f-bcf0-85d70222bd70 tempest-ServersNegativeTestJSON-1688336151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1549938e-ee8d-4955-a1ea-51ccb95f124d" returned: 0 in 0.424s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:54:39 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d10dd866-301d-4a9f-bcf0-85d70222bd70 tempest-ServersNegativeTestJSON-1688336151 None] Lock "cinder-quobyte-1549938e-ee8d-4955-a1ea-51ccb95f124d" released by "delete_volume" :: held 1.100s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:54:39 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-d10dd866-301d-4a9f-bcf0-85d70222bd70 tempest-ServersNegativeTestJSON-1688336151 None] Created reservations ['d8878ec4-70f5-484f-b010-97908ed076de', 'ab6370b4-e3d5-40ea-b588-84988d1eabf1', '89e5696d-c689-4fba-9e80-025f36dceb6c', 'd72aef87-f862-403b-baba-f78a3b6c68cf'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 14:54:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d10dd866-301d-4a9f-bcf0-85d70222bd70 tempest-ServersNegativeTestJSON-1688336151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:54:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d10dd866-301d-4a9f-bcf0-85d70222bd70 tempest-ServersNegativeTestJSON-1688336151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:54:40 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d10dd866-301d-4a9f-bcf0-85d70222bd70 tempest-ServersNegativeTestJSON-1688336151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:54:40 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d10dd866-301d-4a9f-bcf0-85d70222bd70 tempest-ServersNegativeTestJSON-1688336151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:54:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d10dd866-301d-4a9f-bcf0-85d70222bd70 tempest-ServersNegativeTestJSON-1688336151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:54:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d10dd866-301d-4a9f-bcf0-85d70222bd70 tempest-ServersNegativeTestJSON-1688336151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:54:40 devstack sudo[90804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 14:54:40 devstack sudo[90804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:54:40 devstack sudo[90804]: pam_unix(sudo:session): session closed for user root Sep 28 14:54:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d10dd866-301d-4a9f-bcf0-85d70222bd70 tempest-ServersNegativeTestJSON-1688336151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.334s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:54:40 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-d10dd866-301d-4a9f-bcf0-85d70222bd70 tempest-ServersNegativeTestJSON-1688336151 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:54:40 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-d10dd866-301d-4a9f-bcf0-85d70222bd70 tempest-ServersNegativeTestJSON-1688336151 None] Deleted volume successfully. Sep 28 14:54:40 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d10dd866-301d-4a9f-bcf0-85d70222bd70 tempest-ServersNegativeTestJSON-1688336151 None] Lock "cinder-1549938e-ee8d-4955-a1ea-51ccb95f124d-delete_volume" released by "delete_volume" :: held 1.919s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:54:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-bd8c5bd4-4d02-4c79-96b6-76d584a1c2ef tempest-ServersNegativeTestJSON-1688336151 None] Acquiring lock "cinder-338fd65f-39b0-4599-904d-0f2739c9b57c-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:54:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-bd8c5bd4-4d02-4c79-96b6-76d584a1c2ef tempest-ServersNegativeTestJSON-1688336151 None] Lock "cinder-338fd65f-39b0-4599-904d-0f2739c9b57c-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:54:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-bd8c5bd4-4d02-4c79-96b6-76d584a1c2ef tempest-ServersNegativeTestJSON-1688336151 None] Acquiring lock "cinder-quobyte-338fd65f-39b0-4599-904d-0f2739c9b57c" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:54:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-bd8c5bd4-4d02-4c79-96b6-76d584a1c2ef tempest-ServersNegativeTestJSON-1688336151 None] Lock "cinder-quobyte-338fd65f-39b0-4599-904d-0f2739c9b57c" acquired by "delete_volume" :: waited 0.027s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:54:41 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e89922-1486-424f-9d0d-84989bf4b970]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:54:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bd8c5bd4-4d02-4c79-96b6-76d584a1c2ef tempest-ServersNegativeTestJSON-1688336151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-338fd65f-39b0-4599-904d-0f2739c9b57c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:54:41 devstack sudo[90807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-338fd65f-39b0-4599-904d-0f2739c9b57c Sep 28 14:54:41 devstack sudo[90807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:54:41 devstack sudo[90807]: pam_unix(sudo:session): session closed for user root Sep 28 14:54:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bd8c5bd4-4d02-4c79-96b6-76d584a1c2ef tempest-ServersNegativeTestJSON-1688336151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-338fd65f-39b0-4599-904d-0f2739c9b57c" returned: 0 in 0.489s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:54:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bd8c5bd4-4d02-4c79-96b6-76d584a1c2ef tempest-ServersNegativeTestJSON-1688336151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-338fd65f-39b0-4599-904d-0f2739c9b57c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:54:41 devstack sudo[90812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-338fd65f-39b0-4599-904d-0f2739c9b57c Sep 28 14:54:41 devstack sudo[90812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:54:42 devstack sudo[90812]: pam_unix(sudo:session): session closed for user root Sep 28 14:54:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bd8c5bd4-4d02-4c79-96b6-76d584a1c2ef tempest-ServersNegativeTestJSON-1688336151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-338fd65f-39b0-4599-904d-0f2739c9b57c" returned: 0 in 0.361s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:54:42 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-bd8c5bd4-4d02-4c79-96b6-76d584a1c2ef tempest-ServersNegativeTestJSON-1688336151 None] Lock "cinder-quobyte-338fd65f-39b0-4599-904d-0f2739c9b57c" released by "delete_volume" :: held 0.910s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:54:42 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-bd8c5bd4-4d02-4c79-96b6-76d584a1c2ef tempest-ServersNegativeTestJSON-1688336151 None] Created reservations ['4d27a9ec-4bc6-4f0d-8de4-b3593b6e1e08', '33b20268-811a-4880-89f7-fb220c6e9da4', '5ff309d6-43ab-4390-aa19-9d90bea34362', '3fc14e3e-67c3-4861-b55b-f153b11b4d0c'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 14:54:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bd8c5bd4-4d02-4c79-96b6-76d584a1c2ef tempest-ServersNegativeTestJSON-1688336151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:54:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bd8c5bd4-4d02-4c79-96b6-76d584a1c2ef tempest-ServersNegativeTestJSON-1688336151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:54:42 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-bd8c5bd4-4d02-4c79-96b6-76d584a1c2ef tempest-ServersNegativeTestJSON-1688336151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:54:42 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-bd8c5bd4-4d02-4c79-96b6-76d584a1c2ef tempest-ServersNegativeTestJSON-1688336151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:54:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bd8c5bd4-4d02-4c79-96b6-76d584a1c2ef tempest-ServersNegativeTestJSON-1688336151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:54:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bd8c5bd4-4d02-4c79-96b6-76d584a1c2ef tempest-ServersNegativeTestJSON-1688336151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:54:42 devstack sudo[90815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 14:54:42 devstack sudo[90815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:54:42 devstack sudo[90815]: pam_unix(sudo:session): session closed for user root Sep 28 14:54:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bd8c5bd4-4d02-4c79-96b6-76d584a1c2ef tempest-ServersNegativeTestJSON-1688336151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.291s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:54:42 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-bd8c5bd4-4d02-4c79-96b6-76d584a1c2ef tempest-ServersNegativeTestJSON-1688336151 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:54:42 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-bd8c5bd4-4d02-4c79-96b6-76d584a1c2ef tempest-ServersNegativeTestJSON-1688336151 None] Deleted volume successfully. Sep 28 14:54:42 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-bd8c5bd4-4d02-4c79-96b6-76d584a1c2ef tempest-ServersNegativeTestJSON-1688336151 None] Lock "cinder-338fd65f-39b0-4599-904d-0f2739c9b57c-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:54:52 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=16,cinder:UPDATE=23,cinder:DELETE=1,cinder:INSERT=6 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:54:52 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:UPDATE=21,cinder:SELECT=12,cinder:INSERT=4,cinder:DELETE=3 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:54:55 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7e28fee-5631-4cc8-9668-44a8d80b614b tempest-ServerActionsTestOtherA-1078904851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 14:54:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b7e28fee-5631-4cc8-9668-44a8d80b614b tempest-ServerActionsTestOtherA-1078904851 None] Flow 'volume_create_manager' (fe409b41-70b5-4b4b-ac01-8b2fa1b4ae75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:54:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b7e28fee-5631-4cc8-9668-44a8d80b614b tempest-ServerActionsTestOtherA-1078904851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f63f9a04-e883-4b5e-968c-450267723bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:54:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b7e28fee-5631-4cc8-9668-44a8d80b614b tempest-ServerActionsTestOtherA-1078904851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f63f9a04-e883-4b5e-968c-450267723bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:54:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1137040641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c35c06be-12ba-4c6e-8ce6-cf5e912fec8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f6da66fa0094daf8ab49af063ebe64e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:54:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:54:56Z,use_quota=True,user_id='73bb3415cddd4d5e901ce087f4531843',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:54:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b7e28fee-5631-4cc8-9668-44a8d80b614b tempest-ServerActionsTestOtherA-1078904851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c368c61d-3101-4e10-bb65-bb695678179e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:54:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b7e28fee-5631-4cc8-9668-44a8d80b614b tempest-ServerActionsTestOtherA-1078904851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c368c61d-3101-4e10-bb65-bb695678179e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:54:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b7e28fee-5631-4cc8-9668-44a8d80b614b tempest-ServerActionsTestOtherA-1078904851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (562962c4-6d46-4582-8674-a90bb4ecdcfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:54:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b7e28fee-5631-4cc8-9668-44a8d80b614b tempest-ServerActionsTestOtherA-1078904851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (562962c4-6d46-4582-8674-a90bb4ecdcfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c35c06be-12ba-4c6e-8ce6-cf5e912fec8e', 'volume_name': 'volume-c35c06be-12ba-4c6e-8ce6-cf5e912fec8e', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:54:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b7e28fee-5631-4cc8-9668-44a8d80b614b tempest-ServerActionsTestOtherA-1078904851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c80c2a8-4911-4e62-b81e-1713f15b1bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:54:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b7e28fee-5631-4cc8-9668-44a8d80b614b tempest-ServerActionsTestOtherA-1078904851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c80c2a8-4911-4e62-b81e-1713f15b1bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:54:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b7e28fee-5631-4cc8-9668-44a8d80b614b tempest-ServerActionsTestOtherA-1078904851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca9cb298-5526-4d02-a311-6a9a11d6cebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:54:56 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-b7e28fee-5631-4cc8-9668-44a8d80b614b tempest-ServerActionsTestOtherA-1078904851 None] Volume c35c06be-12ba-4c6e-8ce6-cf5e912fec8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c35c06be-12ba-4c6e-8ce6-cf5e912fec8e', 'volume_size': 1} Sep 28 14:54:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b7e28fee-5631-4cc8-9668-44a8d80b614b tempest-ServerActionsTestOtherA-1078904851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:54:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b7e28fee-5631-4cc8-9668-44a8d80b614b tempest-ServerActionsTestOtherA-1078904851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:54:56 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b7e28fee-5631-4cc8-9668-44a8d80b614b tempest-ServerActionsTestOtherA-1078904851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:54:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1137040641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c35c06be-12ba-4c6e-8ce6-cf5e912fec8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f6da66fa0094daf8ab49af063ebe64e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:54:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:54:56Z,use_quota=True,user_id='73bb3415cddd4d5e901ce087f4531843',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 14:54:56 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-b7e28fee-5631-4cc8-9668-44a8d80b614b tempest-ServerActionsTestOtherA-1078904851 None] Creating volume c35c06be-12ba-4c6e-8ce6-cf5e912fec8e {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 14:54:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b7e28fee-5631-4cc8-9668-44a8d80b614b tempest-ServerActionsTestOtherA-1078904851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:54:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b7e28fee-5631-4cc8-9668-44a8d80b614b tempest-ServerActionsTestOtherA-1078904851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:54:56 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b7e28fee-5631-4cc8-9668-44a8d80b614b tempest-ServerActionsTestOtherA-1078904851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:54:56 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b7e28fee-5631-4cc8-9668-44a8d80b614b tempest-ServerActionsTestOtherA-1078904851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:54:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b7e28fee-5631-4cc8-9668-44a8d80b614b tempest-ServerActionsTestOtherA-1078904851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:54:56 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b7e28fee-5631-4cc8-9668-44a8d80b614b tempest-ServerActionsTestOtherA-1078904851 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 14:54:56 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-b7e28fee-5631-4cc8-9668-44a8d80b614b tempest-ServerActionsTestOtherA-1078904851 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 14:54:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b7e28fee-5631-4cc8-9668-44a8d80b614b tempest-ServerActionsTestOtherA-1078904851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c35c06be-12ba-4c6e-8ce6-cf5e912fec8e 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:54:56 devstack sudo[91011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c35c06be-12ba-4c6e-8ce6-cf5e912fec8e 1073741824 Sep 28 14:54:56 devstack sudo[91011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:54:56 devstack sudo[91011]: pam_unix(sudo:session): session closed for user root Sep 28 14:54:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b7e28fee-5631-4cc8-9668-44a8d80b614b tempest-ServerActionsTestOtherA-1078904851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c35c06be-12ba-4c6e-8ce6-cf5e912fec8e 1073741824" returned: 0 in 0.819s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:54:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b7e28fee-5631-4cc8-9668-44a8d80b614b tempest-ServerActionsTestOtherA-1078904851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c35c06be-12ba-4c6e-8ce6-cf5e912fec8e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:54:57 devstack sudo[91017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c35c06be-12ba-4c6e-8ce6-cf5e912fec8e Sep 28 14:54:57 devstack sudo[91017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:54:57 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [req-f75f7626-96e9-4312-a5db-05e501470194 req-19d657de-a9a8-478a-997b-b45341a2c10e tempest-VolumesSnapshotsTestJSON-897712566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 14:54:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-f75f7626-96e9-4312-a5db-05e501470194 req-19d657de-a9a8-478a-997b-b45341a2c10e tempest-VolumesSnapshotsTestJSON-897712566 None] Flow 'volume_create_manager' (7f2c677f-fd59-4182-9d33-f176d8eb690f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:54:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-f75f7626-96e9-4312-a5db-05e501470194 req-19d657de-a9a8-478a-997b-b45341a2c10e tempest-VolumesSnapshotsTestJSON-897712566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5bb14f4-2c83-45ed-b2dc-26a5ac6db780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:54:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-f75f7626-96e9-4312-a5db-05e501470194 req-19d657de-a9a8-478a-997b-b45341a2c10e tempest-VolumesSnapshotsTestJSON-897712566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5bb14f4-2c83-45ed-b2dc-26a5ac6db780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-543197089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85432d1b-5e12-4c49-a654-de41eb113d1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b59746f50b274e16b3088248683b44b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:54:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:54:57Z,use_quota=True,user_id='bbbdef878a4844aea05bcebb344488e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:54:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-f75f7626-96e9-4312-a5db-05e501470194 req-19d657de-a9a8-478a-997b-b45341a2c10e tempest-VolumesSnapshotsTestJSON-897712566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e4da1b2-c48f-43e8-87d3-82268a6ffc04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:54:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-f75f7626-96e9-4312-a5db-05e501470194 req-19d657de-a9a8-478a-997b-b45341a2c10e tempest-VolumesSnapshotsTestJSON-897712566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e4da1b2-c48f-43e8-87d3-82268a6ffc04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:54:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-f75f7626-96e9-4312-a5db-05e501470194 req-19d657de-a9a8-478a-997b-b45341a2c10e tempest-VolumesSnapshotsTestJSON-897712566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0edc4762-2def-4c57-853a-e5ad284518b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:54:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-f75f7626-96e9-4312-a5db-05e501470194 req-19d657de-a9a8-478a-997b-b45341a2c10e tempest-VolumesSnapshotsTestJSON-897712566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0edc4762-2def-4c57-853a-e5ad284518b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85432d1b-5e12-4c49-a654-de41eb113d1c', 'volume_name': 'volume-85432d1b-5e12-4c49-a654-de41eb113d1c', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:54:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-f75f7626-96e9-4312-a5db-05e501470194 req-19d657de-a9a8-478a-997b-b45341a2c10e tempest-VolumesSnapshotsTestJSON-897712566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21e3ae1f-4dea-42e7-a979-85b763ee5b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:54:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-f75f7626-96e9-4312-a5db-05e501470194 req-19d657de-a9a8-478a-997b-b45341a2c10e tempest-VolumesSnapshotsTestJSON-897712566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21e3ae1f-4dea-42e7-a979-85b763ee5b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:54:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-f75f7626-96e9-4312-a5db-05e501470194 req-19d657de-a9a8-478a-997b-b45341a2c10e tempest-VolumesSnapshotsTestJSON-897712566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac3b9ec9-3327-4795-8b14-24ba078d4560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:54:57 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [req-f75f7626-96e9-4312-a5db-05e501470194 req-19d657de-a9a8-478a-997b-b45341a2c10e tempest-VolumesSnapshotsTestJSON-897712566 None] Volume 85432d1b-5e12-4c49-a654-de41eb113d1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85432d1b-5e12-4c49-a654-de41eb113d1c', 'volume_size': 1} Sep 28 14:54:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-f75f7626-96e9-4312-a5db-05e501470194 req-19d657de-a9a8-478a-997b-b45341a2c10e tempest-VolumesSnapshotsTestJSON-897712566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:54:57 devstack sudo[91017]: pam_unix(sudo:session): session closed for user root Sep 28 14:54:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b7e28fee-5631-4cc8-9668-44a8d80b614b tempest-ServerActionsTestOtherA-1078904851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c35c06be-12ba-4c6e-8ce6-cf5e912fec8e" returned: 0 in 0.573s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:54:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b7e28fee-5631-4cc8-9668-44a8d80b614b tempest-ServerActionsTestOtherA-1078904851 None] <== create_volume: return (1490ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 14:54:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b7e28fee-5631-4cc8-9668-44a8d80b614b tempest-ServerActionsTestOtherA-1078904851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.494s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:54:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-f75f7626-96e9-4312-a5db-05e501470194 req-19d657de-a9a8-478a-997b-b45341a2c10e tempest-VolumesSnapshotsTestJSON-897712566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.161s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:54:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [req-f75f7626-96e9-4312-a5db-05e501470194 req-19d657de-a9a8-478a-997b-b45341a2c10e tempest-VolumesSnapshotsTestJSON-897712566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-543197089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85432d1b-5e12-4c49-a654-de41eb113d1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b59746f50b274e16b3088248683b44b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:54:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:54:57Z,use_quota=True,user_id='bbbdef878a4844aea05bcebb344488e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 14:54:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [req-f75f7626-96e9-4312-a5db-05e501470194 req-19d657de-a9a8-478a-997b-b45341a2c10e tempest-VolumesSnapshotsTestJSON-897712566 None] Creating volume 85432d1b-5e12-4c49-a654-de41eb113d1c {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 14:54:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-f75f7626-96e9-4312-a5db-05e501470194 req-19d657de-a9a8-478a-997b-b45341a2c10e tempest-VolumesSnapshotsTestJSON-897712566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:54:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-f75f7626-96e9-4312-a5db-05e501470194 req-19d657de-a9a8-478a-997b-b45341a2c10e tempest-VolumesSnapshotsTestJSON-897712566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:54:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [req-f75f7626-96e9-4312-a5db-05e501470194 req-19d657de-a9a8-478a-997b-b45341a2c10e tempest-VolumesSnapshotsTestJSON-897712566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:54:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [req-f75f7626-96e9-4312-a5db-05e501470194 req-19d657de-a9a8-478a-997b-b45341a2c10e tempest-VolumesSnapshotsTestJSON-897712566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:54:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-f75f7626-96e9-4312-a5db-05e501470194 req-19d657de-a9a8-478a-997b-b45341a2c10e tempest-VolumesSnapshotsTestJSON-897712566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:54:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [req-f75f7626-96e9-4312-a5db-05e501470194 req-19d657de-a9a8-478a-997b-b45341a2c10e tempest-VolumesSnapshotsTestJSON-897712566 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 14:54:57 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [req-f75f7626-96e9-4312-a5db-05e501470194 req-19d657de-a9a8-478a-997b-b45341a2c10e tempest-VolumesSnapshotsTestJSON-897712566 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 14:54:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-f75f7626-96e9-4312-a5db-05e501470194 req-19d657de-a9a8-478a-997b-b45341a2c10e tempest-VolumesSnapshotsTestJSON-897712566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-85432d1b-5e12-4c49-a654-de41eb113d1c 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:54:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b7e28fee-5631-4cc8-9668-44a8d80b614b tempest-ServerActionsTestOtherA-1078904851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca9cb298-5526-4d02-a311-6a9a11d6cebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c35c06be-12ba-4c6e-8ce6-cf5e912fec8e', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:54:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b7e28fee-5631-4cc8-9668-44a8d80b614b tempest-ServerActionsTestOtherA-1078904851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82ebd4f0-2217-408f-9d13-daea1a606007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:54:57 devstack sudo[91023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-85432d1b-5e12-4c49-a654-de41eb113d1c 1073741824 Sep 28 14:54:57 devstack sudo[91023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:54:57 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-b7e28fee-5631-4cc8-9668-44a8d80b614b tempest-ServerActionsTestOtherA-1078904851 None] Volume volume-c35c06be-12ba-4c6e-8ce6-cf5e912fec8e (c35c06be-12ba-4c6e-8ce6-cf5e912fec8e): created successfully Sep 28 14:54:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b7e28fee-5631-4cc8-9668-44a8d80b614b tempest-ServerActionsTestOtherA-1078904851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82ebd4f0-2217-408f-9d13-daea1a606007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:54:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b7e28fee-5631-4cc8-9668-44a8d80b614b tempest-ServerActionsTestOtherA-1078904851 None] Flow 'volume_create_manager' (fe409b41-70b5-4b4b-ac01-8b2fa1b4ae75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:54:57 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-b7e28fee-5631-4cc8-9668-44a8d80b614b tempest-ServerActionsTestOtherA-1078904851 None] Created volume successfully. Sep 28 14:54:58 devstack sudo[91023]: pam_unix(sudo:session): session closed for user root Sep 28 14:54:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-f75f7626-96e9-4312-a5db-05e501470194 req-19d657de-a9a8-478a-997b-b45341a2c10e tempest-VolumesSnapshotsTestJSON-897712566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-85432d1b-5e12-4c49-a654-de41eb113d1c 1073741824" returned: 0 in 0.603s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:54:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-f75f7626-96e9-4312-a5db-05e501470194 req-19d657de-a9a8-478a-997b-b45341a2c10e tempest-VolumesSnapshotsTestJSON-897712566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-85432d1b-5e12-4c49-a654-de41eb113d1c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:54:58 devstack sudo[91029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-85432d1b-5e12-4c49-a654-de41eb113d1c Sep 28 14:54:58 devstack sudo[91029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:54:58 devstack sudo[91029]: pam_unix(sudo:session): session closed for user root Sep 28 14:54:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-f75f7626-96e9-4312-a5db-05e501470194 req-19d657de-a9a8-478a-997b-b45341a2c10e tempest-VolumesSnapshotsTestJSON-897712566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-85432d1b-5e12-4c49-a654-de41eb113d1c" returned: 0 in 0.377s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:54:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [req-f75f7626-96e9-4312-a5db-05e501470194 req-19d657de-a9a8-478a-997b-b45341a2c10e tempest-VolumesSnapshotsTestJSON-897712566 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 14:54:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-f75f7626-96e9-4312-a5db-05e501470194 req-19d657de-a9a8-478a-997b-b45341a2c10e tempest-VolumesSnapshotsTestJSON-897712566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:54:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-f75f7626-96e9-4312-a5db-05e501470194 req-19d657de-a9a8-478a-997b-b45341a2c10e tempest-VolumesSnapshotsTestJSON-897712566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac3b9ec9-3327-4795-8b14-24ba078d4560) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85432d1b-5e12-4c49-a654-de41eb113d1c', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:54:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-f75f7626-96e9-4312-a5db-05e501470194 req-19d657de-a9a8-478a-997b-b45341a2c10e tempest-VolumesSnapshotsTestJSON-897712566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5abd8e8f-8fe4-4d56-80ae-b0ac2bb5de6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:54:58 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [req-f75f7626-96e9-4312-a5db-05e501470194 req-19d657de-a9a8-478a-997b-b45341a2c10e tempest-VolumesSnapshotsTestJSON-897712566 None] Volume volume-85432d1b-5e12-4c49-a654-de41eb113d1c (85432d1b-5e12-4c49-a654-de41eb113d1c): created successfully Sep 28 14:54:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-f75f7626-96e9-4312-a5db-05e501470194 req-19d657de-a9a8-478a-997b-b45341a2c10e tempest-VolumesSnapshotsTestJSON-897712566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5abd8e8f-8fe4-4d56-80ae-b0ac2bb5de6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:54:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-f75f7626-96e9-4312-a5db-05e501470194 req-19d657de-a9a8-478a-997b-b45341a2c10e tempest-VolumesSnapshotsTestJSON-897712566 None] Flow 'volume_create_manager' (7f2c677f-fd59-4182-9d33-f176d8eb690f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:54:58 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-f75f7626-96e9-4312-a5db-05e501470194 req-19d657de-a9a8-478a-997b-b45341a2c10e tempest-VolumesSnapshotsTestJSON-897712566 None] Created volume successfully. Sep 28 14:55:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-40f49e69-6f80-4d62-81d2-5023d6c6b75d req-974c08d4-cf93-4497-b2a4-4627df26785f tempest-VolumesSnapshotsTestJSON-897712566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:55:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-40f49e69-6f80-4d62-81d2-5023d6c6b75d req-974c08d4-cf93-4497-b2a4-4627df26785f tempest-VolumesSnapshotsTestJSON-897712566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:55:00 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [req-40f49e69-6f80-4d62-81d2-5023d6c6b75d req-974c08d4-cf93-4497-b2a4-4627df26785f tempest-VolumesSnapshotsTestJSON-897712566 None] Creating offline snapshot 729601f8-b648-4de3-abec-716ef6565455 of volume 85432d1b-5e12-4c49-a654-de41eb113d1c {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 14:55:01 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[8854c5d5-11e3-4ada-bcf6-f30ebe25dc3d]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:55:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-40f49e69-6f80-4d62-81d2-5023d6c6b75d req-974c08d4-cf93-4497-b2a4-4627df26785f tempest-VolumesSnapshotsTestJSON-897712566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-85432d1b-5e12-4c49-a654-de41eb113d1c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:01 devstack sudo[91038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-85432d1b-5e12-4c49-a654-de41eb113d1c Sep 28 14:55:01 devstack sudo[91038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:01 devstack sudo[91038]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-40f49e69-6f80-4d62-81d2-5023d6c6b75d req-974c08d4-cf93-4497-b2a4-4627df26785f tempest-VolumesSnapshotsTestJSON-897712566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-85432d1b-5e12-4c49-a654-de41eb113d1c" returned: 0 in 0.626s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-40f49e69-6f80-4d62-81d2-5023d6c6b75d req-974c08d4-cf93-4497-b2a4-4627df26785f tempest-VolumesSnapshotsTestJSON-897712566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-85432d1b-5e12-4c49-a654-de41eb113d1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-85432d1b-5e12-4c49-a654-de41eb113d1c.729601f8-b648-4de3-abec-716ef6565455 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:01 devstack sudo[91045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-85432d1b-5e12-4c49-a654-de41eb113d1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-85432d1b-5e12-4c49-a654-de41eb113d1c.729601f8-b648-4de3-abec-716ef6565455 1G Sep 28 14:55:01 devstack sudo[91045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:02 devstack sudo[91045]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-40f49e69-6f80-4d62-81d2-5023d6c6b75d req-974c08d4-cf93-4497-b2a4-4627df26785f tempest-VolumesSnapshotsTestJSON-897712566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-85432d1b-5e12-4c49-a654-de41eb113d1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-85432d1b-5e12-4c49-a654-de41eb113d1c.729601f8-b648-4de3-abec-716ef6565455 1G" returned: 0 in 1.306s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-40f49e69-6f80-4d62-81d2-5023d6c6b75d req-974c08d4-cf93-4497-b2a4-4627df26785f tempest-VolumesSnapshotsTestJSON-897712566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85432d1b-5e12-4c49-a654-de41eb113d1c -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-85432d1b-5e12-4c49-a654-de41eb113d1c.729601f8-b648-4de3-abec-716ef6565455 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:02 devstack sudo[91260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85432d1b-5e12-4c49-a654-de41eb113d1c -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-85432d1b-5e12-4c49-a654-de41eb113d1c.729601f8-b648-4de3-abec-716ef6565455 Sep 28 14:55:02 devstack sudo[91260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:03 devstack sudo[91260]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-40f49e69-6f80-4d62-81d2-5023d6c6b75d req-974c08d4-cf93-4497-b2a4-4627df26785f tempest-VolumesSnapshotsTestJSON-897712566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85432d1b-5e12-4c49-a654-de41eb113d1c -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-85432d1b-5e12-4c49-a654-de41eb113d1c.729601f8-b648-4de3-abec-716ef6565455" returned: 0 in 1.002s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:03 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [req-40f49e69-6f80-4d62-81d2-5023d6c6b75d req-974c08d4-cf93-4497-b2a4-4627df26785f tempest-VolumesSnapshotsTestJSON-897712566 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-85432d1b-5e12-4c49-a654-de41eb113d1c.729601f8-b648-4de3-abec-716ef6565455 is being set with open permissions: ugo+rw Sep 28 14:55:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-40f49e69-6f80-4d62-81d2-5023d6c6b75d req-974c08d4-cf93-4497-b2a4-4627df26785f tempest-VolumesSnapshotsTestJSON-897712566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-85432d1b-5e12-4c49-a654-de41eb113d1c.729601f8-b648-4de3-abec-716ef6565455 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:04 devstack sudo[91438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-85432d1b-5e12-4c49-a654-de41eb113d1c.729601f8-b648-4de3-abec-716ef6565455 Sep 28 14:55:04 devstack sudo[91438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:04 devstack sudo[91438]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-40f49e69-6f80-4d62-81d2-5023d6c6b75d req-974c08d4-cf93-4497-b2a4-4627df26785f tempest-VolumesSnapshotsTestJSON-897712566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-85432d1b-5e12-4c49-a654-de41eb113d1c.729601f8-b648-4de3-abec-716ef6565455" returned: 0 in 0.659s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-40f49e69-6f80-4d62-81d2-5023d6c6b75d req-974c08d4-cf93-4497-b2a4-4627df26785f tempest-VolumesSnapshotsTestJSON-897712566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-85432d1b-5e12-4c49-a654-de41eb113d1c.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:04 devstack sudo[91452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-85432d1b-5e12-4c49-a654-de41eb113d1c.info Sep 28 14:55:04 devstack sudo[91452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:05 devstack sudo[91452]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-40f49e69-6f80-4d62-81d2-5023d6c6b75d req-974c08d4-cf93-4497-b2a4-4627df26785f tempest-VolumesSnapshotsTestJSON-897712566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-85432d1b-5e12-4c49-a654-de41eb113d1c.info" returned: 0 in 0.517s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:05 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [req-40f49e69-6f80-4d62-81d2-5023d6c6b75d req-974c08d4-cf93-4497-b2a4-4627df26785f tempest-VolumesSnapshotsTestJSON-897712566 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-85432d1b-5e12-4c49-a654-de41eb113d1c.info is being set with open permissions: ugo+rw Sep 28 14:55:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-40f49e69-6f80-4d62-81d2-5023d6c6b75d req-974c08d4-cf93-4497-b2a4-4627df26785f tempest-VolumesSnapshotsTestJSON-897712566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-85432d1b-5e12-4c49-a654-de41eb113d1c.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:05 devstack sudo[91468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-85432d1b-5e12-4c49-a654-de41eb113d1c.info Sep 28 14:55:05 devstack sudo[91468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-9cda7985-a74f-467c-8414-16b03673b457 req-63ba4865-9394-4e9d-af73-ae05df148a63 tempest-TaggedAttachmentsTest-879245329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:55:05 devstack sudo[91468]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-40f49e69-6f80-4d62-81d2-5023d6c6b75d req-974c08d4-cf93-4497-b2a4-4627df26785f tempest-VolumesSnapshotsTestJSON-897712566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-85432d1b-5e12-4c49-a654-de41eb113d1c.info" returned: 0 in 0.458s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-40f49e69-6f80-4d62-81d2-5023d6c6b75d req-974c08d4-cf93-4497-b2a4-4627df26785f tempest-VolumesSnapshotsTestJSON-897712566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.737s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:55:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-9cda7985-a74f-467c-8414-16b03673b457 req-63ba4865-9394-4e9d-af73-ae05df148a63 tempest-TaggedAttachmentsTest-879245329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.151s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:55:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-9cda7985-a74f-467c-8414-16b03673b457 req-63ba4865-9394-4e9d-af73-ae05df148a63 tempest-TaggedAttachmentsTest-879245329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:55:05 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-40f49e69-6f80-4d62-81d2-5023d6c6b75d req-974c08d4-cf93-4497-b2a4-4627df26785f tempest-VolumesSnapshotsTestJSON-897712566 None] Create snapshot completed successfully Sep 28 14:55:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-9cda7985-a74f-467c-8414-16b03673b457 req-63ba4865-9394-4e9d-af73-ae05df148a63 tempest-TaggedAttachmentsTest-879245329 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1', 'name': 'volume-e82f9e8a-469b-44ac-b470-e7b8799d0109', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1a49e09c-1e68-49af-a49c-1fdd73737e21', 'enforce_multipath': True} {{(pid=87116) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 14:55:05 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-9cda7985-a74f-467c-8414-16b03673b457 req-63ba4865-9394-4e9d-af73-ae05df148a63 tempest-TaggedAttachmentsTest-879245329 None] attachment_update completed successfully. Sep 28 14:55:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-a9b094ea-70dc-4d5a-be44-7fc503b43c21 req-b975a2e1-fe95-4cd8-b318-72cd74eb8a9b tempest-VolumesSnapshotsTestJSON-897712566 None] Acquiring lock "cinder-729601f8-b648-4de3-abec-716ef6565455-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:55:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-a9b094ea-70dc-4d5a-be44-7fc503b43c21 req-b975a2e1-fe95-4cd8-b318-72cd74eb8a9b tempest-VolumesSnapshotsTestJSON-897712566 None] Lock "cinder-729601f8-b648-4de3-abec-716ef6565455-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:55:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-a9b094ea-70dc-4d5a-be44-7fc503b43c21 req-b975a2e1-fe95-4cd8-b318-72cd74eb8a9b tempest-VolumesSnapshotsTestJSON-897712566 None] Acquiring lock "cinder-quobyte-85432d1b-5e12-4c49-a654-de41eb113d1c" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:55:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-a9b094ea-70dc-4d5a-be44-7fc503b43c21 req-b975a2e1-fe95-4cd8-b318-72cd74eb8a9b tempest-VolumesSnapshotsTestJSON-897712566 None] Lock "cinder-quobyte-85432d1b-5e12-4c49-a654-de41eb113d1c" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:55:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-a9b094ea-70dc-4d5a-be44-7fc503b43c21 req-b975a2e1-fe95-4cd8-b318-72cd74eb8a9b tempest-VolumesSnapshotsTestJSON-897712566 None] Acquiring lock "cinder-quobyte-729601f8-b648-4de3-abec-716ef6565455" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:55:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-a9b094ea-70dc-4d5a-be44-7fc503b43c21 req-b975a2e1-fe95-4cd8-b318-72cd74eb8a9b tempest-VolumesSnapshotsTestJSON-897712566 None] Lock "cinder-quobyte-729601f8-b648-4de3-abec-716ef6565455" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:55:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [req-a9b094ea-70dc-4d5a-be44-7fc503b43c21 req-b975a2e1-fe95-4cd8-b318-72cd74eb8a9b tempest-VolumesSnapshotsTestJSON-897712566 None] Deleting offline snapshot 729601f8-b648-4de3-abec-716ef6565455 of volume 85432d1b-5e12-4c49-a654-de41eb113d1c {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 14:55:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [req-a9b094ea-70dc-4d5a-be44-7fc503b43c21 req-b975a2e1-fe95-4cd8-b318-72cd74eb8a9b tempest-VolumesSnapshotsTestJSON-897712566 None] snapshot_file for this snap is: volume-85432d1b-5e12-4c49-a654-de41eb113d1c.729601f8-b648-4de3-abec-716ef6565455 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 14:55:06 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[801f282b-0072-4a72-a19c-4d046fff17ea]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:55:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-a9b094ea-70dc-4d5a-be44-7fc503b43c21 req-b975a2e1-fe95-4cd8-b318-72cd74eb8a9b tempest-VolumesSnapshotsTestJSON-897712566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-85432d1b-5e12-4c49-a654-de41eb113d1c.729601f8-b648-4de3-abec-716ef6565455 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:06 devstack sudo[91912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-85432d1b-5e12-4c49-a654-de41eb113d1c.729601f8-b648-4de3-abec-716ef6565455 Sep 28 14:55:06 devstack sudo[91912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:06 devstack sudo[91912]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-a9b094ea-70dc-4d5a-be44-7fc503b43c21 req-b975a2e1-fe95-4cd8-b318-72cd74eb8a9b tempest-VolumesSnapshotsTestJSON-897712566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-85432d1b-5e12-4c49-a654-de41eb113d1c.729601f8-b648-4de3-abec-716ef6565455" returned: 0 in 0.499s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [req-a9b094ea-70dc-4d5a-be44-7fc503b43c21 req-b975a2e1-fe95-4cd8-b318-72cd74eb8a9b tempest-VolumesSnapshotsTestJSON-897712566 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85432d1b-5e12-4c49-a654-de41eb113d1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 14:55:06 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d6578f-8089-4aff-94dc-218d5027265e]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:55:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-a9b094ea-70dc-4d5a-be44-7fc503b43c21 req-b975a2e1-fe95-4cd8-b318-72cd74eb8a9b tempest-VolumesSnapshotsTestJSON-897712566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-85432d1b-5e12-4c49-a654-de41eb113d1c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:07 devstack sudo[91920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-85432d1b-5e12-4c49-a654-de41eb113d1c Sep 28 14:55:07 devstack sudo[91920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:07 devstack sudo[91920]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-a9b094ea-70dc-4d5a-be44-7fc503b43c21 req-b975a2e1-fe95-4cd8-b318-72cd74eb8a9b tempest-VolumesSnapshotsTestJSON-897712566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-85432d1b-5e12-4c49-a654-de41eb113d1c" returned: 0 in 0.596s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-a9b094ea-70dc-4d5a-be44-7fc503b43c21 req-b975a2e1-fe95-4cd8-b318-72cd74eb8a9b tempest-VolumesSnapshotsTestJSON-897712566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-85432d1b-5e12-4c49-a654-de41eb113d1c.729601f8-b648-4de3-abec-716ef6565455 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:07 devstack sudo[91928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-85432d1b-5e12-4c49-a654-de41eb113d1c.729601f8-b648-4de3-abec-716ef6565455 Sep 28 14:55:07 devstack sudo[91928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-a9b094ea-70dc-4d5a-be44-7fc503b43c21 req-b975a2e1-fe95-4cd8-b318-72cd74eb8a9b tempest-VolumesSnapshotsTestJSON-897712566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-85432d1b-5e12-4c49-a654-de41eb113d1c.729601f8-b648-4de3-abec-716ef6565455" returned: 0 in 0.516s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-a9b094ea-70dc-4d5a-be44-7fc503b43c21 req-b975a2e1-fe95-4cd8-b318-72cd74eb8a9b tempest-VolumesSnapshotsTestJSON-897712566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-85432d1b-5e12-4c49-a654-de41eb113d1c.729601f8-b648-4de3-abec-716ef6565455 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:08 devstack sudo[91928]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:08 devstack sudo[91936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-85432d1b-5e12-4c49-a654-de41eb113d1c.729601f8-b648-4de3-abec-716ef6565455 Sep 28 14:55:08 devstack sudo[91936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-a9b094ea-70dc-4d5a-be44-7fc503b43c21 req-b975a2e1-fe95-4cd8-b318-72cd74eb8a9b tempest-VolumesSnapshotsTestJSON-897712566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-85432d1b-5e12-4c49-a654-de41eb113d1c.729601f8-b648-4de3-abec-716ef6565455" returned: 0 in 0.557s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:08 devstack sudo[91936]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:08 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-a9b094ea-70dc-4d5a-be44-7fc503b43c21 req-b975a2e1-fe95-4cd8-b318-72cd74eb8a9b tempest-VolumesSnapshotsTestJSON-897712566 None] Lock "cinder-quobyte-729601f8-b648-4de3-abec-716ef6565455" released by "_delete_snapshot" :: held 2.388s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:55:08 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-a9b094ea-70dc-4d5a-be44-7fc503b43c21 req-b975a2e1-fe95-4cd8-b318-72cd74eb8a9b tempest-VolumesSnapshotsTestJSON-897712566 None] Lock "cinder-quobyte-85432d1b-5e12-4c49-a654-de41eb113d1c" released by "delete_snapshot" :: held 2.418s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:55:08 devstack cinder-volume[87116]: WARNING cinder.quota [req-a9b094ea-70dc-4d5a-be44-7fc503b43c21 req-b975a2e1-fe95-4cd8-b318-72cd74eb8a9b tempest-VolumesSnapshotsTestJSON-897712566 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 14:55:08 devstack cinder-volume[87116]: DEBUG cinder.quota [req-a9b094ea-70dc-4d5a-be44-7fc503b43c21 req-b975a2e1-fe95-4cd8-b318-72cd74eb8a9b tempest-VolumesSnapshotsTestJSON-897712566 None] Created reservations ['70cf9e60-7a2f-49cf-9caa-5638fa67ce0d', '3a6f2375-9a77-4b9d-88f2-db14c1554c9c', '59f0fb5f-00c4-4acc-9e3b-10230d0d2f2b', '01e4d3c4-aa48-4ad0-9051-04979e0ec94e'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 14:55:08 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-a9b094ea-70dc-4d5a-be44-7fc503b43c21 req-b975a2e1-fe95-4cd8-b318-72cd74eb8a9b tempest-VolumesSnapshotsTestJSON-897712566 None] Delete snapshot completed successfully. Sep 28 14:55:08 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-a9b094ea-70dc-4d5a-be44-7fc503b43c21 req-b975a2e1-fe95-4cd8-b318-72cd74eb8a9b tempest-VolumesSnapshotsTestJSON-897712566 None] Lock "cinder-729601f8-b648-4de3-abec-716ef6565455-delete_snapshot" released by "delete_snapshot" :: held 2.689s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:55:09 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-6e726009-a437-4c2b-8d81-1b1c5330e4f3 req-ec7c9e87-3d4e-4d46-9518-cbc116c76a6a tempest-TaggedAttachmentsTest-879245329 None] Terminate volume connection completed successfully. Sep 28 14:55:09 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-6e726009-a437-4c2b-8d81-1b1c5330e4f3 req-ec7c9e87-3d4e-4d46-9518-cbc116c76a6a tempest-TaggedAttachmentsTest-879245329 None] Deleting attachment 1a49e09c-1e68-49af-a49c-1fdd73737e21. {{(pid=87116) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 14:55:09 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-ef096ba4-e025-41c0-aa44-7eab9871138b req-ae2dda31-6fa6-4ed3-8bbf-988c0cc6c407 tempest-VolumesSnapshotsTestJSON-897712566 None] Acquiring lock "cinder-85432d1b-5e12-4c49-a654-de41eb113d1c-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:55:09 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-ef096ba4-e025-41c0-aa44-7eab9871138b req-ae2dda31-6fa6-4ed3-8bbf-988c0cc6c407 tempest-VolumesSnapshotsTestJSON-897712566 None] Lock "cinder-85432d1b-5e12-4c49-a654-de41eb113d1c-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:55:10 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-ef096ba4-e025-41c0-aa44-7eab9871138b req-ae2dda31-6fa6-4ed3-8bbf-988c0cc6c407 tempest-VolumesSnapshotsTestJSON-897712566 None] Acquiring lock "cinder-quobyte-85432d1b-5e12-4c49-a654-de41eb113d1c" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:55:10 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-ef096ba4-e025-41c0-aa44-7eab9871138b req-ae2dda31-6fa6-4ed3-8bbf-988c0cc6c407 tempest-VolumesSnapshotsTestJSON-897712566 None] Lock "cinder-quobyte-85432d1b-5e12-4c49-a654-de41eb113d1c" acquired by "delete_volume" :: waited 0.026s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:55:10 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9006c2-ba86-40e5-bfb0-7fc678b3764e]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:55:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-ef096ba4-e025-41c0-aa44-7eab9871138b req-ae2dda31-6fa6-4ed3-8bbf-988c0cc6c407 tempest-VolumesSnapshotsTestJSON-897712566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-85432d1b-5e12-4c49-a654-de41eb113d1c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:10 devstack sudo[92077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-85432d1b-5e12-4c49-a654-de41eb113d1c Sep 28 14:55:10 devstack sudo[92077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:10 devstack sudo[92077]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-ef096ba4-e025-41c0-aa44-7eab9871138b req-ae2dda31-6fa6-4ed3-8bbf-988c0cc6c407 tempest-VolumesSnapshotsTestJSON-897712566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-85432d1b-5e12-4c49-a654-de41eb113d1c" returned: 0 in 0.440s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-ef096ba4-e025-41c0-aa44-7eab9871138b req-ae2dda31-6fa6-4ed3-8bbf-988c0cc6c407 tempest-VolumesSnapshotsTestJSON-897712566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-85432d1b-5e12-4c49-a654-de41eb113d1c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:10 devstack sudo[92117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-85432d1b-5e12-4c49-a654-de41eb113d1c Sep 28 14:55:10 devstack sudo[92117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:10 devstack sudo[92117]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-ef096ba4-e025-41c0-aa44-7eab9871138b req-ae2dda31-6fa6-4ed3-8bbf-988c0cc6c407 tempest-VolumesSnapshotsTestJSON-897712566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-85432d1b-5e12-4c49-a654-de41eb113d1c" returned: 0 in 0.367s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:11 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-ef096ba4-e025-41c0-aa44-7eab9871138b req-ae2dda31-6fa6-4ed3-8bbf-988c0cc6c407 tempest-VolumesSnapshotsTestJSON-897712566 None] Lock "cinder-quobyte-85432d1b-5e12-4c49-a654-de41eb113d1c" released by "delete_volume" :: held 0.946s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:55:11 devstack cinder-volume[87116]: DEBUG cinder.quota [req-ef096ba4-e025-41c0-aa44-7eab9871138b req-ae2dda31-6fa6-4ed3-8bbf-988c0cc6c407 tempest-VolumesSnapshotsTestJSON-897712566 None] Created reservations ['d31d92de-8e79-436c-a027-f43ca1a30320', 'f14aa833-0f56-4a2b-8161-b00978e0f134', '23b1998f-35fb-41af-bfb0-2c1bacc61df7', 'aa2837ad-6b49-4711-ab80-8dafd7fad19e'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 14:55:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-ef096ba4-e025-41c0-aa44-7eab9871138b req-ae2dda31-6fa6-4ed3-8bbf-988c0cc6c407 tempest-VolumesSnapshotsTestJSON-897712566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:55:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-ef096ba4-e025-41c0-aa44-7eab9871138b req-ae2dda31-6fa6-4ed3-8bbf-988c0cc6c407 tempest-VolumesSnapshotsTestJSON-897712566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:55:11 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [req-ef096ba4-e025-41c0-aa44-7eab9871138b req-ae2dda31-6fa6-4ed3-8bbf-988c0cc6c407 tempest-VolumesSnapshotsTestJSON-897712566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:55:11 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [req-ef096ba4-e025-41c0-aa44-7eab9871138b req-ae2dda31-6fa6-4ed3-8bbf-988c0cc6c407 tempest-VolumesSnapshotsTestJSON-897712566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:55:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-ef096ba4-e025-41c0-aa44-7eab9871138b req-ae2dda31-6fa6-4ed3-8bbf-988c0cc6c407 tempest-VolumesSnapshotsTestJSON-897712566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:55:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-ef096ba4-e025-41c0-aa44-7eab9871138b req-ae2dda31-6fa6-4ed3-8bbf-988c0cc6c407 tempest-VolumesSnapshotsTestJSON-897712566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:11 devstack sudo[92125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 14:55:11 devstack sudo[92125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:12 devstack sudo[92125]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-ef096ba4-e025-41c0-aa44-7eab9871138b req-ae2dda31-6fa6-4ed3-8bbf-988c0cc6c407 tempest-VolumesSnapshotsTestJSON-897712566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.673s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:12 devstack cinder-volume[87116]: DEBUG cinder.manager [req-ef096ba4-e025-41c0-aa44-7eab9871138b req-ae2dda31-6fa6-4ed3-8bbf-988c0cc6c407 tempest-VolumesSnapshotsTestJSON-897712566 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:55:12 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-ef096ba4-e025-41c0-aa44-7eab9871138b req-ae2dda31-6fa6-4ed3-8bbf-988c0cc6c407 tempest-VolumesSnapshotsTestJSON-897712566 None] Deleted volume successfully. Sep 28 14:55:12 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-ef096ba4-e025-41c0-aa44-7eab9871138b req-ae2dda31-6fa6-4ed3-8bbf-988c0cc6c407 tempest-VolumesSnapshotsTestJSON-897712566 None] Lock "cinder-85432d1b-5e12-4c49-a654-de41eb113d1c-delete_volume" released by "delete_volume" :: held 2.158s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:55:16 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:55:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:55:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:55:16 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:55:16 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:55:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:55:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:17 devstack sudo[92151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 14:55:17 devstack sudo[92151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:17 devstack sudo[92151]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.418s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:17 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:55:17 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running periodic task VolumeManager._thread_info {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:55:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] thread count: 8 {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 14:55:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] thread info: [<_MainThread(MainThread, started 135146735652992)>, , , , , , , ] {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 14:55:17 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a1f0b8b-cf21-4bdc-9b2d-56c639ce3fc9 tempest-AttachVolumeTestJSON-1945595936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 14:55:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8a1f0b8b-cf21-4bdc-9b2d-56c639ce3fc9 tempest-AttachVolumeTestJSON-1945595936 None] Flow 'volume_create_manager' (0c7b93df-6d91-45d1-b03d-b46d63d496d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:55:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8a1f0b8b-cf21-4bdc-9b2d-56c639ce3fc9 tempest-AttachVolumeTestJSON-1945595936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b886770-eb74-4d84-9191-68fe06daacf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:55:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8a1f0b8b-cf21-4bdc-9b2d-56c639ce3fc9 tempest-AttachVolumeTestJSON-1945595936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b886770-eb74-4d84-9191-68fe06daacf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:55:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1151876048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e082e12-5880-4ef2-93e3-5842c7e3c3c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='637e9096f3f847ca8ff2afd88c2d060d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:55:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:55:18Z,use_quota=True,user_id='46a45d5880354576bb4e53d961968613',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:55:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8a1f0b8b-cf21-4bdc-9b2d-56c639ce3fc9 tempest-AttachVolumeTestJSON-1945595936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9340191c-5294-4bb8-9620-124cb5b93032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:55:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8a1f0b8b-cf21-4bdc-9b2d-56c639ce3fc9 tempest-AttachVolumeTestJSON-1945595936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9340191c-5294-4bb8-9620-124cb5b93032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:55:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8a1f0b8b-cf21-4bdc-9b2d-56c639ce3fc9 tempest-AttachVolumeTestJSON-1945595936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (747042d4-b209-4762-bc6a-64a58d8b9cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:55:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8a1f0b8b-cf21-4bdc-9b2d-56c639ce3fc9 tempest-AttachVolumeTestJSON-1945595936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (747042d4-b209-4762-bc6a-64a58d8b9cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e082e12-5880-4ef2-93e3-5842c7e3c3c4', 'volume_name': 'volume-7e082e12-5880-4ef2-93e3-5842c7e3c3c4', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:55:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8a1f0b8b-cf21-4bdc-9b2d-56c639ce3fc9 tempest-AttachVolumeTestJSON-1945595936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1c16cb1-7918-4d4e-ab50-7dc06c10cc0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:55:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8a1f0b8b-cf21-4bdc-9b2d-56c639ce3fc9 tempest-AttachVolumeTestJSON-1945595936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1c16cb1-7918-4d4e-ab50-7dc06c10cc0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:55:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8a1f0b8b-cf21-4bdc-9b2d-56c639ce3fc9 tempest-AttachVolumeTestJSON-1945595936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (712482a2-1fb6-469c-b87e-69e4cabf51be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:55:17 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-8a1f0b8b-cf21-4bdc-9b2d-56c639ce3fc9 tempest-AttachVolumeTestJSON-1945595936 None] Volume 7e082e12-5880-4ef2-93e3-5842c7e3c3c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e082e12-5880-4ef2-93e3-5842c7e3c3c4', 'volume_size': 1} Sep 28 14:55:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8a1f0b8b-cf21-4bdc-9b2d-56c639ce3fc9 tempest-AttachVolumeTestJSON-1945595936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:55:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8a1f0b8b-cf21-4bdc-9b2d-56c639ce3fc9 tempest-AttachVolumeTestJSON-1945595936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:55:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8a1f0b8b-cf21-4bdc-9b2d-56c639ce3fc9 tempest-AttachVolumeTestJSON-1945595936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:55:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1151876048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e082e12-5880-4ef2-93e3-5842c7e3c3c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='637e9096f3f847ca8ff2afd88c2d060d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:55:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:55:18Z,use_quota=True,user_id='46a45d5880354576bb4e53d961968613',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 14:55:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-8a1f0b8b-cf21-4bdc-9b2d-56c639ce3fc9 tempest-AttachVolumeTestJSON-1945595936 None] Creating volume 7e082e12-5880-4ef2-93e3-5842c7e3c3c4 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 14:55:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8a1f0b8b-cf21-4bdc-9b2d-56c639ce3fc9 tempest-AttachVolumeTestJSON-1945595936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:55:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8a1f0b8b-cf21-4bdc-9b2d-56c639ce3fc9 tempest-AttachVolumeTestJSON-1945595936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:55:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8a1f0b8b-cf21-4bdc-9b2d-56c639ce3fc9 tempest-AttachVolumeTestJSON-1945595936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:55:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8a1f0b8b-cf21-4bdc-9b2d-56c639ce3fc9 tempest-AttachVolumeTestJSON-1945595936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:55:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8a1f0b8b-cf21-4bdc-9b2d-56c639ce3fc9 tempest-AttachVolumeTestJSON-1945595936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:55:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8a1f0b8b-cf21-4bdc-9b2d-56c639ce3fc9 tempest-AttachVolumeTestJSON-1945595936 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 14:55:17 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-8a1f0b8b-cf21-4bdc-9b2d-56c639ce3fc9 tempest-AttachVolumeTestJSON-1945595936 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 14:55:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8a1f0b8b-cf21-4bdc-9b2d-56c639ce3fc9 tempest-AttachVolumeTestJSON-1945595936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7e082e12-5880-4ef2-93e3-5842c7e3c3c4 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:17 devstack sudo[92161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7e082e12-5880-4ef2-93e3-5842c7e3c3c4 1073741824 Sep 28 14:55:17 devstack sudo[92161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:18 devstack sudo[92161]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8a1f0b8b-cf21-4bdc-9b2d-56c639ce3fc9 tempest-AttachVolumeTestJSON-1945595936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7e082e12-5880-4ef2-93e3-5842c7e3c3c4 1073741824" returned: 0 in 1.023s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8a1f0b8b-cf21-4bdc-9b2d-56c639ce3fc9 tempest-AttachVolumeTestJSON-1945595936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7e082e12-5880-4ef2-93e3-5842c7e3c3c4 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:18 devstack sudo[92186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7e082e12-5880-4ef2-93e3-5842c7e3c3c4 Sep 28 14:55:18 devstack sudo[92186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:19 devstack sudo[92186]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8a1f0b8b-cf21-4bdc-9b2d-56c639ce3fc9 tempest-AttachVolumeTestJSON-1945595936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7e082e12-5880-4ef2-93e3-5842c7e3c3c4" returned: 0 in 0.450s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8a1f0b8b-cf21-4bdc-9b2d-56c639ce3fc9 tempest-AttachVolumeTestJSON-1945595936 None] <== create_volume: return (1575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 14:55:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8a1f0b8b-cf21-4bdc-9b2d-56c639ce3fc9 tempest-AttachVolumeTestJSON-1945595936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.579s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:55:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8a1f0b8b-cf21-4bdc-9b2d-56c639ce3fc9 tempest-AttachVolumeTestJSON-1945595936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (712482a2-1fb6-469c-b87e-69e4cabf51be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e082e12-5880-4ef2-93e3-5842c7e3c3c4', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:55:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8a1f0b8b-cf21-4bdc-9b2d-56c639ce3fc9 tempest-AttachVolumeTestJSON-1945595936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6522a51-4640-4660-b4fe-29eba67c1a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:55:19 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-8a1f0b8b-cf21-4bdc-9b2d-56c639ce3fc9 tempest-AttachVolumeTestJSON-1945595936 None] Volume volume-7e082e12-5880-4ef2-93e3-5842c7e3c3c4 (7e082e12-5880-4ef2-93e3-5842c7e3c3c4): created successfully Sep 28 14:55:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8a1f0b8b-cf21-4bdc-9b2d-56c639ce3fc9 tempest-AttachVolumeTestJSON-1945595936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6522a51-4640-4660-b4fe-29eba67c1a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:55:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8a1f0b8b-cf21-4bdc-9b2d-56c639ce3fc9 tempest-AttachVolumeTestJSON-1945595936 None] Flow 'volume_create_manager' (0c7b93df-6d91-45d1-b03d-b46d63d496d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:55:19 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-8a1f0b8b-cf21-4bdc-9b2d-56c639ce3fc9 tempest-AttachVolumeTestJSON-1945595936 None] Created volume successfully. Sep 28 14:55:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-315fb2e2-4ff1-4b08-a665-a655b1115877 req-2c4caa2d-5cc4-4556-8e8c-ba2c4107ad79 tempest-AttachVolumeTestJSON-1945595936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:55:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-315fb2e2-4ff1-4b08-a665-a655b1115877 req-2c4caa2d-5cc4-4556-8e8c-ba2c4107ad79 tempest-AttachVolumeTestJSON-1945595936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:55:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-315fb2e2-4ff1-4b08-a665-a655b1115877 req-2c4caa2d-5cc4-4556-8e8c-ba2c4107ad79 tempest-AttachVolumeTestJSON-1945595936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:55:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-315fb2e2-4ff1-4b08-a665-a655b1115877 req-2c4caa2d-5cc4-4556-8e8c-ba2c4107ad79 tempest-AttachVolumeTestJSON-1945595936 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1', 'name': 'volume-7e082e12-5880-4ef2-93e3-5842c7e3c3c4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6f8cbde9-162b-4e4e-8c6e-a1ccab9d1e47', 'enforce_multipath': True} {{(pid=87116) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 14:55:21 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-315fb2e2-4ff1-4b08-a665-a655b1115877 req-2c4caa2d-5cc4-4556-8e8c-ba2c4107ad79 tempest-AttachVolumeTestJSON-1945595936 None] attachment_update completed successfully. Sep 28 14:55:24 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a7c8d5e-1634-474b-94ce-2f7f071fcd16 tempest-AttachVolumeTestJSON-1945595936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 14:55:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0a7c8d5e-1634-474b-94ce-2f7f071fcd16 tempest-AttachVolumeTestJSON-1945595936 None] Flow 'volume_create_manager' (f6d43a19-c841-41b2-ac5f-3b30d4d4258c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:55:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0a7c8d5e-1634-474b-94ce-2f7f071fcd16 tempest-AttachVolumeTestJSON-1945595936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33f11746-cf23-4096-ac09-95dabacf9408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:55:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0a7c8d5e-1634-474b-94ce-2f7f071fcd16 tempest-AttachVolumeTestJSON-1945595936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33f11746-cf23-4096-ac09-95dabacf9408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1644890263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3c7763c-2a0f-4d3d-abc5-265f40c78905,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='637e9096f3f847ca8ff2afd88c2d060d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:55:24Z,use_quota=True,user_id='46a45d5880354576bb4e53d961968613',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:55:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0a7c8d5e-1634-474b-94ce-2f7f071fcd16 tempest-AttachVolumeTestJSON-1945595936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00e809b8-f49d-40be-908f-b4e5f48d19ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:55:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0a7c8d5e-1634-474b-94ce-2f7f071fcd16 tempest-AttachVolumeTestJSON-1945595936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00e809b8-f49d-40be-908f-b4e5f48d19ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:55:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0a7c8d5e-1634-474b-94ce-2f7f071fcd16 tempest-AttachVolumeTestJSON-1945595936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d35f078-8083-47f6-a692-727140df17d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:55:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0a7c8d5e-1634-474b-94ce-2f7f071fcd16 tempest-AttachVolumeTestJSON-1945595936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d35f078-8083-47f6-a692-727140df17d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3c7763c-2a0f-4d3d-abc5-265f40c78905', 'volume_name': 'volume-b3c7763c-2a0f-4d3d-abc5-265f40c78905', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:55:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0a7c8d5e-1634-474b-94ce-2f7f071fcd16 tempest-AttachVolumeTestJSON-1945595936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc2bf8ff-8736-4878-b0e9-3020bb5f663a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:55:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0a7c8d5e-1634-474b-94ce-2f7f071fcd16 tempest-AttachVolumeTestJSON-1945595936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc2bf8ff-8736-4878-b0e9-3020bb5f663a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:55:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0a7c8d5e-1634-474b-94ce-2f7f071fcd16 tempest-AttachVolumeTestJSON-1945595936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1af67b75-9ca1-447f-92a4-f3397a3d6cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:55:24 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-0a7c8d5e-1634-474b-94ce-2f7f071fcd16 tempest-AttachVolumeTestJSON-1945595936 None] Volume b3c7763c-2a0f-4d3d-abc5-265f40c78905: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3c7763c-2a0f-4d3d-abc5-265f40c78905', 'volume_size': 1} Sep 28 14:55:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0a7c8d5e-1634-474b-94ce-2f7f071fcd16 tempest-AttachVolumeTestJSON-1945595936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:55:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0a7c8d5e-1634-474b-94ce-2f7f071fcd16 tempest-AttachVolumeTestJSON-1945595936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:55:24 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0a7c8d5e-1634-474b-94ce-2f7f071fcd16 tempest-AttachVolumeTestJSON-1945595936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1644890263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3c7763c-2a0f-4d3d-abc5-265f40c78905,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='637e9096f3f847ca8ff2afd88c2d060d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:55:24Z,use_quota=True,user_id='46a45d5880354576bb4e53d961968613',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 14:55:24 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-0a7c8d5e-1634-474b-94ce-2f7f071fcd16 tempest-AttachVolumeTestJSON-1945595936 None] Creating volume b3c7763c-2a0f-4d3d-abc5-265f40c78905 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 14:55:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0a7c8d5e-1634-474b-94ce-2f7f071fcd16 tempest-AttachVolumeTestJSON-1945595936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:55:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0a7c8d5e-1634-474b-94ce-2f7f071fcd16 tempest-AttachVolumeTestJSON-1945595936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:55:24 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0a7c8d5e-1634-474b-94ce-2f7f071fcd16 tempest-AttachVolumeTestJSON-1945595936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:55:24 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0a7c8d5e-1634-474b-94ce-2f7f071fcd16 tempest-AttachVolumeTestJSON-1945595936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:55:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0a7c8d5e-1634-474b-94ce-2f7f071fcd16 tempest-AttachVolumeTestJSON-1945595936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:55:24 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0a7c8d5e-1634-474b-94ce-2f7f071fcd16 tempest-AttachVolumeTestJSON-1945595936 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 14:55:24 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-0a7c8d5e-1634-474b-94ce-2f7f071fcd16 tempest-AttachVolumeTestJSON-1945595936 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 14:55:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0a7c8d5e-1634-474b-94ce-2f7f071fcd16 tempest-AttachVolumeTestJSON-1945595936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b3c7763c-2a0f-4d3d-abc5-265f40c78905 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:24 devstack sudo[92660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b3c7763c-2a0f-4d3d-abc5-265f40c78905 1073741824 Sep 28 14:55:24 devstack sudo[92660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:24 devstack sudo[92660]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0a7c8d5e-1634-474b-94ce-2f7f071fcd16 tempest-AttachVolumeTestJSON-1945595936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b3c7763c-2a0f-4d3d-abc5-265f40c78905 1073741824" returned: 0 in 0.728s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0a7c8d5e-1634-474b-94ce-2f7f071fcd16 tempest-AttachVolumeTestJSON-1945595936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b3c7763c-2a0f-4d3d-abc5-265f40c78905 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:25 devstack sudo[92687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b3c7763c-2a0f-4d3d-abc5-265f40c78905 Sep 28 14:55:25 devstack sudo[92687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:25 devstack sudo[92687]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0a7c8d5e-1634-474b-94ce-2f7f071fcd16 tempest-AttachVolumeTestJSON-1945595936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b3c7763c-2a0f-4d3d-abc5-265f40c78905" returned: 0 in 0.377s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:25 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0a7c8d5e-1634-474b-94ce-2f7f071fcd16 tempest-AttachVolumeTestJSON-1945595936 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 14:55:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0a7c8d5e-1634-474b-94ce-2f7f071fcd16 tempest-AttachVolumeTestJSON-1945595936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:55:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0a7c8d5e-1634-474b-94ce-2f7f071fcd16 tempest-AttachVolumeTestJSON-1945595936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1af67b75-9ca1-447f-92a4-f3397a3d6cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3c7763c-2a0f-4d3d-abc5-265f40c78905', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:55:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0a7c8d5e-1634-474b-94ce-2f7f071fcd16 tempest-AttachVolumeTestJSON-1945595936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26660c3a-34b7-420b-a3e7-e77180e161aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:55:25 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-0a7c8d5e-1634-474b-94ce-2f7f071fcd16 tempest-AttachVolumeTestJSON-1945595936 None] Volume volume-b3c7763c-2a0f-4d3d-abc5-265f40c78905 (b3c7763c-2a0f-4d3d-abc5-265f40c78905): created successfully Sep 28 14:55:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0a7c8d5e-1634-474b-94ce-2f7f071fcd16 tempest-AttachVolumeTestJSON-1945595936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26660c3a-34b7-420b-a3e7-e77180e161aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:55:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0a7c8d5e-1634-474b-94ce-2f7f071fcd16 tempest-AttachVolumeTestJSON-1945595936 None] Flow 'volume_create_manager' (f6d43a19-c841-41b2-ac5f-3b30d4d4258c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:55:25 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-0a7c8d5e-1634-474b-94ce-2f7f071fcd16 tempest-AttachVolumeTestJSON-1945595936 None] Created volume successfully. Sep 28 14:55:25 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-497e36ab-b2f1-4ad5-a8c0-765d843f337c tempest-TaggedAttachmentsTest-879245329 None] Acquiring lock "cinder-e82f9e8a-469b-44ac-b470-e7b8799d0109-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:55:25 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-497e36ab-b2f1-4ad5-a8c0-765d843f337c tempest-TaggedAttachmentsTest-879245329 None] Lock "cinder-e82f9e8a-469b-44ac-b470-e7b8799d0109-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:55:25 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-497e36ab-b2f1-4ad5-a8c0-765d843f337c tempest-TaggedAttachmentsTest-879245329 None] Acquiring lock "cinder-quobyte-e82f9e8a-469b-44ac-b470-e7b8799d0109" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:55:25 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-497e36ab-b2f1-4ad5-a8c0-765d843f337c tempest-TaggedAttachmentsTest-879245329 None] Lock "cinder-quobyte-e82f9e8a-469b-44ac-b470-e7b8799d0109" acquired by "delete_volume" :: waited 0.015s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:55:25 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9fd22e4-f08e-4d43-81b9-cfad4f579af6]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:55:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-497e36ab-b2f1-4ad5-a8c0-765d843f337c tempest-TaggedAttachmentsTest-879245329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e82f9e8a-469b-44ac-b470-e7b8799d0109 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:26 devstack sudo[92691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e82f9e8a-469b-44ac-b470-e7b8799d0109 Sep 28 14:55:26 devstack sudo[92691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:26 devstack sudo[92691]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-497e36ab-b2f1-4ad5-a8c0-765d843f337c tempest-TaggedAttachmentsTest-879245329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e82f9e8a-469b-44ac-b470-e7b8799d0109" returned: 0 in 0.445s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-497e36ab-b2f1-4ad5-a8c0-765d843f337c tempest-TaggedAttachmentsTest-879245329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e82f9e8a-469b-44ac-b470-e7b8799d0109 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:26 devstack sudo[92700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e82f9e8a-469b-44ac-b470-e7b8799d0109 Sep 28 14:55:26 devstack sudo[92700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:26 devstack sudo[92700]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-497e36ab-b2f1-4ad5-a8c0-765d843f337c tempest-TaggedAttachmentsTest-879245329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e82f9e8a-469b-44ac-b470-e7b8799d0109" returned: 0 in 0.341s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-497e36ab-b2f1-4ad5-a8c0-765d843f337c tempest-TaggedAttachmentsTest-879245329 None] Lock "cinder-quobyte-e82f9e8a-469b-44ac-b470-e7b8799d0109" released by "delete_volume" :: held 0.845s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:55:26 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-497e36ab-b2f1-4ad5-a8c0-765d843f337c tempest-TaggedAttachmentsTest-879245329 None] Created reservations ['9a9fffab-ca7f-4c4f-b475-10431e389d39', '6aec275c-d4c6-4779-8953-8311dd7686cc', 'caa2df42-142a-463a-920b-39ec930bc99b', '30d1fa8d-a711-4303-85df-c75064a6f917'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 14:55:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-497e36ab-b2f1-4ad5-a8c0-765d843f337c tempest-TaggedAttachmentsTest-879245329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:55:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-497e36ab-b2f1-4ad5-a8c0-765d843f337c tempest-TaggedAttachmentsTest-879245329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:55:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-497e36ab-b2f1-4ad5-a8c0-765d843f337c tempest-TaggedAttachmentsTest-879245329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:55:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-497e36ab-b2f1-4ad5-a8c0-765d843f337c tempest-TaggedAttachmentsTest-879245329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:55:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-497e36ab-b2f1-4ad5-a8c0-765d843f337c tempest-TaggedAttachmentsTest-879245329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:55:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-497e36ab-b2f1-4ad5-a8c0-765d843f337c tempest-TaggedAttachmentsTest-879245329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:26 devstack sudo[92712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 14:55:26 devstack sudo[92712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-c28834d7-21a9-4ca8-bfec-722f0c843f81 req-07b7d642-373d-45d0-8ef2-a246fc39cee5 tempest-AttachVolumeTestJSON-1945595936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:55:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-c28834d7-21a9-4ca8-bfec-722f0c843f81 req-07b7d642-373d-45d0-8ef2-a246fc39cee5 tempest-AttachVolumeTestJSON-1945595936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:55:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-c28834d7-21a9-4ca8-bfec-722f0c843f81 req-07b7d642-373d-45d0-8ef2-a246fc39cee5 tempest-AttachVolumeTestJSON-1945595936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:55:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-c28834d7-21a9-4ca8-bfec-722f0c843f81 req-07b7d642-373d-45d0-8ef2-a246fc39cee5 tempest-AttachVolumeTestJSON-1945595936 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1', 'name': 'volume-b3c7763c-2a0f-4d3d-abc5-265f40c78905', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f0de4c37-c397-47cc-920e-b8fd88f7f5ed', 'enforce_multipath': True} {{(pid=87116) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 14:55:27 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-c28834d7-21a9-4ca8-bfec-722f0c843f81 req-07b7d642-373d-45d0-8ef2-a246fc39cee5 tempest-AttachVolumeTestJSON-1945595936 None] attachment_update completed successfully. Sep 28 14:55:27 devstack sudo[92712]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-497e36ab-b2f1-4ad5-a8c0-765d843f337c tempest-TaggedAttachmentsTest-879245329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.308s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:27 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-497e36ab-b2f1-4ad5-a8c0-765d843f337c tempest-TaggedAttachmentsTest-879245329 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:55:27 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-497e36ab-b2f1-4ad5-a8c0-765d843f337c tempest-TaggedAttachmentsTest-879245329 None] Deleted volume successfully. Sep 28 14:55:27 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-497e36ab-b2f1-4ad5-a8c0-765d843f337c tempest-TaggedAttachmentsTest-879245329 None] Lock "cinder-e82f9e8a-469b-44ac-b470-e7b8799d0109-delete_volume" released by "delete_volume" :: held 1.418s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:55:27 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-fcd3122c-bf55-4715-9a04-e222792c7f2d tempest-GroupSnapshotsTest-752462418 None] Group tempest-GroupSnapshotsTest-Group-1370104085: creating Sep 28 14:55:27 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-fcd3122c-bf55-4715-9a04-e222792c7f2d tempest-GroupSnapshotsTest-752462418 None] Group tempest-GroupSnapshotsTest-Group-1370104085: created successfully Sep 28 14:55:27 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-fcd3122c-bf55-4715-9a04-e222792c7f2d tempest-GroupSnapshotsTest-752462418 None] Create group completed successfully. Sep 28 14:55:29 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bf1074b-76eb-4594-86af-cd5db339bbd2 tempest-GroupSnapshotsTest-752462418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 14:55:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6bf1074b-76eb-4594-86af-cd5db339bbd2 tempest-GroupSnapshotsTest-752462418 None] Flow 'volume_create_manager' (085f4cf1-7756-4364-b07c-cf23d751c9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:55:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6bf1074b-76eb-4594-86af-cd5db339bbd2 tempest-GroupSnapshotsTest-752462418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87f7ed7b-ee05-40f2-b851-3f85efa88050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:55:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6bf1074b-76eb-4594-86af-cd5db339bbd2 tempest-GroupSnapshotsTest-752462418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87f7ed7b-ee05-40f2-b851-3f85efa88050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:55:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1463146696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=89f1aba1-c15a-47eb-99d6-58ee5c3ec8a2,host='devstack@QuobyteHD#QuobyteHD',id=16169f94-75d8-4f3f-b5ee-f2316b978c07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b8305889c98447e947915146fef1e27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:55:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:55:29Z,use_quota=True,user_id='5d4257ffa32f41c7b7429885fdcbf312',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(271573de-7d47-4cd6-a0b0-1bfc7ae8ada7),volume_type_id=271573de-7d47-4cd6-a0b0-1bfc7ae8ada7)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:55:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6bf1074b-76eb-4594-86af-cd5db339bbd2 tempest-GroupSnapshotsTest-752462418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c90fb861-112c-4db9-9d33-2e2de24c2c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:55:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6bf1074b-76eb-4594-86af-cd5db339bbd2 tempest-GroupSnapshotsTest-752462418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c90fb861-112c-4db9-9d33-2e2de24c2c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:55:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6bf1074b-76eb-4594-86af-cd5db339bbd2 tempest-GroupSnapshotsTest-752462418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc3ff979-6d27-4310-8e5f-cc1aa00b3fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:55:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6bf1074b-76eb-4594-86af-cd5db339bbd2 tempest-GroupSnapshotsTest-752462418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc3ff979-6d27-4310-8e5f-cc1aa00b3fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16169f94-75d8-4f3f-b5ee-f2316b978c07', 'volume_name': 'volume-16169f94-75d8-4f3f-b5ee-f2316b978c07', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:55:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6bf1074b-76eb-4594-86af-cd5db339bbd2 tempest-GroupSnapshotsTest-752462418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c14073f9-eb40-4756-b2a5-a2225fb688c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:55:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6bf1074b-76eb-4594-86af-cd5db339bbd2 tempest-GroupSnapshotsTest-752462418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c14073f9-eb40-4756-b2a5-a2225fb688c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:55:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6bf1074b-76eb-4594-86af-cd5db339bbd2 tempest-GroupSnapshotsTest-752462418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52e7dfa2-1a4f-4deb-ba91-541cdd98bc2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:55:29 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-6bf1074b-76eb-4594-86af-cd5db339bbd2 tempest-GroupSnapshotsTest-752462418 None] Volume 16169f94-75d8-4f3f-b5ee-f2316b978c07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16169f94-75d8-4f3f-b5ee-f2316b978c07', 'volume_size': 1} Sep 28 14:55:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6bf1074b-76eb-4594-86af-cd5db339bbd2 tempest-GroupSnapshotsTest-752462418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:55:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6bf1074b-76eb-4594-86af-cd5db339bbd2 tempest-GroupSnapshotsTest-752462418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:55:29 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-6bf1074b-76eb-4594-86af-cd5db339bbd2 tempest-GroupSnapshotsTest-752462418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=89f1aba1-c15a-47eb-99d6-58ee5c3ec8a2,created_at=2026-09-28T12:55:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1463146696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=89f1aba1-c15a-47eb-99d6-58ee5c3ec8a2,host='devstack@QuobyteHD#QuobyteHD',id=16169f94-75d8-4f3f-b5ee-f2316b978c07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b8305889c98447e947915146fef1e27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:55:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:55:29Z,use_quota=True,user_id='5d4257ffa32f41c7b7429885fdcbf312',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(271573de-7d47-4cd6-a0b0-1bfc7ae8ada7),volume_type_id=271573de-7d47-4cd6-a0b0-1bfc7ae8ada7)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 14:55:29 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-6bf1074b-76eb-4594-86af-cd5db339bbd2 tempest-GroupSnapshotsTest-752462418 None] Creating volume 16169f94-75d8-4f3f-b5ee-f2316b978c07 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 14:55:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6bf1074b-76eb-4594-86af-cd5db339bbd2 tempest-GroupSnapshotsTest-752462418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:55:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6bf1074b-76eb-4594-86af-cd5db339bbd2 tempest-GroupSnapshotsTest-752462418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:55:29 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-6bf1074b-76eb-4594-86af-cd5db339bbd2 tempest-GroupSnapshotsTest-752462418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:55:29 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-6bf1074b-76eb-4594-86af-cd5db339bbd2 tempest-GroupSnapshotsTest-752462418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:55:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6bf1074b-76eb-4594-86af-cd5db339bbd2 tempest-GroupSnapshotsTest-752462418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:55:29 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-6bf1074b-76eb-4594-86af-cd5db339bbd2 tempest-GroupSnapshotsTest-752462418 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 14:55:29 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-6bf1074b-76eb-4594-86af-cd5db339bbd2 tempest-GroupSnapshotsTest-752462418 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 14:55:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6bf1074b-76eb-4594-86af-cd5db339bbd2 tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-16169f94-75d8-4f3f-b5ee-f2316b978c07 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:29 devstack sudo[92724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-16169f94-75d8-4f3f-b5ee-f2316b978c07 1073741824 Sep 28 14:55:29 devstack sudo[92724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:30 devstack sudo[92724]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6bf1074b-76eb-4594-86af-cd5db339bbd2 tempest-GroupSnapshotsTest-752462418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-16169f94-75d8-4f3f-b5ee-f2316b978c07 1073741824" returned: 0 in 0.555s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6bf1074b-76eb-4594-86af-cd5db339bbd2 tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-16169f94-75d8-4f3f-b5ee-f2316b978c07 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:30 devstack sudo[92735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-16169f94-75d8-4f3f-b5ee-f2316b978c07 Sep 28 14:55:30 devstack sudo[92735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:30 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-a30a17a9-3142-46ca-9e0b-323a77f3e818 req-cb12e5f8-420f-4130-a14b-d9342d07d030 tempest-AttachVolumeTestJSON-1945595936 None] Terminate volume connection completed successfully. Sep 28 14:55:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-a30a17a9-3142-46ca-9e0b-323a77f3e818 req-cb12e5f8-420f-4130-a14b-d9342d07d030 tempest-AttachVolumeTestJSON-1945595936 None] Deleting attachment 6f8cbde9-162b-4e4e-8c6e-a1ccab9d1e47. {{(pid=87116) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 14:55:30 devstack sudo[92735]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6bf1074b-76eb-4594-86af-cd5db339bbd2 tempest-GroupSnapshotsTest-752462418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-16169f94-75d8-4f3f-b5ee-f2316b978c07" returned: 0 in 0.251s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-6bf1074b-76eb-4594-86af-cd5db339bbd2 tempest-GroupSnapshotsTest-752462418 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 14:55:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6bf1074b-76eb-4594-86af-cd5db339bbd2 tempest-GroupSnapshotsTest-752462418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:55:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6bf1074b-76eb-4594-86af-cd5db339bbd2 tempest-GroupSnapshotsTest-752462418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52e7dfa2-1a4f-4deb-ba91-541cdd98bc2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16169f94-75d8-4f3f-b5ee-f2316b978c07', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:55:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6bf1074b-76eb-4594-86af-cd5db339bbd2 tempest-GroupSnapshotsTest-752462418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea69afa0-024d-40c2-a7d8-34948d6c7048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:55:30 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-6bf1074b-76eb-4594-86af-cd5db339bbd2 tempest-GroupSnapshotsTest-752462418 None] Volume volume-16169f94-75d8-4f3f-b5ee-f2316b978c07 (16169f94-75d8-4f3f-b5ee-f2316b978c07): created successfully Sep 28 14:55:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6bf1074b-76eb-4594-86af-cd5db339bbd2 tempest-GroupSnapshotsTest-752462418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea69afa0-024d-40c2-a7d8-34948d6c7048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:55:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6bf1074b-76eb-4594-86af-cd5db339bbd2 tempest-GroupSnapshotsTest-752462418 None] Flow 'volume_create_manager' (085f4cf1-7756-4364-b07c-cf23d751c9ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:55:30 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-6bf1074b-76eb-4594-86af-cd5db339bbd2 tempest-GroupSnapshotsTest-752462418 None] Created volume successfully. Sep 28 14:55:30 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-bf4666f2-91bc-4bf2-99f9-e5d9a0dfbf2f tempest-GroupSnapshotsTest-752462418 None] GroupSnapshot 489b776b-fd6d-4ff3-8d16-b159cef7cf46: creating. Sep 28 14:55:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bf4666f2-91bc-4bf2-99f9-e5d9a0dfbf2f tempest-GroupSnapshotsTest-752462418 None] Group snapshot 489b776b-fd6d-4ff3-8d16-b159cef7cf46: creating. {{(pid=87116) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 14:55:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bf4666f2-91bc-4bf2-99f9-e5d9a0dfbf2f tempest-GroupSnapshotsTest-752462418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:55:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bf4666f2-91bc-4bf2-99f9-e5d9a0dfbf2f tempest-GroupSnapshotsTest-752462418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:55:31 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-bf4666f2-91bc-4bf2-99f9-e5d9a0dfbf2f tempest-GroupSnapshotsTest-752462418 None] Creating offline snapshot 6fff0ced-7281-4d50-81be-77b661d399a0 of volume 16169f94-75d8-4f3f-b5ee-f2316b978c07 {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 14:55:31 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d78435-fcb5-4cd0-9642-754ec36aa462]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:55:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bf4666f2-91bc-4bf2-99f9-e5d9a0dfbf2f tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-16169f94-75d8-4f3f-b5ee-f2316b978c07 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:31 devstack sudo[92741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-16169f94-75d8-4f3f-b5ee-f2316b978c07 Sep 28 14:55:31 devstack sudo[92741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:31 devstack sudo[92741]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bf4666f2-91bc-4bf2-99f9-e5d9a0dfbf2f tempest-GroupSnapshotsTest-752462418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-16169f94-75d8-4f3f-b5ee-f2316b978c07" returned: 0 in 0.422s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bf4666f2-91bc-4bf2-99f9-e5d9a0dfbf2f tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-16169f94-75d8-4f3f-b5ee-f2316b978c07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-16169f94-75d8-4f3f-b5ee-f2316b978c07.6fff0ced-7281-4d50-81be-77b661d399a0 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:31 devstack sudo[92754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-16169f94-75d8-4f3f-b5ee-f2316b978c07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-16169f94-75d8-4f3f-b5ee-f2316b978c07.6fff0ced-7281-4d50-81be-77b661d399a0 1G Sep 28 14:55:31 devstack sudo[92754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:31 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-d71ba9d6-76c5-48e4-a298-fe8dbc44c349 req-35d24de6-dd7e-4757-9c77-01be6c613c72 tempest-AttachVolumeTestJSON-1945595936 None] Terminate volume connection completed successfully. Sep 28 14:55:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-d71ba9d6-76c5-48e4-a298-fe8dbc44c349 req-35d24de6-dd7e-4757-9c77-01be6c613c72 tempest-AttachVolumeTestJSON-1945595936 None] Deleting attachment f0de4c37-c397-47cc-920e-b8fd88f7f5ed. {{(pid=87116) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 14:55:32 devstack sudo[92754]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bf4666f2-91bc-4bf2-99f9-e5d9a0dfbf2f tempest-GroupSnapshotsTest-752462418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-16169f94-75d8-4f3f-b5ee-f2316b978c07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-16169f94-75d8-4f3f-b5ee-f2316b978c07.6fff0ced-7281-4d50-81be-77b661d399a0 1G" returned: 0 in 0.554s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bf4666f2-91bc-4bf2-99f9-e5d9a0dfbf2f tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16169f94-75d8-4f3f-b5ee-f2316b978c07 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-16169f94-75d8-4f3f-b5ee-f2316b978c07.6fff0ced-7281-4d50-81be-77b661d399a0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:32 devstack sudo[92790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16169f94-75d8-4f3f-b5ee-f2316b978c07 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-16169f94-75d8-4f3f-b5ee-f2316b978c07.6fff0ced-7281-4d50-81be-77b661d399a0 Sep 28 14:55:32 devstack sudo[92790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:32 devstack sudo[92790]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bf4666f2-91bc-4bf2-99f9-e5d9a0dfbf2f tempest-GroupSnapshotsTest-752462418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16169f94-75d8-4f3f-b5ee-f2316b978c07 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-16169f94-75d8-4f3f-b5ee-f2316b978c07.6fff0ced-7281-4d50-81be-77b661d399a0" returned: 0 in 0.339s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:32 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-bf4666f2-91bc-4bf2-99f9-e5d9a0dfbf2f tempest-GroupSnapshotsTest-752462418 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-16169f94-75d8-4f3f-b5ee-f2316b978c07.6fff0ced-7281-4d50-81be-77b661d399a0 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 14:55:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bf4666f2-91bc-4bf2-99f9-e5d9a0dfbf2f tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-16169f94-75d8-4f3f-b5ee-f2316b978c07.6fff0ced-7281-4d50-81be-77b661d399a0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:32 devstack sudo[92795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-16169f94-75d8-4f3f-b5ee-f2316b978c07.6fff0ced-7281-4d50-81be-77b661d399a0 Sep 28 14:55:32 devstack sudo[92795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:32 devstack sudo[92795]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bf4666f2-91bc-4bf2-99f9-e5d9a0dfbf2f tempest-GroupSnapshotsTest-752462418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-16169f94-75d8-4f3f-b5ee-f2316b978c07.6fff0ced-7281-4d50-81be-77b661d399a0" returned: 0 in 0.328s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bf4666f2-91bc-4bf2-99f9-e5d9a0dfbf2f tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-16169f94-75d8-4f3f-b5ee-f2316b978c07.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:32 devstack sudo[92798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-16169f94-75d8-4f3f-b5ee-f2316b978c07.info Sep 28 14:55:32 devstack sudo[92798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:33 devstack sudo[92798]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bf4666f2-91bc-4bf2-99f9-e5d9a0dfbf2f tempest-GroupSnapshotsTest-752462418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-16169f94-75d8-4f3f-b5ee-f2316b978c07.info" returned: 0 in 0.408s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:33 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-bf4666f2-91bc-4bf2-99f9-e5d9a0dfbf2f tempest-GroupSnapshotsTest-752462418 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-16169f94-75d8-4f3f-b5ee-f2316b978c07.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 14:55:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bf4666f2-91bc-4bf2-99f9-e5d9a0dfbf2f tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-16169f94-75d8-4f3f-b5ee-f2316b978c07.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:33 devstack sudo[92802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-16169f94-75d8-4f3f-b5ee-f2316b978c07.info Sep 28 14:55:33 devstack sudo[92802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:33 devstack sudo[92802]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bf4666f2-91bc-4bf2-99f9-e5d9a0dfbf2f tempest-GroupSnapshotsTest-752462418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-16169f94-75d8-4f3f-b5ee-f2316b978c07.info" returned: 0 in 0.360s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bf4666f2-91bc-4bf2-99f9-e5d9a0dfbf2f tempest-GroupSnapshotsTest-752462418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.529s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:55:33 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-bf4666f2-91bc-4bf2-99f9-e5d9a0dfbf2f tempest-GroupSnapshotsTest-752462418 None] group_snapshot 489b776b-fd6d-4ff3-8d16-b159cef7cf46: created successfully Sep 28 14:55:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4552784e-47b4-4084-8ead-4f28800a2a4f tempest-GroupSnapshotsTest-752462418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:55:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4552784e-47b4-4084-8ead-4f28800a2a4f tempest-GroupSnapshotsTest-752462418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:55:35 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4552784e-47b4-4084-8ead-4f28800a2a4f tempest-GroupSnapshotsTest-752462418 None] Acquiring lock "cinder-quobyte-6fff0ced-7281-4d50-81be-77b661d399a0-0ea95d0b-429a-440d-82e0-058451c103ba" by "_create_volume_from_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:55:35 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4552784e-47b4-4084-8ead-4f28800a2a4f tempest-GroupSnapshotsTest-752462418 None] Lock "cinder-quobyte-6fff0ced-7281-4d50-81be-77b661d399a0-0ea95d0b-429a-440d-82e0-058451c103ba" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:55:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4552784e-47b4-4084-8ead-4f28800a2a4f tempest-GroupSnapshotsTest-752462418 None] Creating volume 0ea95d0b-429a-440d-82e0-058451c103ba from snapshot 6fff0ced-7281-4d50-81be-77b661d399a0 {{(pid=87116) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 14:55:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4552784e-47b4-4084-8ead-4f28800a2a4f tempest-GroupSnapshotsTest-752462418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:55:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4552784e-47b4-4084-8ead-4f28800a2a4f tempest-GroupSnapshotsTest-752462418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:55:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4552784e-47b4-4084-8ead-4f28800a2a4f tempest-GroupSnapshotsTest-752462418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:55:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4552784e-47b4-4084-8ead-4f28800a2a4f tempest-GroupSnapshotsTest-752462418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:55:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4552784e-47b4-4084-8ead-4f28800a2a4f tempest-GroupSnapshotsTest-752462418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:55:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4552784e-47b4-4084-8ead-4f28800a2a4f tempest-GroupSnapshotsTest-752462418 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 14:55:35 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4552784e-47b4-4084-8ead-4f28800a2a4f tempest-GroupSnapshotsTest-752462418 None] Acquiring lock "cinder-quobyte-0ea95d0b-429a-440d-82e0-058451c103ba" by "_copy_volume_from_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:55:35 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4552784e-47b4-4084-8ead-4f28800a2a4f tempest-GroupSnapshotsTest-752462418 None] Lock "cinder-quobyte-0ea95d0b-429a-440d-82e0-058451c103ba" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:55:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4552784e-47b4-4084-8ead-4f28800a2a4f tempest-GroupSnapshotsTest-752462418 None] snapshot: 6fff0ced-7281-4d50-81be-77b661d399a0, volume: 0ea95d0b-429a-440d-82e0-058451c103ba, {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 14:55:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4552784e-47b4-4084-8ead-4f28800a2a4f tempest-GroupSnapshotsTest-752462418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:55:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4552784e-47b4-4084-8ead-4f28800a2a4f tempest-GroupSnapshotsTest-752462418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:55:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4552784e-47b4-4084-8ead-4f28800a2a4f tempest-GroupSnapshotsTest-752462418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:55:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4552784e-47b4-4084-8ead-4f28800a2a4f tempest-GroupSnapshotsTest-752462418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:55:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4552784e-47b4-4084-8ead-4f28800a2a4f tempest-GroupSnapshotsTest-752462418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:55:35 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[4331fa8f-b26d-4f68-b55b-d0dd40604aa8]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:55:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4552784e-47b4-4084-8ead-4f28800a2a4f tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-16169f94-75d8-4f3f-b5ee-f2316b978c07.6fff0ced-7281-4d50-81be-77b661d399a0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:35 devstack sudo[92831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-16169f94-75d8-4f3f-b5ee-f2316b978c07.6fff0ced-7281-4d50-81be-77b661d399a0 Sep 28 14:55:35 devstack sudo[92831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:35 devstack sudo[92831]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4552784e-47b4-4084-8ead-4f28800a2a4f tempest-GroupSnapshotsTest-752462418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-16169f94-75d8-4f3f-b5ee-f2316b978c07.6fff0ced-7281-4d50-81be-77b661d399a0" returned: 0 in 0.555s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-4552784e-47b4-4084-8ead-4f28800a2a4f tempest-GroupSnapshotsTest-752462418 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16169f94-75d8-4f3f-b5ee-f2316b978c07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 14:55:35 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[404bd043-3b67-4f6e-bea3-eb4adb0e528c]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:55:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4552784e-47b4-4084-8ead-4f28800a2a4f tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-16169f94-75d8-4f3f-b5ee-f2316b978c07 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:35 devstack sudo[92837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-16169f94-75d8-4f3f-b5ee-f2316b978c07 Sep 28 14:55:35 devstack sudo[92837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:36 devstack sudo[92837]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4552784e-47b4-4084-8ead-4f28800a2a4f tempest-GroupSnapshotsTest-752462418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-16169f94-75d8-4f3f-b5ee-f2316b978c07" returned: 0 in 0.401s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:36 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4552784e-47b4-4084-8ead-4f28800a2a4f tempest-GroupSnapshotsTest-752462418 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-16169f94-75d8-4f3f-b5ee-f2316b978c07 {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 14:55:36 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4552784e-47b4-4084-8ead-4f28800a2a4f tempest-GroupSnapshotsTest-752462418 None] Creating direct copy from snapshot {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 14:55:36 devstack cinder-volume[87116]: DEBUG cinder.utils [None req-4552784e-47b4-4084-8ead-4f28800a2a4f tempest-GroupSnapshotsTest-752462418 None] Path /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0ea95d0b-429a-440d-82e0-058451c103ba not found in is_blk_device check {{(pid=87116) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 14:55:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4552784e-47b4-4084-8ead-4f28800a2a4f tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-16169f94-75d8-4f3f-b5ee-f2316b978c07 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0ea95d0b-429a-440d-82e0-058451c103ba {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:36 devstack sudo[92843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-16169f94-75d8-4f3f-b5ee-f2316b978c07 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0ea95d0b-429a-440d-82e0-058451c103ba Sep 28 14:55:36 devstack sudo[92843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:39 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6bfde7d0-55e2-4ee0-946f-1aeec2598398 tempest-AttachVolumeTestJSON-1945595936 None] Acquiring lock "cinder-b3c7763c-2a0f-4d3d-abc5-265f40c78905-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:55:39 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6bfde7d0-55e2-4ee0-946f-1aeec2598398 tempest-AttachVolumeTestJSON-1945595936 None] Lock "cinder-b3c7763c-2a0f-4d3d-abc5-265f40c78905-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:55:39 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6bfde7d0-55e2-4ee0-946f-1aeec2598398 tempest-AttachVolumeTestJSON-1945595936 None] Acquiring lock "cinder-quobyte-b3c7763c-2a0f-4d3d-abc5-265f40c78905" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:55:39 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6bfde7d0-55e2-4ee0-946f-1aeec2598398 tempest-AttachVolumeTestJSON-1945595936 None] Lock "cinder-quobyte-b3c7763c-2a0f-4d3d-abc5-265f40c78905" acquired by "delete_volume" :: waited 0.075s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:55:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-30879536-5b41-456e-a8b8-b31e738f561f req-ccafce3f-c47f-4911-be7f-369bec3517f7 tempest-ServerActionsTestOtherA-1078904851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:55:39 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c89edc-c9d6-401c-aa7e-01a7e805d106]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:55:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6bfde7d0-55e2-4ee0-946f-1aeec2598398 tempest-AttachVolumeTestJSON-1945595936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b3c7763c-2a0f-4d3d-abc5-265f40c78905 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:40 devstack sudo[92899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b3c7763c-2a0f-4d3d-abc5-265f40c78905 Sep 28 14:55:40 devstack sudo[92899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:40 devstack sudo[92899]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6bfde7d0-55e2-4ee0-946f-1aeec2598398 tempest-AttachVolumeTestJSON-1945595936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b3c7763c-2a0f-4d3d-abc5-265f40c78905" returned: 0 in 0.998s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6bfde7d0-55e2-4ee0-946f-1aeec2598398 tempest-AttachVolumeTestJSON-1945595936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b3c7763c-2a0f-4d3d-abc5-265f40c78905 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:40 devstack sudo[92908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b3c7763c-2a0f-4d3d-abc5-265f40c78905 Sep 28 14:55:40 devstack sudo[92908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:41 devstack sudo[92908]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6bfde7d0-55e2-4ee0-946f-1aeec2598398 tempest-AttachVolumeTestJSON-1945595936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b3c7763c-2a0f-4d3d-abc5-265f40c78905" returned: 0 in 0.567s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6bfde7d0-55e2-4ee0-946f-1aeec2598398 tempest-AttachVolumeTestJSON-1945595936 None] Lock "cinder-quobyte-b3c7763c-2a0f-4d3d-abc5-265f40c78905" released by "delete_volume" :: held 1.683s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:55:41 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-6bfde7d0-55e2-4ee0-946f-1aeec2598398 tempest-AttachVolumeTestJSON-1945595936 None] Created reservations ['cf046659-731f-48be-bd4b-b37b13e95e18', '540b910d-82da-48f5-bd36-5556a333adf2', '241d7fa0-8bc6-4fb3-8fdf-aeba07248d15', '72ade822-594a-4a8f-80d2-49914699532f'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 14:55:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6bfde7d0-55e2-4ee0-946f-1aeec2598398 tempest-AttachVolumeTestJSON-1945595936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:55:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6bfde7d0-55e2-4ee0-946f-1aeec2598398 tempest-AttachVolumeTestJSON-1945595936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:55:41 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-6bfde7d0-55e2-4ee0-946f-1aeec2598398 tempest-AttachVolumeTestJSON-1945595936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:55:41 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-6bfde7d0-55e2-4ee0-946f-1aeec2598398 tempest-AttachVolumeTestJSON-1945595936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:55:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6bfde7d0-55e2-4ee0-946f-1aeec2598398 tempest-AttachVolumeTestJSON-1945595936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:55:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6bfde7d0-55e2-4ee0-946f-1aeec2598398 tempest-AttachVolumeTestJSON-1945595936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:41 devstack sudo[92911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 14:55:41 devstack sudo[92911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:42 devstack sudo[92911]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6bfde7d0-55e2-4ee0-946f-1aeec2598398 tempest-AttachVolumeTestJSON-1945595936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.407s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:42 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-6bfde7d0-55e2-4ee0-946f-1aeec2598398 tempest-AttachVolumeTestJSON-1945595936 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:55:42 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-6bfde7d0-55e2-4ee0-946f-1aeec2598398 tempest-AttachVolumeTestJSON-1945595936 None] Deleted volume successfully. Sep 28 14:55:42 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6bfde7d0-55e2-4ee0-946f-1aeec2598398 tempest-AttachVolumeTestJSON-1945595936 None] Lock "cinder-b3c7763c-2a0f-4d3d-abc5-265f40c78905-delete_volume" released by "delete_volume" :: held 2.719s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:55:42 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d7d56892-bd4e-4a56-83ef-6f2209ee7615 tempest-AttachVolumeTestJSON-1945595936 None] Acquiring lock "cinder-7e082e12-5880-4ef2-93e3-5842c7e3c3c4-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:55:42 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d7d56892-bd4e-4a56-83ef-6f2209ee7615 tempest-AttachVolumeTestJSON-1945595936 None] Lock "cinder-7e082e12-5880-4ef2-93e3-5842c7e3c3c4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:55:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d7d56892-bd4e-4a56-83ef-6f2209ee7615 tempest-AttachVolumeTestJSON-1945595936 None] Acquiring lock "cinder-quobyte-7e082e12-5880-4ef2-93e3-5842c7e3c3c4" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:55:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d7d56892-bd4e-4a56-83ef-6f2209ee7615 tempest-AttachVolumeTestJSON-1945595936 None] Lock "cinder-quobyte-7e082e12-5880-4ef2-93e3-5842c7e3c3c4" acquired by "delete_volume" :: waited 0.035s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:55:43 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6cde21-a358-45b9-8f66-7cf742c3639d]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:55:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d7d56892-bd4e-4a56-83ef-6f2209ee7615 tempest-AttachVolumeTestJSON-1945595936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7e082e12-5880-4ef2-93e3-5842c7e3c3c4 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:43 devstack sudo[92914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7e082e12-5880-4ef2-93e3-5842c7e3c3c4 Sep 28 14:55:43 devstack sudo[92914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:44 devstack sudo[92914]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d7d56892-bd4e-4a56-83ef-6f2209ee7615 tempest-AttachVolumeTestJSON-1945595936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7e082e12-5880-4ef2-93e3-5842c7e3c3c4" returned: 0 in 0.955s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d7d56892-bd4e-4a56-83ef-6f2209ee7615 tempest-AttachVolumeTestJSON-1945595936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7e082e12-5880-4ef2-93e3-5842c7e3c3c4 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:44 devstack sudo[92919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7e082e12-5880-4ef2-93e3-5842c7e3c3c4 Sep 28 14:55:44 devstack sudo[92919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:44 devstack sudo[92919]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d7d56892-bd4e-4a56-83ef-6f2209ee7615 tempest-AttachVolumeTestJSON-1945595936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7e082e12-5880-4ef2-93e3-5842c7e3c3c4" returned: 0 in 0.359s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:44 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d7d56892-bd4e-4a56-83ef-6f2209ee7615 tempest-AttachVolumeTestJSON-1945595936 None] Lock "cinder-quobyte-7e082e12-5880-4ef2-93e3-5842c7e3c3c4" released by "delete_volume" :: held 1.404s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:55:44 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-d7d56892-bd4e-4a56-83ef-6f2209ee7615 tempest-AttachVolumeTestJSON-1945595936 None] Created reservations ['50985b77-6a9d-4b3e-af2f-b931cc185cf3', '4fa1333f-11b0-4aba-801a-3b60b30be561', '3147ee0a-fe06-42bf-b4d7-00902e0f2dde', '85642db1-a77c-49f9-98ea-7e800fb472c6'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 14:55:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d7d56892-bd4e-4a56-83ef-6f2209ee7615 tempest-AttachVolumeTestJSON-1945595936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:55:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d7d56892-bd4e-4a56-83ef-6f2209ee7615 tempest-AttachVolumeTestJSON-1945595936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:55:44 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d7d56892-bd4e-4a56-83ef-6f2209ee7615 tempest-AttachVolumeTestJSON-1945595936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:55:44 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d7d56892-bd4e-4a56-83ef-6f2209ee7615 tempest-AttachVolumeTestJSON-1945595936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:55:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d7d56892-bd4e-4a56-83ef-6f2209ee7615 tempest-AttachVolumeTestJSON-1945595936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:55:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d7d56892-bd4e-4a56-83ef-6f2209ee7615 tempest-AttachVolumeTestJSON-1945595936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:44 devstack sudo[92922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 14:55:44 devstack sudo[92922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:45 devstack sudo[92922]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d7d56892-bd4e-4a56-83ef-6f2209ee7615 tempest-AttachVolumeTestJSON-1945595936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.470s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:45 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-d7d56892-bd4e-4a56-83ef-6f2209ee7615 tempest-AttachVolumeTestJSON-1945595936 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:55:45 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-d7d56892-bd4e-4a56-83ef-6f2209ee7615 tempest-AttachVolumeTestJSON-1945595936 None] Deleted volume successfully. Sep 28 14:55:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d7d56892-bd4e-4a56-83ef-6f2209ee7615 tempest-AttachVolumeTestJSON-1945595936 None] Lock "cinder-7e082e12-5880-4ef2-93e3-5842c7e3c3c4-delete_volume" released by "delete_volume" :: held 2.345s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:55:45 devstack sudo[92843]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4552784e-47b4-4084-8ead-4f28800a2a4f tempest-GroupSnapshotsTest-752462418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-16169f94-75d8-4f3f-b5ee-f2316b978c07 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0ea95d0b-429a-440d-82e0-058451c103ba" returned: 0 in 9.206s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:45 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-4552784e-47b4-4084-8ead-4f28800a2a4f tempest-GroupSnapshotsTest-752462418 None] Image conversion details: src /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-16169f94-75d8-4f3f-b5ee-f2316b978c07, size 1024.00 MB, duration 9.21 sec, destination /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0ea95d0b-429a-440d-82e0-058451c103ba {{(pid=87116) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 14:55:45 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-4552784e-47b4-4084-8ead-4f28800a2a4f tempest-GroupSnapshotsTest-752462418 None] Converted 1024.00 MB image at 111.22 MB/s Sep 28 14:55:45 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-4552784e-47b4-4084-8ead-4f28800a2a4f tempest-GroupSnapshotsTest-752462418 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0ea95d0b-429a-440d-82e0-058451c103ba is being set with open permissions: ugo+rw: NotImplementedError Sep 28 14:55:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4552784e-47b4-4084-8ead-4f28800a2a4f tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0ea95d0b-429a-440d-82e0-058451c103ba {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:45 devstack sudo[92925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0ea95d0b-429a-440d-82e0-058451c103ba Sep 28 14:55:45 devstack sudo[92925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d28093aa-2292-44c9-ae71-ea98ebd60449 tempest-AttachVolumeTestJSON-1945595936 None] Acquiring lock "cinder-8dbf8d99-c922-4ab6-849c-203e7a015885-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:55:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d28093aa-2292-44c9-ae71-ea98ebd60449 tempest-AttachVolumeTestJSON-1945595936 None] Lock "cinder-8dbf8d99-c922-4ab6-849c-203e7a015885-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:55:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d28093aa-2292-44c9-ae71-ea98ebd60449 tempest-AttachVolumeTestJSON-1945595936 None] Acquiring lock "cinder-quobyte-8dbf8d99-c922-4ab6-849c-203e7a015885" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:55:45 devstack sudo[92925]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4552784e-47b4-4084-8ead-4f28800a2a4f tempest-GroupSnapshotsTest-752462418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0ea95d0b-429a-440d-82e0-058451c103ba" returned: 0 in 0.317s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d28093aa-2292-44c9-ae71-ea98ebd60449 tempest-AttachVolumeTestJSON-1945595936 None] Lock "cinder-quobyte-8dbf8d99-c922-4ab6-849c-203e7a015885" acquired by "delete_volume" :: waited 0.024s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:55:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4552784e-47b4-4084-8ead-4f28800a2a4f tempest-GroupSnapshotsTest-752462418 None] Lock "cinder-quobyte-0ea95d0b-429a-440d-82e0-058451c103ba" released by "_copy_volume_from_snapshot" :: held 10.622s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:55:45 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c27d0aa-7a15-4d84-b1cc-928811dd8b45]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:55:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d28093aa-2292-44c9-ae71-ea98ebd60449 tempest-AttachVolumeTestJSON-1945595936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8dbf8d99-c922-4ab6-849c-203e7a015885 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4552784e-47b4-4084-8ead-4f28800a2a4f tempest-GroupSnapshotsTest-752462418 None] Lock "cinder-quobyte-6fff0ced-7281-4d50-81be-77b661d399a0-0ea95d0b-429a-440d-82e0-058451c103ba" released by "_create_volume_from_snapshot" :: held 10.699s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:55:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4552784e-47b4-4084-8ead-4f28800a2a4f tempest-GroupSnapshotsTest-752462418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.719s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:55:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-30879536-5b41-456e-a8b8-b31e738f561f req-ccafce3f-c47f-4911-be7f-369bec3517f7 tempest-ServerActionsTestOtherA-1078904851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.954s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:55:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-30879536-5b41-456e-a8b8-b31e738f561f req-ccafce3f-c47f-4911-be7f-369bec3517f7 tempest-ServerActionsTestOtherA-1078904851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:55:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-30879536-5b41-456e-a8b8-b31e738f561f req-ccafce3f-c47f-4911-be7f-369bec3517f7 tempest-ServerActionsTestOtherA-1078904851 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1', 'name': 'volume-c35c06be-12ba-4c6e-8ce6-cf5e912fec8e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3ea41564-cf7d-4ec8-a8ca-965bb98065e0', 'enforce_multipath': True} {{(pid=87116) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 14:55:45 devstack sudo[92928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8dbf8d99-c922-4ab6-849c-203e7a015885 Sep 28 14:55:45 devstack sudo[92928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:45 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-30879536-5b41-456e-a8b8-b31e738f561f req-ccafce3f-c47f-4911-be7f-369bec3517f7 tempest-ServerActionsTestOtherA-1078904851 None] attachment_update completed successfully. Sep 28 14:55:46 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-4552784e-47b4-4084-8ead-4f28800a2a4f tempest-GroupSnapshotsTest-752462418 None] Create group from source-snapshot-489b776b-fd6d-4ff3-8d16-b159cef7cf46 completed successfully. Sep 28 14:55:46 devstack sudo[92928]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d28093aa-2292-44c9-ae71-ea98ebd60449 tempest-AttachVolumeTestJSON-1945595936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8dbf8d99-c922-4ab6-849c-203e7a015885" returned: 0 in 0.438s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d28093aa-2292-44c9-ae71-ea98ebd60449 tempest-AttachVolumeTestJSON-1945595936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8dbf8d99-c922-4ab6-849c-203e7a015885 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:46 devstack sudo[93026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8dbf8d99-c922-4ab6-849c-203e7a015885 Sep 28 14:55:46 devstack sudo[93026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:46 devstack sudo[93026]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d28093aa-2292-44c9-ae71-ea98ebd60449 tempest-AttachVolumeTestJSON-1945595936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8dbf8d99-c922-4ab6-849c-203e7a015885" returned: 0 in 0.290s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d28093aa-2292-44c9-ae71-ea98ebd60449 tempest-AttachVolumeTestJSON-1945595936 None] Lock "cinder-quobyte-8dbf8d99-c922-4ab6-849c-203e7a015885" released by "delete_volume" :: held 0.818s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:55:46 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-d28093aa-2292-44c9-ae71-ea98ebd60449 tempest-AttachVolumeTestJSON-1945595936 None] Created reservations ['9a194d0b-972e-4da1-9d37-f6fca739507d', 'd31ba91e-5a9a-465e-b1fa-9b577d6ffdf1', '1e1185a4-b8c0-408c-a2e2-fad04b4403d9', '07c181d8-6b98-43f6-812e-84d248e3d532'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 14:55:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d28093aa-2292-44c9-ae71-ea98ebd60449 tempest-AttachVolumeTestJSON-1945595936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:55:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d28093aa-2292-44c9-ae71-ea98ebd60449 tempest-AttachVolumeTestJSON-1945595936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:55:46 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d28093aa-2292-44c9-ae71-ea98ebd60449 tempest-AttachVolumeTestJSON-1945595936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:55:46 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d28093aa-2292-44c9-ae71-ea98ebd60449 tempest-AttachVolumeTestJSON-1945595936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:55:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d28093aa-2292-44c9-ae71-ea98ebd60449 tempest-AttachVolumeTestJSON-1945595936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:55:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d28093aa-2292-44c9-ae71-ea98ebd60449 tempest-AttachVolumeTestJSON-1945595936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:46 devstack sudo[93353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 14:55:46 devstack sudo[93353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:47 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c0600a7e-17ea-4d1a-85fc-2078c94b0e3b tempest-GroupSnapshotsTest-752462418 None] Acquiring lock "cinder-quobyte-0ea95d0b-429a-440d-82e0-058451c103ba" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:55:47 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c0600a7e-17ea-4d1a-85fc-2078c94b0e3b tempest-GroupSnapshotsTest-752462418 None] Lock "cinder-quobyte-0ea95d0b-429a-440d-82e0-058451c103ba" acquired by "delete_volume" :: waited 0.029s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:55:47 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1524f7-b1c8-44f8-857d-961014e322f0]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:55:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c0600a7e-17ea-4d1a-85fc-2078c94b0e3b tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0ea95d0b-429a-440d-82e0-058451c103ba {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:47 devstack sudo[93355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0ea95d0b-429a-440d-82e0-058451c103ba Sep 28 14:55:47 devstack sudo[93355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:47 devstack sudo[93353]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d28093aa-2292-44c9-ae71-ea98ebd60449 tempest-AttachVolumeTestJSON-1945595936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.414s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:47 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-d28093aa-2292-44c9-ae71-ea98ebd60449 tempest-AttachVolumeTestJSON-1945595936 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:55:47 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-d28093aa-2292-44c9-ae71-ea98ebd60449 tempest-AttachVolumeTestJSON-1945595936 None] Deleted volume successfully. Sep 28 14:55:47 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d28093aa-2292-44c9-ae71-ea98ebd60449 tempest-AttachVolumeTestJSON-1945595936 None] Lock "cinder-8dbf8d99-c922-4ab6-849c-203e7a015885-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:55:47 devstack sudo[93355]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c0600a7e-17ea-4d1a-85fc-2078c94b0e3b tempest-GroupSnapshotsTest-752462418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0ea95d0b-429a-440d-82e0-058451c103ba" returned: 0 in 0.443s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c0600a7e-17ea-4d1a-85fc-2078c94b0e3b tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0ea95d0b-429a-440d-82e0-058451c103ba {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:47 devstack sudo[93361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0ea95d0b-429a-440d-82e0-058451c103ba Sep 28 14:55:47 devstack sudo[93361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:47 devstack sudo[93361]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c0600a7e-17ea-4d1a-85fc-2078c94b0e3b tempest-GroupSnapshotsTest-752462418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0ea95d0b-429a-440d-82e0-058451c103ba" returned: 0 in 0.285s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:47 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c0600a7e-17ea-4d1a-85fc-2078c94b0e3b tempest-GroupSnapshotsTest-752462418 None] Lock "cinder-quobyte-0ea95d0b-429a-440d-82e0-058451c103ba" released by "delete_volume" :: held 0.797s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:55:47 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-c0600a7e-17ea-4d1a-85fc-2078c94b0e3b tempest-GroupSnapshotsTest-752462418 None] Created reservations ['a68d4211-c209-430b-a400-82bbc63bf124'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 14:55:48 devstack cinder-volume[87116]: WARNING cinder.quota [None req-c0600a7e-17ea-4d1a-85fc-2078c94b0e3b tempest-GroupSnapshotsTest-752462418 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1512311673 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1512311673, it is now deprecated. Please use the default quota class for default quota. Sep 28 14:55:48 devstack cinder-volume[87116]: WARNING cinder.quota [None req-c0600a7e-17ea-4d1a-85fc-2078c94b0e3b tempest-GroupSnapshotsTest-752462418 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1512311673 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1512311673, it is now deprecated. Please use the default quota class for default quota. Sep 28 14:55:48 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-c0600a7e-17ea-4d1a-85fc-2078c94b0e3b tempest-GroupSnapshotsTest-752462418 None] Created reservations ['07d20932-cdbf-4143-8a79-9724cae60db5', '7c4064ef-1423-4fb7-b6f3-32a90daf225d', '5891017c-7c9f-4567-8aed-6b46c54f1209', '48eda61e-fe64-4754-9e6f-a11a81df8983'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 14:55:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c0600a7e-17ea-4d1a-85fc-2078c94b0e3b tempest-GroupSnapshotsTest-752462418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:55:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c0600a7e-17ea-4d1a-85fc-2078c94b0e3b tempest-GroupSnapshotsTest-752462418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:55:48 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c0600a7e-17ea-4d1a-85fc-2078c94b0e3b tempest-GroupSnapshotsTest-752462418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:55:48 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c0600a7e-17ea-4d1a-85fc-2078c94b0e3b tempest-GroupSnapshotsTest-752462418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:55:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c0600a7e-17ea-4d1a-85fc-2078c94b0e3b tempest-GroupSnapshotsTest-752462418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:55:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c0600a7e-17ea-4d1a-85fc-2078c94b0e3b tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:48 devstack sudo[93364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 14:55:48 devstack sudo[93364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:48 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-663ddb21-b8d0-4701-ba9d-03f77bba223b tempest-GroupSnapshotsTest-752462418 None] group_snapshot 489b776b-fd6d-4ff3-8d16-b159cef7cf46: deleting Sep 28 14:55:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-663ddb21-b8d0-4701-ba9d-03f77bba223b tempest-GroupSnapshotsTest-752462418 None] group_snapshot 489b776b-fd6d-4ff3-8d16-b159cef7cf46: deleting {{(pid=87116) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 14:55:48 devstack sudo[93364]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c0600a7e-17ea-4d1a-85fc-2078c94b0e3b tempest-GroupSnapshotsTest-752462418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.410s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:48 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-c0600a7e-17ea-4d1a-85fc-2078c94b0e3b tempest-GroupSnapshotsTest-752462418 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:55:48 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-663ddb21-b8d0-4701-ba9d-03f77bba223b tempest-GroupSnapshotsTest-752462418 None] Acquiring lock "cinder-quobyte-16169f94-75d8-4f3f-b5ee-f2316b978c07" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:55:48 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-c0600a7e-17ea-4d1a-85fc-2078c94b0e3b tempest-GroupSnapshotsTest-752462418 None] Delete group completed successfully. Sep 28 14:55:48 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-663ddb21-b8d0-4701-ba9d-03f77bba223b tempest-GroupSnapshotsTest-752462418 None] Lock "cinder-quobyte-16169f94-75d8-4f3f-b5ee-f2316b978c07" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:55:48 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-663ddb21-b8d0-4701-ba9d-03f77bba223b tempest-GroupSnapshotsTest-752462418 None] Acquiring lock "cinder-quobyte-6fff0ced-7281-4d50-81be-77b661d399a0" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:55:48 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-663ddb21-b8d0-4701-ba9d-03f77bba223b tempest-GroupSnapshotsTest-752462418 None] Lock "cinder-quobyte-6fff0ced-7281-4d50-81be-77b661d399a0" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:55:48 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-663ddb21-b8d0-4701-ba9d-03f77bba223b tempest-GroupSnapshotsTest-752462418 None] Deleting offline snapshot 6fff0ced-7281-4d50-81be-77b661d399a0 of volume 16169f94-75d8-4f3f-b5ee-f2316b978c07 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 14:55:48 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-663ddb21-b8d0-4701-ba9d-03f77bba223b tempest-GroupSnapshotsTest-752462418 None] snapshot_file for this snap is: volume-16169f94-75d8-4f3f-b5ee-f2316b978c07.6fff0ced-7281-4d50-81be-77b661d399a0 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 14:55:48 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6efd12-6a86-42f5-ac9f-2139444b4ffa]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:55:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-663ddb21-b8d0-4701-ba9d-03f77bba223b tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-16169f94-75d8-4f3f-b5ee-f2316b978c07.6fff0ced-7281-4d50-81be-77b661d399a0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:48 devstack sudo[93367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-16169f94-75d8-4f3f-b5ee-f2316b978c07.6fff0ced-7281-4d50-81be-77b661d399a0 Sep 28 14:55:48 devstack sudo[93367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:49 devstack sudo[93367]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-663ddb21-b8d0-4701-ba9d-03f77bba223b tempest-GroupSnapshotsTest-752462418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-16169f94-75d8-4f3f-b5ee-f2316b978c07.6fff0ced-7281-4d50-81be-77b661d399a0" returned: 0 in 0.512s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-663ddb21-b8d0-4701-ba9d-03f77bba223b tempest-GroupSnapshotsTest-752462418 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16169f94-75d8-4f3f-b5ee-f2316b978c07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 14:55:49 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a27b314-47ce-4611-b5c7-989f8cfaf1ab]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:55:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-663ddb21-b8d0-4701-ba9d-03f77bba223b tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-16169f94-75d8-4f3f-b5ee-f2316b978c07 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:49 devstack sudo[93376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-16169f94-75d8-4f3f-b5ee-f2316b978c07 Sep 28 14:55:49 devstack sudo[93376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:50 devstack sudo[93376]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-663ddb21-b8d0-4701-ba9d-03f77bba223b tempest-GroupSnapshotsTest-752462418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-16169f94-75d8-4f3f-b5ee-f2316b978c07" returned: 0 in 0.672s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-663ddb21-b8d0-4701-ba9d-03f77bba223b tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-16169f94-75d8-4f3f-b5ee-f2316b978c07.6fff0ced-7281-4d50-81be-77b661d399a0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:50 devstack sudo[93392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-16169f94-75d8-4f3f-b5ee-f2316b978c07.6fff0ced-7281-4d50-81be-77b661d399a0 Sep 28 14:55:50 devstack sudo[93392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:50 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-de6d19f5-018e-4471-bbd7-f53e48a8e9c4 req-16be5c68-2560-40b3-9dad-fc9820f33bf3 tempest-ServerActionsTestOtherA-1078904851 None] Terminate volume connection completed successfully. Sep 28 14:55:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-de6d19f5-018e-4471-bbd7-f53e48a8e9c4 req-16be5c68-2560-40b3-9dad-fc9820f33bf3 tempest-ServerActionsTestOtherA-1078904851 None] Deleting attachment 3ea41564-cf7d-4ec8-a8ca-965bb98065e0. {{(pid=87116) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 14:55:50 devstack sudo[93392]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-663ddb21-b8d0-4701-ba9d-03f77bba223b tempest-GroupSnapshotsTest-752462418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-16169f94-75d8-4f3f-b5ee-f2316b978c07.6fff0ced-7281-4d50-81be-77b661d399a0" returned: 0 in 0.483s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-663ddb21-b8d0-4701-ba9d-03f77bba223b tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-16169f94-75d8-4f3f-b5ee-f2316b978c07.6fff0ced-7281-4d50-81be-77b661d399a0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:50 devstack sudo[93425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-16169f94-75d8-4f3f-b5ee-f2316b978c07.6fff0ced-7281-4d50-81be-77b661d399a0 Sep 28 14:55:50 devstack sudo[93425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:50 devstack sudo[93425]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-663ddb21-b8d0-4701-ba9d-03f77bba223b tempest-GroupSnapshotsTest-752462418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-16169f94-75d8-4f3f-b5ee-f2316b978c07.6fff0ced-7281-4d50-81be-77b661d399a0" returned: 0 in 0.401s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:51 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-663ddb21-b8d0-4701-ba9d-03f77bba223b tempest-GroupSnapshotsTest-752462418 None] Lock "cinder-quobyte-6fff0ced-7281-4d50-81be-77b661d399a0" released by "_delete_snapshot" :: held 2.264s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:55:51 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-663ddb21-b8d0-4701-ba9d-03f77bba223b tempest-GroupSnapshotsTest-752462418 None] Lock "cinder-quobyte-16169f94-75d8-4f3f-b5ee-f2316b978c07" released by "delete_snapshot" :: held 2.318s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:55:51 devstack cinder-volume[87116]: WARNING cinder.quota [None req-663ddb21-b8d0-4701-ba9d-03f77bba223b tempest-GroupSnapshotsTest-752462418 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1512311673 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1512311673, it is now deprecated. Please use the default quota class for default quota. Sep 28 14:55:51 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-663ddb21-b8d0-4701-ba9d-03f77bba223b tempest-GroupSnapshotsTest-752462418 None] Created reservations ['ffe95c3a-f874-4020-8378-526d9c4895e6', 'f80fa1d2-9685-44e7-9982-ee00478eca7f', 'c7c161d5-d125-4c30-b209-3748a5b1d7ba', '3992ef15-c7f5-412a-b942-7a486964aa50'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 14:55:51 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-663ddb21-b8d0-4701-ba9d-03f77bba223b tempest-GroupSnapshotsTest-752462418 None] group_snapshot 489b776b-fd6d-4ff3-8d16-b159cef7cf46: deleted successfully Sep 28 14:55:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-de6d19f5-018e-4471-bbd7-f53e48a8e9c4 req-7993574b-e282-4b33-9bcd-048661aa1245 tempest-ServerActionsTestOtherA-1078904851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:55:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-de6d19f5-018e-4471-bbd7-f53e48a8e9c4 req-7993574b-e282-4b33-9bcd-048661aa1245 tempest-ServerActionsTestOtherA-1078904851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:55:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-de6d19f5-018e-4471-bbd7-f53e48a8e9c4 req-7993574b-e282-4b33-9bcd-048661aa1245 tempest-ServerActionsTestOtherA-1078904851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:55:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-de6d19f5-018e-4471-bbd7-f53e48a8e9c4 req-7993574b-e282-4b33-9bcd-048661aa1245 tempest-ServerActionsTestOtherA-1078904851 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1', 'name': 'volume-c35c06be-12ba-4c6e-8ce6-cf5e912fec8e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e2ca0e09-001a-4e66-ab02-fd9a2489aca9', 'enforce_multipath': True} {{(pid=87116) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 14:55:51 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-de6d19f5-018e-4471-bbd7-f53e48a8e9c4 req-7993574b-e282-4b33-9bcd-048661aa1245 tempest-ServerActionsTestOtherA-1078904851 None] attachment_update completed successfully. Sep 28 14:55:52 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=109,cinder:UPDATE=93,cinder:INSERT=19,cinder:DELETE=5 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:55:52 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6e6a77f3-a144-4e86-a7de-0cbe4af12cbc tempest-GroupSnapshotsTest-752462418 None] Acquiring lock "cinder-quobyte-16169f94-75d8-4f3f-b5ee-f2316b978c07" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:55:52 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6e6a77f3-a144-4e86-a7de-0cbe4af12cbc tempest-GroupSnapshotsTest-752462418 None] Lock "cinder-quobyte-16169f94-75d8-4f3f-b5ee-f2316b978c07" acquired by "delete_volume" :: waited 0.033s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:55:52 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9284f28-0f0f-4f20-81fe-98f395f428b6]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:55:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6e6a77f3-a144-4e86-a7de-0cbe4af12cbc tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-16169f94-75d8-4f3f-b5ee-f2316b978c07 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:52 devstack sudo[93468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-16169f94-75d8-4f3f-b5ee-f2316b978c07 Sep 28 14:55:52 devstack sudo[93468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:53 devstack sudo[93468]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6e6a77f3-a144-4e86-a7de-0cbe4af12cbc tempest-GroupSnapshotsTest-752462418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-16169f94-75d8-4f3f-b5ee-f2316b978c07" returned: 0 in 0.524s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6e6a77f3-a144-4e86-a7de-0cbe4af12cbc tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-16169f94-75d8-4f3f-b5ee-f2316b978c07 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:53 devstack sudo[93502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-16169f94-75d8-4f3f-b5ee-f2316b978c07 Sep 28 14:55:53 devstack sudo[93502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:53 devstack sudo[93502]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6e6a77f3-a144-4e86-a7de-0cbe4af12cbc tempest-GroupSnapshotsTest-752462418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-16169f94-75d8-4f3f-b5ee-f2316b978c07" returned: 0 in 0.382s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:53 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6e6a77f3-a144-4e86-a7de-0cbe4af12cbc tempest-GroupSnapshotsTest-752462418 None] Lock "cinder-quobyte-16169f94-75d8-4f3f-b5ee-f2316b978c07" released by "delete_volume" :: held 1.112s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:55:53 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:UPDATE=94,cinder:SELECT=111,cinder:INSERT=22,cinder:DELETE=6 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:55:53 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-6e6a77f3-a144-4e86-a7de-0cbe4af12cbc tempest-GroupSnapshotsTest-752462418 None] Created reservations ['c89d7297-c71a-4e35-8d6b-f38c38c561c6'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 14:55:53 devstack cinder-volume[87116]: WARNING cinder.db.api [None req-6e6a77f3-a144-4e86-a7de-0cbe4af12cbc tempest-GroupSnapshotsTest-752462418 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1512311673'] Sep 28 14:55:53 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-6e6a77f3-a144-4e86-a7de-0cbe4af12cbc tempest-GroupSnapshotsTest-752462418 None] Created reservations ['3cf7f446-7f4d-406b-a40f-516f6e00d4f0', '90648095-6318-473e-a811-4ac1f0bec51a', '94711096-2730-4ad9-bca7-f9a176eecc7c', '42e0b0d8-8937-4b7b-9e2f-1c4db8ddf7e5'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 14:55:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6e6a77f3-a144-4e86-a7de-0cbe4af12cbc tempest-GroupSnapshotsTest-752462418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:55:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6e6a77f3-a144-4e86-a7de-0cbe4af12cbc tempest-GroupSnapshotsTest-752462418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:55:54 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-6e6a77f3-a144-4e86-a7de-0cbe4af12cbc tempest-GroupSnapshotsTest-752462418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:55:54 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-6e6a77f3-a144-4e86-a7de-0cbe4af12cbc tempest-GroupSnapshotsTest-752462418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:55:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6e6a77f3-a144-4e86-a7de-0cbe4af12cbc tempest-GroupSnapshotsTest-752462418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:55:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6e6a77f3-a144-4e86-a7de-0cbe4af12cbc tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:54 devstack sudo[93912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 14:55:54 devstack sudo[93912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:54 devstack sudo[93912]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6e6a77f3-a144-4e86-a7de-0cbe4af12cbc tempest-GroupSnapshotsTest-752462418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.362s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:54 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-6e6a77f3-a144-4e86-a7de-0cbe4af12cbc tempest-GroupSnapshotsTest-752462418 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:55:54 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-6e6a77f3-a144-4e86-a7de-0cbe4af12cbc tempest-GroupSnapshotsTest-752462418 None] Delete group completed successfully. Sep 28 14:55:55 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-8bf9f169-62a0-49cf-8ff1-98aae0666bd6 tempest-GroupSnapshotsTest-752462418 None] Group tempest-GroupSnapshotsTest-Group-669764197: creating Sep 28 14:55:55 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-8bf9f169-62a0-49cf-8ff1-98aae0666bd6 tempest-GroupSnapshotsTest-752462418 None] Group tempest-GroupSnapshotsTest-Group-669764197: created successfully Sep 28 14:55:55 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-8bf9f169-62a0-49cf-8ff1-98aae0666bd6 tempest-GroupSnapshotsTest-752462418 None] Create group completed successfully. Sep 28 14:55:58 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-a35425ff-4237-47aa-8713-639fcfcae720 tempest-GroupSnapshotsTest-752462418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 14:55:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a35425ff-4237-47aa-8713-639fcfcae720 tempest-GroupSnapshotsTest-752462418 None] Flow 'volume_create_manager' (7329b7df-7360-4fd9-97c3-3e94f0245adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:55:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a35425ff-4237-47aa-8713-639fcfcae720 tempest-GroupSnapshotsTest-752462418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17efb912-c12a-4480-be22-2aaa52082e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:55:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a35425ff-4237-47aa-8713-639fcfcae720 tempest-GroupSnapshotsTest-752462418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17efb912-c12a-4480-be22-2aaa52082e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:55:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-317625776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5074711b-6204-43f4-8f4b-438dcac9ae33,host='devstack@QuobyteHD#QuobyteHD',id=8f4eb23c-f661-447a-b2b0-caf40344f29d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b8305889c98447e947915146fef1e27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:55:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:55:58Z,use_quota=True,user_id='5d4257ffa32f41c7b7429885fdcbf312',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11d61d3e-b374-45d5-adb2-31f749046c6c),volume_type_id=11d61d3e-b374-45d5-adb2-31f749046c6c)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:55:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a35425ff-4237-47aa-8713-639fcfcae720 tempest-GroupSnapshotsTest-752462418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef3539a7-a06f-4bc7-86dc-c9c15ea9c7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:55:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a35425ff-4237-47aa-8713-639fcfcae720 tempest-GroupSnapshotsTest-752462418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef3539a7-a06f-4bc7-86dc-c9c15ea9c7e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:55:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a35425ff-4237-47aa-8713-639fcfcae720 tempest-GroupSnapshotsTest-752462418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db5655a6-2b79-40c4-a5f6-3235fd5e6111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:55:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a35425ff-4237-47aa-8713-639fcfcae720 tempest-GroupSnapshotsTest-752462418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db5655a6-2b79-40c4-a5f6-3235fd5e6111) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f4eb23c-f661-447a-b2b0-caf40344f29d', 'volume_name': 'volume-8f4eb23c-f661-447a-b2b0-caf40344f29d', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:55:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a35425ff-4237-47aa-8713-639fcfcae720 tempest-GroupSnapshotsTest-752462418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f73104d-afe9-4fa5-a923-67040da28d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:55:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a35425ff-4237-47aa-8713-639fcfcae720 tempest-GroupSnapshotsTest-752462418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f73104d-afe9-4fa5-a923-67040da28d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:55:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a35425ff-4237-47aa-8713-639fcfcae720 tempest-GroupSnapshotsTest-752462418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f8c5b28-9ee2-472a-aa9c-6733b2fca47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:55:58 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-a35425ff-4237-47aa-8713-639fcfcae720 tempest-GroupSnapshotsTest-752462418 None] Volume 8f4eb23c-f661-447a-b2b0-caf40344f29d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f4eb23c-f661-447a-b2b0-caf40344f29d', 'volume_size': 1} Sep 28 14:55:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a35425ff-4237-47aa-8713-639fcfcae720 tempest-GroupSnapshotsTest-752462418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:55:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a35425ff-4237-47aa-8713-639fcfcae720 tempest-GroupSnapshotsTest-752462418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:55:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a35425ff-4237-47aa-8713-639fcfcae720 tempest-GroupSnapshotsTest-752462418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5074711b-6204-43f4-8f4b-438dcac9ae33,created_at=2026-09-28T12:55:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-317625776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5074711b-6204-43f4-8f4b-438dcac9ae33,host='devstack@QuobyteHD#QuobyteHD',id=8f4eb23c-f661-447a-b2b0-caf40344f29d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b8305889c98447e947915146fef1e27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:55:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:55:58Z,use_quota=True,user_id='5d4257ffa32f41c7b7429885fdcbf312',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11d61d3e-b374-45d5-adb2-31f749046c6c),volume_type_id=11d61d3e-b374-45d5-adb2-31f749046c6c)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 14:55:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-a35425ff-4237-47aa-8713-639fcfcae720 tempest-GroupSnapshotsTest-752462418 None] Creating volume 8f4eb23c-f661-447a-b2b0-caf40344f29d {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 14:55:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a35425ff-4237-47aa-8713-639fcfcae720 tempest-GroupSnapshotsTest-752462418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:55:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a35425ff-4237-47aa-8713-639fcfcae720 tempest-GroupSnapshotsTest-752462418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:55:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a35425ff-4237-47aa-8713-639fcfcae720 tempest-GroupSnapshotsTest-752462418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:55:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a35425ff-4237-47aa-8713-639fcfcae720 tempest-GroupSnapshotsTest-752462418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:55:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a35425ff-4237-47aa-8713-639fcfcae720 tempest-GroupSnapshotsTest-752462418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:55:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a35425ff-4237-47aa-8713-639fcfcae720 tempest-GroupSnapshotsTest-752462418 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 14:55:58 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-a35425ff-4237-47aa-8713-639fcfcae720 tempest-GroupSnapshotsTest-752462418 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 14:55:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a35425ff-4237-47aa-8713-639fcfcae720 tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8f4eb23c-f661-447a-b2b0-caf40344f29d 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:58 devstack sudo[93970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8f4eb23c-f661-447a-b2b0-caf40344f29d 1073741824 Sep 28 14:55:58 devstack sudo[93970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:59 devstack sudo[93970]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a35425ff-4237-47aa-8713-639fcfcae720 tempest-GroupSnapshotsTest-752462418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8f4eb23c-f661-447a-b2b0-caf40344f29d 1073741824" returned: 0 in 0.870s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a35425ff-4237-47aa-8713-639fcfcae720 tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8f4eb23c-f661-447a-b2b0-caf40344f29d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:59 devstack sudo[93977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8f4eb23c-f661-447a-b2b0-caf40344f29d Sep 28 14:55:59 devstack sudo[93977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:59 devstack sudo[93977]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a35425ff-4237-47aa-8713-639fcfcae720 tempest-GroupSnapshotsTest-752462418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8f4eb23c-f661-447a-b2b0-caf40344f29d" returned: 0 in 0.700s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a35425ff-4237-47aa-8713-639fcfcae720 tempest-GroupSnapshotsTest-752462418 None] <== create_volume: return (1677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 14:55:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a35425ff-4237-47aa-8713-639fcfcae720 tempest-GroupSnapshotsTest-752462418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.682s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:55:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a35425ff-4237-47aa-8713-639fcfcae720 tempest-GroupSnapshotsTest-752462418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f8c5b28-9ee2-472a-aa9c-6733b2fca47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f4eb23c-f661-447a-b2b0-caf40344f29d', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:56:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a35425ff-4237-47aa-8713-639fcfcae720 tempest-GroupSnapshotsTest-752462418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc8f5eb8-6c61-4d99-b9bf-6265ceb87ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:56:00 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-a35425ff-4237-47aa-8713-639fcfcae720 tempest-GroupSnapshotsTest-752462418 None] Volume volume-8f4eb23c-f661-447a-b2b0-caf40344f29d (8f4eb23c-f661-447a-b2b0-caf40344f29d): created successfully Sep 28 14:56:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a35425ff-4237-47aa-8713-639fcfcae720 tempest-GroupSnapshotsTest-752462418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc8f5eb8-6c61-4d99-b9bf-6265ceb87ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:56:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a35425ff-4237-47aa-8713-639fcfcae720 tempest-GroupSnapshotsTest-752462418 None] Flow 'volume_create_manager' (7329b7df-7360-4fd9-97c3-3e94f0245adf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:56:00 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-a35425ff-4237-47aa-8713-639fcfcae720 tempest-GroupSnapshotsTest-752462418 None] Created volume successfully. Sep 28 14:56:01 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-840c1ae8-40c7-40d2-9ea8-b0f48aa6c0c2 tempest-GroupSnapshotsTest-752462418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 14:56:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-840c1ae8-40c7-40d2-9ea8-b0f48aa6c0c2 tempest-GroupSnapshotsTest-752462418 None] Flow 'volume_create_manager' (4eb380cb-40ad-474d-8ba8-7321b2c866e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:56:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-840c1ae8-40c7-40d2-9ea8-b0f48aa6c0c2 tempest-GroupSnapshotsTest-752462418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2e4c215-2537-4640-b87c-65c8a92be783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:56:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-840c1ae8-40c7-40d2-9ea8-b0f48aa6c0c2 tempest-GroupSnapshotsTest-752462418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2e4c215-2537-4640-b87c-65c8a92be783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:56:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-431502258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5074711b-6204-43f4-8f4b-438dcac9ae33,host='devstack@QuobyteHD#QuobyteHD',id=c882b1e9-e730-40ee-99e5-dfb9705e5eca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b8305889c98447e947915146fef1e27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:56:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:56:02Z,use_quota=True,user_id='5d4257ffa32f41c7b7429885fdcbf312',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11d61d3e-b374-45d5-adb2-31f749046c6c),volume_type_id=11d61d3e-b374-45d5-adb2-31f749046c6c)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:56:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-840c1ae8-40c7-40d2-9ea8-b0f48aa6c0c2 tempest-GroupSnapshotsTest-752462418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c10ba27-fd36-44fd-9f1e-6a4e7c6915e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:56:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-840c1ae8-40c7-40d2-9ea8-b0f48aa6c0c2 tempest-GroupSnapshotsTest-752462418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c10ba27-fd36-44fd-9f1e-6a4e7c6915e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:56:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-840c1ae8-40c7-40d2-9ea8-b0f48aa6c0c2 tempest-GroupSnapshotsTest-752462418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b5100ce-27d8-448f-a84a-780ba5a9724f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:56:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-840c1ae8-40c7-40d2-9ea8-b0f48aa6c0c2 tempest-GroupSnapshotsTest-752462418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b5100ce-27d8-448f-a84a-780ba5a9724f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c882b1e9-e730-40ee-99e5-dfb9705e5eca', 'volume_name': 'volume-c882b1e9-e730-40ee-99e5-dfb9705e5eca', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:56:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-840c1ae8-40c7-40d2-9ea8-b0f48aa6c0c2 tempest-GroupSnapshotsTest-752462418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fd626a2-c578-42dd-8969-acb209930a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:56:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-840c1ae8-40c7-40d2-9ea8-b0f48aa6c0c2 tempest-GroupSnapshotsTest-752462418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fd626a2-c578-42dd-8969-acb209930a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:56:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-840c1ae8-40c7-40d2-9ea8-b0f48aa6c0c2 tempest-GroupSnapshotsTest-752462418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fc9b8bc-4cab-4221-bdf3-82296251c2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:56:02 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-840c1ae8-40c7-40d2-9ea8-b0f48aa6c0c2 tempest-GroupSnapshotsTest-752462418 None] Volume c882b1e9-e730-40ee-99e5-dfb9705e5eca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c882b1e9-e730-40ee-99e5-dfb9705e5eca', 'volume_size': 1} Sep 28 14:56:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-840c1ae8-40c7-40d2-9ea8-b0f48aa6c0c2 tempest-GroupSnapshotsTest-752462418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:56:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-840c1ae8-40c7-40d2-9ea8-b0f48aa6c0c2 tempest-GroupSnapshotsTest-752462418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:56:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-840c1ae8-40c7-40d2-9ea8-b0f48aa6c0c2 tempest-GroupSnapshotsTest-752462418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5074711b-6204-43f4-8f4b-438dcac9ae33,created_at=2026-09-28T12:56:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-431502258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5074711b-6204-43f4-8f4b-438dcac9ae33,host='devstack@QuobyteHD#QuobyteHD',id=c882b1e9-e730-40ee-99e5-dfb9705e5eca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b8305889c98447e947915146fef1e27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:56:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:56:02Z,use_quota=True,user_id='5d4257ffa32f41c7b7429885fdcbf312',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11d61d3e-b374-45d5-adb2-31f749046c6c),volume_type_id=11d61d3e-b374-45d5-adb2-31f749046c6c)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 14:56:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-840c1ae8-40c7-40d2-9ea8-b0f48aa6c0c2 tempest-GroupSnapshotsTest-752462418 None] Creating volume c882b1e9-e730-40ee-99e5-dfb9705e5eca {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 14:56:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-840c1ae8-40c7-40d2-9ea8-b0f48aa6c0c2 tempest-GroupSnapshotsTest-752462418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:56:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-840c1ae8-40c7-40d2-9ea8-b0f48aa6c0c2 tempest-GroupSnapshotsTest-752462418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:56:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-840c1ae8-40c7-40d2-9ea8-b0f48aa6c0c2 tempest-GroupSnapshotsTest-752462418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:56:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-840c1ae8-40c7-40d2-9ea8-b0f48aa6c0c2 tempest-GroupSnapshotsTest-752462418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:56:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-840c1ae8-40c7-40d2-9ea8-b0f48aa6c0c2 tempest-GroupSnapshotsTest-752462418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:56:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-840c1ae8-40c7-40d2-9ea8-b0f48aa6c0c2 tempest-GroupSnapshotsTest-752462418 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 14:56:02 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-840c1ae8-40c7-40d2-9ea8-b0f48aa6c0c2 tempest-GroupSnapshotsTest-752462418 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 14:56:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-840c1ae8-40c7-40d2-9ea8-b0f48aa6c0c2 tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c882b1e9-e730-40ee-99e5-dfb9705e5eca 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:02 devstack sudo[93981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c882b1e9-e730-40ee-99e5-dfb9705e5eca 1073741824 Sep 28 14:56:02 devstack sudo[93981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:02 devstack sudo[93981]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-840c1ae8-40c7-40d2-9ea8-b0f48aa6c0c2 tempest-GroupSnapshotsTest-752462418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c882b1e9-e730-40ee-99e5-dfb9705e5eca 1073741824" returned: 0 in 0.641s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-840c1ae8-40c7-40d2-9ea8-b0f48aa6c0c2 tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c882b1e9-e730-40ee-99e5-dfb9705e5eca {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:02 devstack sudo[93987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c882b1e9-e730-40ee-99e5-dfb9705e5eca Sep 28 14:56:02 devstack sudo[93987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:03 devstack sudo[93987]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-840c1ae8-40c7-40d2-9ea8-b0f48aa6c0c2 tempest-GroupSnapshotsTest-752462418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c882b1e9-e730-40ee-99e5-dfb9705e5eca" returned: 0 in 0.424s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-840c1ae8-40c7-40d2-9ea8-b0f48aa6c0c2 tempest-GroupSnapshotsTest-752462418 None] <== create_volume: return (1150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 14:56:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-840c1ae8-40c7-40d2-9ea8-b0f48aa6c0c2 tempest-GroupSnapshotsTest-752462418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:56:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-840c1ae8-40c7-40d2-9ea8-b0f48aa6c0c2 tempest-GroupSnapshotsTest-752462418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fc9b8bc-4cab-4221-bdf3-82296251c2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c882b1e9-e730-40ee-99e5-dfb9705e5eca', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:56:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-840c1ae8-40c7-40d2-9ea8-b0f48aa6c0c2 tempest-GroupSnapshotsTest-752462418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d57f7a6-21d8-4f91-8dac-31bedce5ca66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:56:03 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-840c1ae8-40c7-40d2-9ea8-b0f48aa6c0c2 tempest-GroupSnapshotsTest-752462418 None] Volume volume-c882b1e9-e730-40ee-99e5-dfb9705e5eca (c882b1e9-e730-40ee-99e5-dfb9705e5eca): created successfully Sep 28 14:56:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-840c1ae8-40c7-40d2-9ea8-b0f48aa6c0c2 tempest-GroupSnapshotsTest-752462418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d57f7a6-21d8-4f91-8dac-31bedce5ca66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:56:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-840c1ae8-40c7-40d2-9ea8-b0f48aa6c0c2 tempest-GroupSnapshotsTest-752462418 None] Flow 'volume_create_manager' (4eb380cb-40ad-474d-8ba8-7321b2c866e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:56:03 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-840c1ae8-40c7-40d2-9ea8-b0f48aa6c0c2 tempest-GroupSnapshotsTest-752462418 None] Created volume successfully. Sep 28 14:56:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-58880981-2947-4c11-adbe-fe7d1a9fb340 tempest-BackendsCapabilitiesAdminTestsJSON-886016079 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.2063941955566, 'free_capacity_gb': 1775.2063941955566, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87116) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 14:56:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-882a9fc7-e0d9-4943-9172-d8c6a0348c79 tempest-BackendsCapabilitiesAdminTestsJSON-886016079 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.2063941955566, 'free_capacity_gb': 1775.2063941955566, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87116) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 14:56:04 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-0f3759d6-85ea-4673-9788-6fa6a50a8104 tempest-GroupSnapshotsTest-752462418 None] Update group completed successfully. Sep 28 14:56:06 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-504abb1f-53b2-4868-a918-c696396de015 tempest-GroupSnapshotsTest-752462418 None] Update group completed successfully. Sep 28 14:56:07 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-434901d9-94c0-48ab-8e84-e3e7999d5b12 tempest-GroupSnapshotsTest-752462418 None] Update group completed successfully. Sep 28 14:56:08 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-5165268b-e751-41d6-a332-d12fce4aa01b tempest-GroupSnapshotsTest-752462418 None] Update group completed successfully. Sep 28 14:56:10 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-99f69f9c-f73a-471c-b13e-77a9ba40ac80 tempest-GroupSnapshotsTest-752462418 None] GroupSnapshot c0aa9618-5ff4-4b65-936c-b2dda8b43708: creating. Sep 28 14:56:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-99f69f9c-f73a-471c-b13e-77a9ba40ac80 tempest-GroupSnapshotsTest-752462418 None] Group snapshot c0aa9618-5ff4-4b65-936c-b2dda8b43708: creating. {{(pid=87116) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 14:56:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-99f69f9c-f73a-471c-b13e-77a9ba40ac80 tempest-GroupSnapshotsTest-752462418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:56:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-99f69f9c-f73a-471c-b13e-77a9ba40ac80 tempest-GroupSnapshotsTest-752462418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:56:10 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-99f69f9c-f73a-471c-b13e-77a9ba40ac80 tempest-GroupSnapshotsTest-752462418 None] Creating offline snapshot 23cbea61-34bc-42b6-8ca4-503f1b7922ff of volume c882b1e9-e730-40ee-99e5-dfb9705e5eca {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 14:56:10 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff700700-3354-4d69-8f86-605610c47191]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:56:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-99f69f9c-f73a-471c-b13e-77a9ba40ac80 tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c882b1e9-e730-40ee-99e5-dfb9705e5eca {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:10 devstack sudo[94042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c882b1e9-e730-40ee-99e5-dfb9705e5eca Sep 28 14:56:10 devstack sudo[94042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:11 devstack sudo[94042]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-99f69f9c-f73a-471c-b13e-77a9ba40ac80 tempest-GroupSnapshotsTest-752462418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c882b1e9-e730-40ee-99e5-dfb9705e5eca" returned: 0 in 0.502s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-99f69f9c-f73a-471c-b13e-77a9ba40ac80 tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c882b1e9-e730-40ee-99e5-dfb9705e5eca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c882b1e9-e730-40ee-99e5-dfb9705e5eca.23cbea61-34bc-42b6-8ca4-503f1b7922ff 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:11 devstack sudo[94047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c882b1e9-e730-40ee-99e5-dfb9705e5eca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c882b1e9-e730-40ee-99e5-dfb9705e5eca.23cbea61-34bc-42b6-8ca4-503f1b7922ff 1G Sep 28 14:56:11 devstack sudo[94047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:12 devstack sudo[94047]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-99f69f9c-f73a-471c-b13e-77a9ba40ac80 tempest-GroupSnapshotsTest-752462418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c882b1e9-e730-40ee-99e5-dfb9705e5eca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c882b1e9-e730-40ee-99e5-dfb9705e5eca.23cbea61-34bc-42b6-8ca4-503f1b7922ff 1G" returned: 0 in 0.919s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-99f69f9c-f73a-471c-b13e-77a9ba40ac80 tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c882b1e9-e730-40ee-99e5-dfb9705e5eca -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c882b1e9-e730-40ee-99e5-dfb9705e5eca.23cbea61-34bc-42b6-8ca4-503f1b7922ff {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:12 devstack sudo[94103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c882b1e9-e730-40ee-99e5-dfb9705e5eca -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c882b1e9-e730-40ee-99e5-dfb9705e5eca.23cbea61-34bc-42b6-8ca4-503f1b7922ff Sep 28 14:56:12 devstack sudo[94103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:12 devstack sudo[94103]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-99f69f9c-f73a-471c-b13e-77a9ba40ac80 tempest-GroupSnapshotsTest-752462418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c882b1e9-e730-40ee-99e5-dfb9705e5eca -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c882b1e9-e730-40ee-99e5-dfb9705e5eca.23cbea61-34bc-42b6-8ca4-503f1b7922ff" returned: 0 in 0.535s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:12 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-99f69f9c-f73a-471c-b13e-77a9ba40ac80 tempest-GroupSnapshotsTest-752462418 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c882b1e9-e730-40ee-99e5-dfb9705e5eca.23cbea61-34bc-42b6-8ca4-503f1b7922ff is being set with open permissions: ugo+rw: NotImplementedError Sep 28 14:56:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-99f69f9c-f73a-471c-b13e-77a9ba40ac80 tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c882b1e9-e730-40ee-99e5-dfb9705e5eca.23cbea61-34bc-42b6-8ca4-503f1b7922ff {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:12 devstack sudo[94124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c882b1e9-e730-40ee-99e5-dfb9705e5eca.23cbea61-34bc-42b6-8ca4-503f1b7922ff Sep 28 14:56:12 devstack sudo[94124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:12 devstack sudo[94124]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-99f69f9c-f73a-471c-b13e-77a9ba40ac80 tempest-GroupSnapshotsTest-752462418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c882b1e9-e730-40ee-99e5-dfb9705e5eca.23cbea61-34bc-42b6-8ca4-503f1b7922ff" returned: 0 in 0.292s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-99f69f9c-f73a-471c-b13e-77a9ba40ac80 tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c882b1e9-e730-40ee-99e5-dfb9705e5eca.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:12 devstack sudo[94134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c882b1e9-e730-40ee-99e5-dfb9705e5eca.info Sep 28 14:56:12 devstack sudo[94134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:13 devstack sudo[94134]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-99f69f9c-f73a-471c-b13e-77a9ba40ac80 tempest-GroupSnapshotsTest-752462418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c882b1e9-e730-40ee-99e5-dfb9705e5eca.info" returned: 0 in 0.364s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:13 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-99f69f9c-f73a-471c-b13e-77a9ba40ac80 tempest-GroupSnapshotsTest-752462418 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c882b1e9-e730-40ee-99e5-dfb9705e5eca.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 14:56:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-99f69f9c-f73a-471c-b13e-77a9ba40ac80 tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c882b1e9-e730-40ee-99e5-dfb9705e5eca.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:13 devstack sudo[94172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c882b1e9-e730-40ee-99e5-dfb9705e5eca.info Sep 28 14:56:13 devstack sudo[94172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:13 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-f2e1dd59-8eb7-46ab-83ec-06c98121ea3f tempest-GroupSnapshotsV319Test-1883608929 None] Group tempest-GroupSnapshotsV319Test-Group-1323903892: creating Sep 28 14:56:13 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-f2e1dd59-8eb7-46ab-83ec-06c98121ea3f tempest-GroupSnapshotsV319Test-1883608929 None] Group tempest-GroupSnapshotsV319Test-Group-1323903892: created successfully Sep 28 14:56:13 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-f2e1dd59-8eb7-46ab-83ec-06c98121ea3f tempest-GroupSnapshotsV319Test-1883608929 None] Create group completed successfully. Sep 28 14:56:13 devstack sudo[94172]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-99f69f9c-f73a-471c-b13e-77a9ba40ac80 tempest-GroupSnapshotsTest-752462418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c882b1e9-e730-40ee-99e5-dfb9705e5eca.info" returned: 0 in 0.362s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-99f69f9c-f73a-471c-b13e-77a9ba40ac80 tempest-GroupSnapshotsTest-752462418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.113s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:56:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-99f69f9c-f73a-471c-b13e-77a9ba40ac80 tempest-GroupSnapshotsTest-752462418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:56:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-99f69f9c-f73a-471c-b13e-77a9ba40ac80 tempest-GroupSnapshotsTest-752462418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:56:13 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-99f69f9c-f73a-471c-b13e-77a9ba40ac80 tempest-GroupSnapshotsTest-752462418 None] Creating offline snapshot 6600e90e-9c65-4e7f-b12f-d2925ced2e10 of volume 8f4eb23c-f661-447a-b2b0-caf40344f29d {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 14:56:13 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a35f47-a470-4607-a502-eee679af7379]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:56:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-99f69f9c-f73a-471c-b13e-77a9ba40ac80 tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8f4eb23c-f661-447a-b2b0-caf40344f29d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:13 devstack sudo[94175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8f4eb23c-f661-447a-b2b0-caf40344f29d Sep 28 14:56:13 devstack sudo[94175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:14 devstack sudo[94175]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-99f69f9c-f73a-471c-b13e-77a9ba40ac80 tempest-GroupSnapshotsTest-752462418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8f4eb23c-f661-447a-b2b0-caf40344f29d" returned: 0 in 0.525s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-99f69f9c-f73a-471c-b13e-77a9ba40ac80 tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8f4eb23c-f661-447a-b2b0-caf40344f29d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8f4eb23c-f661-447a-b2b0-caf40344f29d.6600e90e-9c65-4e7f-b12f-d2925ced2e10 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:14 devstack sudo[94183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8f4eb23c-f661-447a-b2b0-caf40344f29d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8f4eb23c-f661-447a-b2b0-caf40344f29d.6600e90e-9c65-4e7f-b12f-d2925ced2e10 1G Sep 28 14:56:14 devstack sudo[94183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:14 devstack sudo[94183]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-99f69f9c-f73a-471c-b13e-77a9ba40ac80 tempest-GroupSnapshotsTest-752462418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8f4eb23c-f661-447a-b2b0-caf40344f29d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8f4eb23c-f661-447a-b2b0-caf40344f29d.6600e90e-9c65-4e7f-b12f-d2925ced2e10 1G" returned: 0 in 0.631s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-99f69f9c-f73a-471c-b13e-77a9ba40ac80 tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f4eb23c-f661-447a-b2b0-caf40344f29d -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8f4eb23c-f661-447a-b2b0-caf40344f29d.6600e90e-9c65-4e7f-b12f-d2925ced2e10 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:14 devstack sudo[94189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f4eb23c-f661-447a-b2b0-caf40344f29d -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8f4eb23c-f661-447a-b2b0-caf40344f29d.6600e90e-9c65-4e7f-b12f-d2925ced2e10 Sep 28 14:56:14 devstack sudo[94189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:15 devstack sudo[94189]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-99f69f9c-f73a-471c-b13e-77a9ba40ac80 tempest-GroupSnapshotsTest-752462418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f4eb23c-f661-447a-b2b0-caf40344f29d -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8f4eb23c-f661-447a-b2b0-caf40344f29d.6600e90e-9c65-4e7f-b12f-d2925ced2e10" returned: 0 in 0.512s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:15 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-99f69f9c-f73a-471c-b13e-77a9ba40ac80 tempest-GroupSnapshotsTest-752462418 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8f4eb23c-f661-447a-b2b0-caf40344f29d.6600e90e-9c65-4e7f-b12f-d2925ced2e10 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 14:56:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-99f69f9c-f73a-471c-b13e-77a9ba40ac80 tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8f4eb23c-f661-447a-b2b0-caf40344f29d.6600e90e-9c65-4e7f-b12f-d2925ced2e10 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:15 devstack sudo[94195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8f4eb23c-f661-447a-b2b0-caf40344f29d.6600e90e-9c65-4e7f-b12f-d2925ced2e10 Sep 28 14:56:15 devstack sudo[94195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:15 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-58025af3-ab93-4ff7-8b4a-4a0c706e9249 tempest-GroupSnapshotsV319Test-1883608929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 14:56:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-58025af3-ab93-4ff7-8b4a-4a0c706e9249 tempest-GroupSnapshotsV319Test-1883608929 None] Flow 'volume_create_manager' (f0491c0c-fdfe-4e4c-bcc3-b57ba4a8308a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:56:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-58025af3-ab93-4ff7-8b4a-4a0c706e9249 tempest-GroupSnapshotsV319Test-1883608929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1305be7-f291-4d37-9c34-36de5d6b31a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:56:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-58025af3-ab93-4ff7-8b4a-4a0c706e9249 tempest-GroupSnapshotsV319Test-1883608929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1305be7-f291-4d37-9c34-36de5d6b31a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:56:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2033399016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=470e5c60-2c9e-4eb2-be15-9c7396cbd1a5,host='devstack@QuobyteHD#QuobyteHD',id=8d35bb45-33ca-4a61-9359-8526258cbbe0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d26c8aeb14fb48af9f90a692d2cd6a85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:56:16Z,use_quota=True,user_id='f6a9346d0d424e35a929bcadc60b51d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85eef76c-362f-421d-970f-6c7368a0704f),volume_type_id=85eef76c-362f-421d-970f-6c7368a0704f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:56:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-58025af3-ab93-4ff7-8b4a-4a0c706e9249 tempest-GroupSnapshotsV319Test-1883608929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (339c9f50-52d3-4a23-a6a0-d07b2a4a8733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:56:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-58025af3-ab93-4ff7-8b4a-4a0c706e9249 tempest-GroupSnapshotsV319Test-1883608929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (339c9f50-52d3-4a23-a6a0-d07b2a4a8733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:56:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-58025af3-ab93-4ff7-8b4a-4a0c706e9249 tempest-GroupSnapshotsV319Test-1883608929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba237bb1-5c93-469d-a799-b8c04fdf8ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:56:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-58025af3-ab93-4ff7-8b4a-4a0c706e9249 tempest-GroupSnapshotsV319Test-1883608929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba237bb1-5c93-469d-a799-b8c04fdf8ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d35bb45-33ca-4a61-9359-8526258cbbe0', 'volume_name': 'volume-8d35bb45-33ca-4a61-9359-8526258cbbe0', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:56:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-58025af3-ab93-4ff7-8b4a-4a0c706e9249 tempest-GroupSnapshotsV319Test-1883608929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c437b69-8716-4b06-bf19-fac67fb04f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:56:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-58025af3-ab93-4ff7-8b4a-4a0c706e9249 tempest-GroupSnapshotsV319Test-1883608929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c437b69-8716-4b06-bf19-fac67fb04f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:56:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-58025af3-ab93-4ff7-8b4a-4a0c706e9249 tempest-GroupSnapshotsV319Test-1883608929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44aba7f3-37e8-4d2c-9760-c50d7318fc96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:56:15 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-58025af3-ab93-4ff7-8b4a-4a0c706e9249 tempest-GroupSnapshotsV319Test-1883608929 None] Volume 8d35bb45-33ca-4a61-9359-8526258cbbe0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d35bb45-33ca-4a61-9359-8526258cbbe0', 'volume_size': 1} Sep 28 14:56:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-58025af3-ab93-4ff7-8b4a-4a0c706e9249 tempest-GroupSnapshotsV319Test-1883608929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:56:15 devstack sudo[94195]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-99f69f9c-f73a-471c-b13e-77a9ba40ac80 tempest-GroupSnapshotsTest-752462418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8f4eb23c-f661-447a-b2b0-caf40344f29d.6600e90e-9c65-4e7f-b12f-d2925ced2e10" returned: 0 in 0.486s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-99f69f9c-f73a-471c-b13e-77a9ba40ac80 tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8f4eb23c-f661-447a-b2b0-caf40344f29d.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:15 devstack sudo[94198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8f4eb23c-f661-447a-b2b0-caf40344f29d.info Sep 28 14:56:15 devstack sudo[94198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:16 devstack sudo[94198]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-99f69f9c-f73a-471c-b13e-77a9ba40ac80 tempest-GroupSnapshotsTest-752462418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8f4eb23c-f661-447a-b2b0-caf40344f29d.info" returned: 0 in 0.344s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:16 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-99f69f9c-f73a-471c-b13e-77a9ba40ac80 tempest-GroupSnapshotsTest-752462418 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8f4eb23c-f661-447a-b2b0-caf40344f29d.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 14:56:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-99f69f9c-f73a-471c-b13e-77a9ba40ac80 tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8f4eb23c-f661-447a-b2b0-caf40344f29d.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:16 devstack sudo[94202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8f4eb23c-f661-447a-b2b0-caf40344f29d.info Sep 28 14:56:16 devstack sudo[94202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:16 devstack sudo[94202]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-99f69f9c-f73a-471c-b13e-77a9ba40ac80 tempest-GroupSnapshotsTest-752462418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8f4eb23c-f661-447a-b2b0-caf40344f29d.info" returned: 0 in 0.339s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-99f69f9c-f73a-471c-b13e-77a9ba40ac80 tempest-GroupSnapshotsTest-752462418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.960s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:56:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-58025af3-ab93-4ff7-8b4a-4a0c706e9249 tempest-GroupSnapshotsV319Test-1883608929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.883s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:56:16 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-58025af3-ab93-4ff7-8b4a-4a0c706e9249 tempest-GroupSnapshotsV319Test-1883608929 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=470e5c60-2c9e-4eb2-be15-9c7396cbd1a5,created_at=2026-09-28T12:56:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2033399016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=470e5c60-2c9e-4eb2-be15-9c7396cbd1a5,host='devstack@QuobyteHD#QuobyteHD',id=8d35bb45-33ca-4a61-9359-8526258cbbe0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d26c8aeb14fb48af9f90a692d2cd6a85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:56:16Z,use_quota=True,user_id='f6a9346d0d424e35a929bcadc60b51d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85eef76c-362f-421d-970f-6c7368a0704f),volume_type_id=85eef76c-362f-421d-970f-6c7368a0704f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 14:56:16 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-58025af3-ab93-4ff7-8b4a-4a0c706e9249 tempest-GroupSnapshotsV319Test-1883608929 None] Creating volume 8d35bb45-33ca-4a61-9359-8526258cbbe0 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 14:56:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-58025af3-ab93-4ff7-8b4a-4a0c706e9249 tempest-GroupSnapshotsV319Test-1883608929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:56:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-58025af3-ab93-4ff7-8b4a-4a0c706e9249 tempest-GroupSnapshotsV319Test-1883608929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:56:16 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-58025af3-ab93-4ff7-8b4a-4a0c706e9249 tempest-GroupSnapshotsV319Test-1883608929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:56:16 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-58025af3-ab93-4ff7-8b4a-4a0c706e9249 tempest-GroupSnapshotsV319Test-1883608929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:56:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-58025af3-ab93-4ff7-8b4a-4a0c706e9249 tempest-GroupSnapshotsV319Test-1883608929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:56:16 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-58025af3-ab93-4ff7-8b4a-4a0c706e9249 tempest-GroupSnapshotsV319Test-1883608929 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 14:56:16 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-58025af3-ab93-4ff7-8b4a-4a0c706e9249 tempest-GroupSnapshotsV319Test-1883608929 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 14:56:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-58025af3-ab93-4ff7-8b4a-4a0c706e9249 tempest-GroupSnapshotsV319Test-1883608929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8d35bb45-33ca-4a61-9359-8526258cbbe0 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:16 devstack sudo[94205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8d35bb45-33ca-4a61-9359-8526258cbbe0 1073741824 Sep 28 14:56:16 devstack sudo[94205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:16 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:56:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:56:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:56:16 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:56:16 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:56:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:56:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:17 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-99f69f9c-f73a-471c-b13e-77a9ba40ac80 tempest-GroupSnapshotsTest-752462418 None] group_snapshot c0aa9618-5ff4-4b65-936c-b2dda8b43708: created successfully Sep 28 14:56:17 devstack sudo[94209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 14:56:17 devstack sudo[94209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:17 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-013ef216-6c22-4ce6-9f88-dc5199c38cf9 tempest-GroupSnapshotsTest-752462418 None] group_snapshot c0aa9618-5ff4-4b65-936c-b2dda8b43708: deleting Sep 28 14:56:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-013ef216-6c22-4ce6-9f88-dc5199c38cf9 tempest-GroupSnapshotsTest-752462418 None] group_snapshot c0aa9618-5ff4-4b65-936c-b2dda8b43708: deleting {{(pid=87116) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 14:56:17 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-013ef216-6c22-4ce6-9f88-dc5199c38cf9 tempest-GroupSnapshotsTest-752462418 None] Acquiring lock "cinder-quobyte-c882b1e9-e730-40ee-99e5-dfb9705e5eca" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:56:17 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-013ef216-6c22-4ce6-9f88-dc5199c38cf9 tempest-GroupSnapshotsTest-752462418 None] Lock "cinder-quobyte-c882b1e9-e730-40ee-99e5-dfb9705e5eca" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:56:17 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-013ef216-6c22-4ce6-9f88-dc5199c38cf9 tempest-GroupSnapshotsTest-752462418 None] Acquiring lock "cinder-quobyte-23cbea61-34bc-42b6-8ca4-503f1b7922ff" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:56:17 devstack sudo[94209]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.611s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:17 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:56:17 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-013ef216-6c22-4ce6-9f88-dc5199c38cf9 tempest-GroupSnapshotsTest-752462418 None] Lock "cinder-quobyte-23cbea61-34bc-42b6-8ca4-503f1b7922ff" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:56:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-013ef216-6c22-4ce6-9f88-dc5199c38cf9 tempest-GroupSnapshotsTest-752462418 None] Deleting offline snapshot 23cbea61-34bc-42b6-8ca4-503f1b7922ff of volume c882b1e9-e730-40ee-99e5-dfb9705e5eca {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 14:56:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-013ef216-6c22-4ce6-9f88-dc5199c38cf9 tempest-GroupSnapshotsTest-752462418 None] snapshot_file for this snap is: volume-c882b1e9-e730-40ee-99e5-dfb9705e5eca.23cbea61-34bc-42b6-8ca4-503f1b7922ff {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 14:56:17 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running periodic task VolumeManager._thread_info {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:56:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] thread count: 8 {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 14:56:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] thread info: [<_MainThread(MainThread, started 135146735652992)>, , , , , , , ] {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 14:56:17 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9a3c7a-9574-4c32-993c-5e824ca50d52]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:56:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-013ef216-6c22-4ce6-9f88-dc5199c38cf9 tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c882b1e9-e730-40ee-99e5-dfb9705e5eca.23cbea61-34bc-42b6-8ca4-503f1b7922ff {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:17 devstack sudo[94205]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-58025af3-ab93-4ff7-8b4a-4a0c706e9249 tempest-GroupSnapshotsV319Test-1883608929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8d35bb45-33ca-4a61-9359-8526258cbbe0 1073741824" returned: 0 in 1.162s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-58025af3-ab93-4ff7-8b4a-4a0c706e9249 tempest-GroupSnapshotsV319Test-1883608929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8d35bb45-33ca-4a61-9359-8526258cbbe0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:18 devstack sudo[94216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c882b1e9-e730-40ee-99e5-dfb9705e5eca.23cbea61-34bc-42b6-8ca4-503f1b7922ff Sep 28 14:56:18 devstack sudo[94216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:18 devstack sudo[94217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8d35bb45-33ca-4a61-9359-8526258cbbe0 Sep 28 14:56:18 devstack sudo[94217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:18 devstack sudo[94217]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-58025af3-ab93-4ff7-8b4a-4a0c706e9249 tempest-GroupSnapshotsV319Test-1883608929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8d35bb45-33ca-4a61-9359-8526258cbbe0" returned: 0 in 0.578s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-58025af3-ab93-4ff7-8b4a-4a0c706e9249 tempest-GroupSnapshotsV319Test-1883608929 None] <== create_volume: return (1874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 14:56:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-58025af3-ab93-4ff7-8b4a-4a0c706e9249 tempest-GroupSnapshotsV319Test-1883608929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.879s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:56:18 devstack sudo[94216]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-013ef216-6c22-4ce6-9f88-dc5199c38cf9 tempest-GroupSnapshotsTest-752462418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c882b1e9-e730-40ee-99e5-dfb9705e5eca.23cbea61-34bc-42b6-8ca4-503f1b7922ff" returned: 0 in 0.846s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-013ef216-6c22-4ce6-9f88-dc5199c38cf9 tempest-GroupSnapshotsTest-752462418 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c882b1e9-e730-40ee-99e5-dfb9705e5eca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 14:56:18 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47ac9af-1b3e-4c43-8cbe-a8ef577d93f6]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:56:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-013ef216-6c22-4ce6-9f88-dc5199c38cf9 tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c882b1e9-e730-40ee-99e5-dfb9705e5eca {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-58025af3-ab93-4ff7-8b4a-4a0c706e9249 tempest-GroupSnapshotsV319Test-1883608929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44aba7f3-37e8-4d2c-9760-c50d7318fc96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d35bb45-33ca-4a61-9359-8526258cbbe0', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:56:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-58025af3-ab93-4ff7-8b4a-4a0c706e9249 tempest-GroupSnapshotsV319Test-1883608929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0397699f-84c5-4f5a-b3f5-987ac0502895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:56:18 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-58025af3-ab93-4ff7-8b4a-4a0c706e9249 tempest-GroupSnapshotsV319Test-1883608929 None] Volume volume-8d35bb45-33ca-4a61-9359-8526258cbbe0 (8d35bb45-33ca-4a61-9359-8526258cbbe0): created successfully Sep 28 14:56:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-58025af3-ab93-4ff7-8b4a-4a0c706e9249 tempest-GroupSnapshotsV319Test-1883608929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0397699f-84c5-4f5a-b3f5-987ac0502895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:56:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-58025af3-ab93-4ff7-8b4a-4a0c706e9249 tempest-GroupSnapshotsV319Test-1883608929 None] Flow 'volume_create_manager' (f0491c0c-fdfe-4e4c-bcc3-b57ba4a8308a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:56:18 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-58025af3-ab93-4ff7-8b4a-4a0c706e9249 tempest-GroupSnapshotsV319Test-1883608929 None] Created volume successfully. Sep 28 14:56:18 devstack sudo[94224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c882b1e9-e730-40ee-99e5-dfb9705e5eca Sep 28 14:56:18 devstack sudo[94224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:19 devstack sudo[94224]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-013ef216-6c22-4ce6-9f88-dc5199c38cf9 tempest-GroupSnapshotsTest-752462418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c882b1e9-e730-40ee-99e5-dfb9705e5eca" returned: 0 in 0.439s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-013ef216-6c22-4ce6-9f88-dc5199c38cf9 tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c882b1e9-e730-40ee-99e5-dfb9705e5eca.23cbea61-34bc-42b6-8ca4-503f1b7922ff {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:19 devstack sudo[94229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c882b1e9-e730-40ee-99e5-dfb9705e5eca.23cbea61-34bc-42b6-8ca4-503f1b7922ff Sep 28 14:56:19 devstack sudo[94229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:19 devstack sudo[94229]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-013ef216-6c22-4ce6-9f88-dc5199c38cf9 tempest-GroupSnapshotsTest-752462418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c882b1e9-e730-40ee-99e5-dfb9705e5eca.23cbea61-34bc-42b6-8ca4-503f1b7922ff" returned: 0 in 0.363s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-013ef216-6c22-4ce6-9f88-dc5199c38cf9 tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c882b1e9-e730-40ee-99e5-dfb9705e5eca.23cbea61-34bc-42b6-8ca4-503f1b7922ff {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:19 devstack sudo[94235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c882b1e9-e730-40ee-99e5-dfb9705e5eca.23cbea61-34bc-42b6-8ca4-503f1b7922ff Sep 28 14:56:19 devstack sudo[94235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:19 devstack sudo[94235]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-013ef216-6c22-4ce6-9f88-dc5199c38cf9 tempest-GroupSnapshotsTest-752462418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c882b1e9-e730-40ee-99e5-dfb9705e5eca.23cbea61-34bc-42b6-8ca4-503f1b7922ff" returned: 0 in 0.293s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:19 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-013ef216-6c22-4ce6-9f88-dc5199c38cf9 tempest-GroupSnapshotsTest-752462418 None] Lock "cinder-quobyte-23cbea61-34bc-42b6-8ca4-503f1b7922ff" released by "_delete_snapshot" :: held 2.120s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:56:19 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-013ef216-6c22-4ce6-9f88-dc5199c38cf9 tempest-GroupSnapshotsTest-752462418 None] Lock "cinder-quobyte-c882b1e9-e730-40ee-99e5-dfb9705e5eca" released by "delete_snapshot" :: held 2.183s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:56:19 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-013ef216-6c22-4ce6-9f88-dc5199c38cf9 tempest-GroupSnapshotsTest-752462418 None] Acquiring lock "cinder-quobyte-8f4eb23c-f661-447a-b2b0-caf40344f29d" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:56:19 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-013ef216-6c22-4ce6-9f88-dc5199c38cf9 tempest-GroupSnapshotsTest-752462418 None] Lock "cinder-quobyte-8f4eb23c-f661-447a-b2b0-caf40344f29d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:56:19 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-013ef216-6c22-4ce6-9f88-dc5199c38cf9 tempest-GroupSnapshotsTest-752462418 None] Acquiring lock "cinder-quobyte-6600e90e-9c65-4e7f-b12f-d2925ced2e10" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:56:19 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-013ef216-6c22-4ce6-9f88-dc5199c38cf9 tempest-GroupSnapshotsTest-752462418 None] Lock "cinder-quobyte-6600e90e-9c65-4e7f-b12f-d2925ced2e10" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:56:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-013ef216-6c22-4ce6-9f88-dc5199c38cf9 tempest-GroupSnapshotsTest-752462418 None] Deleting offline snapshot 6600e90e-9c65-4e7f-b12f-d2925ced2e10 of volume 8f4eb23c-f661-447a-b2b0-caf40344f29d {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 14:56:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-013ef216-6c22-4ce6-9f88-dc5199c38cf9 tempest-GroupSnapshotsTest-752462418 None] snapshot_file for this snap is: volume-8f4eb23c-f661-447a-b2b0-caf40344f29d.6600e90e-9c65-4e7f-b12f-d2925ced2e10 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 14:56:19 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[6faf9008-a595-42ed-968e-8dc5ee85eac7]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:56:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-013ef216-6c22-4ce6-9f88-dc5199c38cf9 tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8f4eb23c-f661-447a-b2b0-caf40344f29d.6600e90e-9c65-4e7f-b12f-d2925ced2e10 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:20 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-bc638d5d-3251-412b-a240-077496492db2 tempest-GroupSnapshotsV319Test-1883608929 None] GroupSnapshot 12101bf3-d394-40f2-97c7-cbf331f8e40a: creating. Sep 28 14:56:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bc638d5d-3251-412b-a240-077496492db2 tempest-GroupSnapshotsV319Test-1883608929 None] Group snapshot 12101bf3-d394-40f2-97c7-cbf331f8e40a: creating. {{(pid=87116) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 14:56:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bc638d5d-3251-412b-a240-077496492db2 tempest-GroupSnapshotsV319Test-1883608929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:56:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bc638d5d-3251-412b-a240-077496492db2 tempest-GroupSnapshotsV319Test-1883608929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:56:20 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-bc638d5d-3251-412b-a240-077496492db2 tempest-GroupSnapshotsV319Test-1883608929 None] Creating offline snapshot 2adc0a57-1054-4e4c-b272-7c55aab901b0 of volume 8d35bb45-33ca-4a61-9359-8526258cbbe0 {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 14:56:20 devstack sudo[94240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8f4eb23c-f661-447a-b2b0-caf40344f29d.6600e90e-9c65-4e7f-b12f-d2925ced2e10 Sep 28 14:56:20 devstack sudo[94240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:20 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f76c652-21f8-4cc7-a0c4-d3b64555fe7f]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:56:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bc638d5d-3251-412b-a240-077496492db2 tempest-GroupSnapshotsV319Test-1883608929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8d35bb45-33ca-4a61-9359-8526258cbbe0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:20 devstack sudo[94243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8d35bb45-33ca-4a61-9359-8526258cbbe0 Sep 28 14:56:20 devstack sudo[94243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:20 devstack sudo[94240]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-013ef216-6c22-4ce6-9f88-dc5199c38cf9 tempest-GroupSnapshotsTest-752462418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8f4eb23c-f661-447a-b2b0-caf40344f29d.6600e90e-9c65-4e7f-b12f-d2925ced2e10" returned: 0 in 0.597s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:20 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-013ef216-6c22-4ce6-9f88-dc5199c38cf9 tempest-GroupSnapshotsTest-752462418 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f4eb23c-f661-447a-b2b0-caf40344f29d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 14:56:20 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[685d475b-d2ba-417a-affd-3cee9f3c8177]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:56:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-013ef216-6c22-4ce6-9f88-dc5199c38cf9 tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8f4eb23c-f661-447a-b2b0-caf40344f29d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:20 devstack sudo[94243]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bc638d5d-3251-412b-a240-077496492db2 tempest-GroupSnapshotsV319Test-1883608929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8d35bb45-33ca-4a61-9359-8526258cbbe0" returned: 0 in 0.583s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bc638d5d-3251-412b-a240-077496492db2 tempest-GroupSnapshotsV319Test-1883608929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8d35bb45-33ca-4a61-9359-8526258cbbe0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8d35bb45-33ca-4a61-9359-8526258cbbe0.2adc0a57-1054-4e4c-b272-7c55aab901b0 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:20 devstack sudo[94252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8d35bb45-33ca-4a61-9359-8526258cbbe0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8d35bb45-33ca-4a61-9359-8526258cbbe0.2adc0a57-1054-4e4c-b272-7c55aab901b0 1G Sep 28 14:56:20 devstack sudo[94252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:20 devstack sudo[94248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8f4eb23c-f661-447a-b2b0-caf40344f29d Sep 28 14:56:20 devstack sudo[94248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:21 devstack sudo[94248]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-013ef216-6c22-4ce6-9f88-dc5199c38cf9 tempest-GroupSnapshotsTest-752462418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8f4eb23c-f661-447a-b2b0-caf40344f29d" returned: 0 in 0.539s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-013ef216-6c22-4ce6-9f88-dc5199c38cf9 tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8f4eb23c-f661-447a-b2b0-caf40344f29d.6600e90e-9c65-4e7f-b12f-d2925ced2e10 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:21 devstack sudo[94262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8f4eb23c-f661-447a-b2b0-caf40344f29d.6600e90e-9c65-4e7f-b12f-d2925ced2e10 Sep 28 14:56:21 devstack sudo[94262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:21 devstack sudo[94252]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bc638d5d-3251-412b-a240-077496492db2 tempest-GroupSnapshotsV319Test-1883608929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8d35bb45-33ca-4a61-9359-8526258cbbe0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8d35bb45-33ca-4a61-9359-8526258cbbe0.2adc0a57-1054-4e4c-b272-7c55aab901b0 1G" returned: 0 in 0.605s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bc638d5d-3251-412b-a240-077496492db2 tempest-GroupSnapshotsV319Test-1883608929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d35bb45-33ca-4a61-9359-8526258cbbe0 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8d35bb45-33ca-4a61-9359-8526258cbbe0.2adc0a57-1054-4e4c-b272-7c55aab901b0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:21 devstack sudo[94266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d35bb45-33ca-4a61-9359-8526258cbbe0 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8d35bb45-33ca-4a61-9359-8526258cbbe0.2adc0a57-1054-4e4c-b272-7c55aab901b0 Sep 28 14:56:21 devstack sudo[94266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:21 devstack sudo[94262]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-013ef216-6c22-4ce6-9f88-dc5199c38cf9 tempest-GroupSnapshotsTest-752462418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8f4eb23c-f661-447a-b2b0-caf40344f29d.6600e90e-9c65-4e7f-b12f-d2925ced2e10" returned: 0 in 0.539s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-013ef216-6c22-4ce6-9f88-dc5199c38cf9 tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8f4eb23c-f661-447a-b2b0-caf40344f29d.6600e90e-9c65-4e7f-b12f-d2925ced2e10 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:21 devstack sudo[94279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8f4eb23c-f661-447a-b2b0-caf40344f29d.6600e90e-9c65-4e7f-b12f-d2925ced2e10 Sep 28 14:56:21 devstack sudo[94279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:21 devstack sudo[94266]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bc638d5d-3251-412b-a240-077496492db2 tempest-GroupSnapshotsV319Test-1883608929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d35bb45-33ca-4a61-9359-8526258cbbe0 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8d35bb45-33ca-4a61-9359-8526258cbbe0.2adc0a57-1054-4e4c-b272-7c55aab901b0" returned: 0 in 0.384s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:21 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-bc638d5d-3251-412b-a240-077496492db2 tempest-GroupSnapshotsV319Test-1883608929 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8d35bb45-33ca-4a61-9359-8526258cbbe0.2adc0a57-1054-4e4c-b272-7c55aab901b0 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 14:56:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bc638d5d-3251-412b-a240-077496492db2 tempest-GroupSnapshotsV319Test-1883608929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8d35bb45-33ca-4a61-9359-8526258cbbe0.2adc0a57-1054-4e4c-b272-7c55aab901b0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:21 devstack sudo[94283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8d35bb45-33ca-4a61-9359-8526258cbbe0.2adc0a57-1054-4e4c-b272-7c55aab901b0 Sep 28 14:56:21 devstack sudo[94283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:21 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-87331f24-f7a4-4e80-8164-8dacdfc3025b req-6777b02c-4114-4927-a1da-058e33bda002 tempest-ServerActionsTestOtherA-1078904851 None] Terminate volume connection completed successfully. Sep 28 14:56:21 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-87331f24-f7a4-4e80-8164-8dacdfc3025b req-6777b02c-4114-4927-a1da-058e33bda002 tempest-ServerActionsTestOtherA-1078904851 None] Deleting attachment e2ca0e09-001a-4e66-ab02-fd9a2489aca9. {{(pid=87116) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 14:56:21 devstack sudo[94279]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-013ef216-6c22-4ce6-9f88-dc5199c38cf9 tempest-GroupSnapshotsTest-752462418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8f4eb23c-f661-447a-b2b0-caf40344f29d.6600e90e-9c65-4e7f-b12f-d2925ced2e10" returned: 0 in 0.378s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:22 devstack sudo[94283]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bc638d5d-3251-412b-a240-077496492db2 tempest-GroupSnapshotsV319Test-1883608929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8d35bb45-33ca-4a61-9359-8526258cbbe0.2adc0a57-1054-4e4c-b272-7c55aab901b0" returned: 0 in 0.316s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:22 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-013ef216-6c22-4ce6-9f88-dc5199c38cf9 tempest-GroupSnapshotsTest-752462418 None] Lock "cinder-quobyte-6600e90e-9c65-4e7f-b12f-d2925ced2e10" released by "_delete_snapshot" :: held 2.205s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:56:22 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-013ef216-6c22-4ce6-9f88-dc5199c38cf9 tempest-GroupSnapshotsTest-752462418 None] Lock "cinder-quobyte-8f4eb23c-f661-447a-b2b0-caf40344f29d" released by "delete_snapshot" :: held 2.259s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:56:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bc638d5d-3251-412b-a240-077496492db2 tempest-GroupSnapshotsV319Test-1883608929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8d35bb45-33ca-4a61-9359-8526258cbbe0.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:22 devstack sudo[94289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8d35bb45-33ca-4a61-9359-8526258cbbe0.info Sep 28 14:56:22 devstack sudo[94289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:22 devstack cinder-volume[87116]: WARNING cinder.quota [None req-013ef216-6c22-4ce6-9f88-dc5199c38cf9 tempest-GroupSnapshotsTest-752462418 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1469366580 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1469366580, it is now deprecated. Please use the default quota class for default quota. Sep 28 14:56:22 devstack cinder-volume[87116]: WARNING cinder.quota [None req-013ef216-6c22-4ce6-9f88-dc5199c38cf9 tempest-GroupSnapshotsTest-752462418 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1469366580 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1469366580, it is now deprecated. Please use the default quota class for default quota. Sep 28 14:56:22 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-013ef216-6c22-4ce6-9f88-dc5199c38cf9 tempest-GroupSnapshotsTest-752462418 None] Created reservations ['a861a601-235b-456d-a20f-c09996fd5c5f', '82d7f33f-a92f-4f31-91fc-d0e9ce4b7b5f', '07e66310-4bdd-48ab-ac95-616967133edc', '4baa82e3-7a41-4140-8ebb-6aa5ecd10d6a'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 14:56:22 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-013ef216-6c22-4ce6-9f88-dc5199c38cf9 tempest-GroupSnapshotsTest-752462418 None] Created reservations ['c72e9ecb-4f8c-4184-a8ec-4a93fbaf6da9', '53ea5f76-e772-4796-9d28-cbfb6ff6fe6c', '7001e498-89c4-43ee-a4a3-8db5f305eee3', '69378498-0c18-4a1d-b85f-54f1373d7d81'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 14:56:22 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-013ef216-6c22-4ce6-9f88-dc5199c38cf9 tempest-GroupSnapshotsTest-752462418 None] group_snapshot c0aa9618-5ff4-4b65-936c-b2dda8b43708: deleted successfully Sep 28 14:56:22 devstack sudo[94289]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bc638d5d-3251-412b-a240-077496492db2 tempest-GroupSnapshotsV319Test-1883608929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8d35bb45-33ca-4a61-9359-8526258cbbe0.info" returned: 0 in 0.430s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:22 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-bc638d5d-3251-412b-a240-077496492db2 tempest-GroupSnapshotsV319Test-1883608929 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8d35bb45-33ca-4a61-9359-8526258cbbe0.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 14:56:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bc638d5d-3251-412b-a240-077496492db2 tempest-GroupSnapshotsV319Test-1883608929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8d35bb45-33ca-4a61-9359-8526258cbbe0.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:22 devstack sudo[94292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8d35bb45-33ca-4a61-9359-8526258cbbe0.info Sep 28 14:56:22 devstack sudo[94292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:23 devstack sudo[94292]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bc638d5d-3251-412b-a240-077496492db2 tempest-GroupSnapshotsV319Test-1883608929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8d35bb45-33ca-4a61-9359-8526258cbbe0.info" returned: 0 in 0.493s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bc638d5d-3251-412b-a240-077496492db2 tempest-GroupSnapshotsV319Test-1883608929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.955s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:56:23 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-bc638d5d-3251-412b-a240-077496492db2 tempest-GroupSnapshotsV319Test-1883608929 None] group_snapshot 12101bf3-d394-40f2-97c7-cbf331f8e40a: created successfully Sep 28 14:56:23 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1fd16c12-6764-4dc5-a5f8-c27a4030f4ab tempest-GroupSnapshotsTest-752462418 None] Acquiring lock "cinder-quobyte-8f4eb23c-f661-447a-b2b0-caf40344f29d" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:56:23 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1fd16c12-6764-4dc5-a5f8-c27a4030f4ab tempest-GroupSnapshotsTest-752462418 None] Lock "cinder-quobyte-8f4eb23c-f661-447a-b2b0-caf40344f29d" acquired by "delete_volume" :: waited 0.029s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:56:23 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8e4d26-e8c5-4d1f-8f3f-963fa3aacaeb]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:56:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1fd16c12-6764-4dc5-a5f8-c27a4030f4ab tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8f4eb23c-f661-447a-b2b0-caf40344f29d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:23 devstack sudo[94323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8f4eb23c-f661-447a-b2b0-caf40344f29d Sep 28 14:56:23 devstack sudo[94323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:24 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-57c76d75-3b20-4bf1-b937-ae79cc5a74b5 tempest-GroupSnapshotsV319Test-1883608929 None] group_snapshot 12101bf3-d394-40f2-97c7-cbf331f8e40a: deleting Sep 28 14:56:24 devstack sudo[94323]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1fd16c12-6764-4dc5-a5f8-c27a4030f4ab tempest-GroupSnapshotsTest-752462418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8f4eb23c-f661-447a-b2b0-caf40344f29d" returned: 0 in 1.090s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1fd16c12-6764-4dc5-a5f8-c27a4030f4ab tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8f4eb23c-f661-447a-b2b0-caf40344f29d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:24 devstack sudo[94364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8f4eb23c-f661-447a-b2b0-caf40344f29d Sep 28 14:56:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-57c76d75-3b20-4bf1-b937-ae79cc5a74b5 tempest-GroupSnapshotsV319Test-1883608929 None] group_snapshot 12101bf3-d394-40f2-97c7-cbf331f8e40a: deleting {{(pid=87116) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 14:56:24 devstack sudo[94364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:24 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-57c76d75-3b20-4bf1-b937-ae79cc5a74b5 tempest-GroupSnapshotsV319Test-1883608929 None] Acquiring lock "cinder-quobyte-8d35bb45-33ca-4a61-9359-8526258cbbe0" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:56:24 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-57c76d75-3b20-4bf1-b937-ae79cc5a74b5 tempest-GroupSnapshotsV319Test-1883608929 None] Lock "cinder-quobyte-8d35bb45-33ca-4a61-9359-8526258cbbe0" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:56:24 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-57c76d75-3b20-4bf1-b937-ae79cc5a74b5 tempest-GroupSnapshotsV319Test-1883608929 None] Acquiring lock "cinder-quobyte-2adc0a57-1054-4e4c-b272-7c55aab901b0" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:56:24 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-57c76d75-3b20-4bf1-b937-ae79cc5a74b5 tempest-GroupSnapshotsV319Test-1883608929 None] Lock "cinder-quobyte-2adc0a57-1054-4e4c-b272-7c55aab901b0" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:56:24 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-57c76d75-3b20-4bf1-b937-ae79cc5a74b5 tempest-GroupSnapshotsV319Test-1883608929 None] Deleting offline snapshot 2adc0a57-1054-4e4c-b272-7c55aab901b0 of volume 8d35bb45-33ca-4a61-9359-8526258cbbe0 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 14:56:24 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-57c76d75-3b20-4bf1-b937-ae79cc5a74b5 tempest-GroupSnapshotsV319Test-1883608929 None] snapshot_file for this snap is: volume-8d35bb45-33ca-4a61-9359-8526258cbbe0.2adc0a57-1054-4e4c-b272-7c55aab901b0 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 14:56:24 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e1e1dc-2452-40c1-a821-318a4b024aea]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:56:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-57c76d75-3b20-4bf1-b937-ae79cc5a74b5 tempest-GroupSnapshotsV319Test-1883608929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8d35bb45-33ca-4a61-9359-8526258cbbe0.2adc0a57-1054-4e4c-b272-7c55aab901b0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:25 devstack sudo[94366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8d35bb45-33ca-4a61-9359-8526258cbbe0.2adc0a57-1054-4e4c-b272-7c55aab901b0 Sep 28 14:56:25 devstack sudo[94366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:25 devstack sudo[94364]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1fd16c12-6764-4dc5-a5f8-c27a4030f4ab tempest-GroupSnapshotsTest-752462418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8f4eb23c-f661-447a-b2b0-caf40344f29d" returned: 0 in 0.545s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:25 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1fd16c12-6764-4dc5-a5f8-c27a4030f4ab tempest-GroupSnapshotsTest-752462418 None] Lock "cinder-quobyte-8f4eb23c-f661-447a-b2b0-caf40344f29d" released by "delete_volume" :: held 1.910s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:56:25 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1fd16c12-6764-4dc5-a5f8-c27a4030f4ab tempest-GroupSnapshotsTest-752462418 None] Acquiring lock "cinder-quobyte-c882b1e9-e730-40ee-99e5-dfb9705e5eca" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:56:25 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1fd16c12-6764-4dc5-a5f8-c27a4030f4ab tempest-GroupSnapshotsTest-752462418 None] Lock "cinder-quobyte-c882b1e9-e730-40ee-99e5-dfb9705e5eca" acquired by "delete_volume" :: waited 0.026s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:56:25 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e0ed94-8163-40af-89ce-f4b26303a3ae]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:56:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1fd16c12-6764-4dc5-a5f8-c27a4030f4ab tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c882b1e9-e730-40ee-99e5-dfb9705e5eca {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:25 devstack sudo[94369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c882b1e9-e730-40ee-99e5-dfb9705e5eca Sep 28 14:56:25 devstack sudo[94369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:25 devstack sudo[94366]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-57c76d75-3b20-4bf1-b937-ae79cc5a74b5 tempest-GroupSnapshotsV319Test-1883608929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8d35bb45-33ca-4a61-9359-8526258cbbe0.2adc0a57-1054-4e4c-b272-7c55aab901b0" returned: 0 in 0.639s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:25 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-57c76d75-3b20-4bf1-b937-ae79cc5a74b5 tempest-GroupSnapshotsV319Test-1883608929 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d35bb45-33ca-4a61-9359-8526258cbbe0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 14:56:25 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d41449-be31-4e26-b7c9-023f39534d5d]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:56:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-57c76d75-3b20-4bf1-b937-ae79cc5a74b5 tempest-GroupSnapshotsV319Test-1883608929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8d35bb45-33ca-4a61-9359-8526258cbbe0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:25 devstack sudo[94375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8d35bb45-33ca-4a61-9359-8526258cbbe0 Sep 28 14:56:25 devstack sudo[94375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:26 devstack sudo[94369]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1fd16c12-6764-4dc5-a5f8-c27a4030f4ab tempest-GroupSnapshotsTest-752462418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c882b1e9-e730-40ee-99e5-dfb9705e5eca" returned: 0 in 0.753s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1fd16c12-6764-4dc5-a5f8-c27a4030f4ab tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c882b1e9-e730-40ee-99e5-dfb9705e5eca {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:26 devstack sudo[94383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c882b1e9-e730-40ee-99e5-dfb9705e5eca Sep 28 14:56:26 devstack sudo[94383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:26 devstack sudo[94375]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-57c76d75-3b20-4bf1-b937-ae79cc5a74b5 tempest-GroupSnapshotsV319Test-1883608929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8d35bb45-33ca-4a61-9359-8526258cbbe0" returned: 0 in 0.787s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-57c76d75-3b20-4bf1-b937-ae79cc5a74b5 tempest-GroupSnapshotsV319Test-1883608929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8d35bb45-33ca-4a61-9359-8526258cbbe0.2adc0a57-1054-4e4c-b272-7c55aab901b0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:26 devstack sudo[94391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8d35bb45-33ca-4a61-9359-8526258cbbe0.2adc0a57-1054-4e4c-b272-7c55aab901b0 Sep 28 14:56:26 devstack sudo[94391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:26 devstack sudo[94383]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1fd16c12-6764-4dc5-a5f8-c27a4030f4ab tempest-GroupSnapshotsTest-752462418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c882b1e9-e730-40ee-99e5-dfb9705e5eca" returned: 0 in 0.397s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1fd16c12-6764-4dc5-a5f8-c27a4030f4ab tempest-GroupSnapshotsTest-752462418 None] Lock "cinder-quobyte-c882b1e9-e730-40ee-99e5-dfb9705e5eca" released by "delete_volume" :: held 1.232s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:56:26 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-1fd16c12-6764-4dc5-a5f8-c27a4030f4ab tempest-GroupSnapshotsTest-752462418 None] Created reservations ['816f26a6-19f9-4e03-96bf-6b938bf64ca0'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 14:56:26 devstack cinder-volume[87116]: WARNING cinder.quota [None req-1fd16c12-6764-4dc5-a5f8-c27a4030f4ab tempest-GroupSnapshotsTest-752462418 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1469366580 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1469366580, it is now deprecated. Please use the default quota class for default quota. Sep 28 14:56:26 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-1fd16c12-6764-4dc5-a5f8-c27a4030f4ab tempest-GroupSnapshotsTest-752462418 None] Created reservations ['361d7481-1301-47b1-b887-ba37052d01c8', '8d628e8d-7126-4a99-a3be-6540af952b2d', 'e817d807-3ad2-4e09-8d84-8ea8da694ed5', '8ddf9517-cb44-48f8-b526-0c5a82894ebd'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 14:56:26 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-1fd16c12-6764-4dc5-a5f8-c27a4030f4ab tempest-GroupSnapshotsTest-752462418 None] Created reservations ['7c16fd50-f249-4a99-9d77-1f7c3305eb1d', 'ed5be7a1-5319-45bd-8d40-f3593a3bf97d', '5830527a-de52-492c-ba7f-72c776d70027', '25fa0378-4b0c-446e-b7ad-f2a0e03e8926'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 14:56:26 devstack sudo[94391]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-57c76d75-3b20-4bf1-b937-ae79cc5a74b5 tempest-GroupSnapshotsV319Test-1883608929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8d35bb45-33ca-4a61-9359-8526258cbbe0.2adc0a57-1054-4e4c-b272-7c55aab901b0" returned: 0 in 0.533s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-57c76d75-3b20-4bf1-b937-ae79cc5a74b5 tempest-GroupSnapshotsV319Test-1883608929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8d35bb45-33ca-4a61-9359-8526258cbbe0.2adc0a57-1054-4e4c-b272-7c55aab901b0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:26 devstack sudo[94396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8d35bb45-33ca-4a61-9359-8526258cbbe0.2adc0a57-1054-4e4c-b272-7c55aab901b0 Sep 28 14:56:26 devstack sudo[94396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1fd16c12-6764-4dc5-a5f8-c27a4030f4ab tempest-GroupSnapshotsTest-752462418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:56:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1fd16c12-6764-4dc5-a5f8-c27a4030f4ab tempest-GroupSnapshotsTest-752462418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:56:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1fd16c12-6764-4dc5-a5f8-c27a4030f4ab tempest-GroupSnapshotsTest-752462418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:56:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1fd16c12-6764-4dc5-a5f8-c27a4030f4ab tempest-GroupSnapshotsTest-752462418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:56:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1fd16c12-6764-4dc5-a5f8-c27a4030f4ab tempest-GroupSnapshotsTest-752462418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:56:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1fd16c12-6764-4dc5-a5f8-c27a4030f4ab tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:27 devstack sudo[94398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 14:56:27 devstack sudo[94398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:27 devstack sudo[94396]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-57c76d75-3b20-4bf1-b937-ae79cc5a74b5 tempest-GroupSnapshotsV319Test-1883608929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8d35bb45-33ca-4a61-9359-8526258cbbe0.2adc0a57-1054-4e4c-b272-7c55aab901b0" returned: 0 in 0.375s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:27 devstack sudo[94398]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1fd16c12-6764-4dc5-a5f8-c27a4030f4ab tempest-GroupSnapshotsTest-752462418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.351s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:27 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-1fd16c12-6764-4dc5-a5f8-c27a4030f4ab tempest-GroupSnapshotsTest-752462418 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:56:27 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-57c76d75-3b20-4bf1-b937-ae79cc5a74b5 tempest-GroupSnapshotsV319Test-1883608929 None] Lock "cinder-quobyte-2adc0a57-1054-4e4c-b272-7c55aab901b0" released by "_delete_snapshot" :: held 2.567s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:56:27 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-1fd16c12-6764-4dc5-a5f8-c27a4030f4ab tempest-GroupSnapshotsTest-752462418 None] Delete group completed successfully. Sep 28 14:56:27 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-57c76d75-3b20-4bf1-b937-ae79cc5a74b5 tempest-GroupSnapshotsV319Test-1883608929 None] Lock "cinder-quobyte-8d35bb45-33ca-4a61-9359-8526258cbbe0" released by "delete_snapshot" :: held 2.626s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:56:27 devstack cinder-volume[87116]: WARNING cinder.quota [None req-57c76d75-3b20-4bf1-b937-ae79cc5a74b5 tempest-GroupSnapshotsV319Test-1883608929 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1550721842 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1550721842, it is now deprecated. Please use the default quota class for default quota. Sep 28 14:56:27 devstack cinder-volume[87116]: WARNING cinder.quota [None req-57c76d75-3b20-4bf1-b937-ae79cc5a74b5 tempest-GroupSnapshotsV319Test-1883608929 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1550721842 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1550721842, it is now deprecated. Please use the default quota class for default quota. Sep 28 14:56:27 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-57c76d75-3b20-4bf1-b937-ae79cc5a74b5 tempest-GroupSnapshotsV319Test-1883608929 None] Created reservations ['9583cb02-3ea6-4df8-8904-999a172173a9', '21e9ee4e-1f93-4706-858f-b4a19bd0597d', 'c7b1826c-250f-48e3-b87f-134093852511', '890e5fe9-0e1e-48a5-83c6-c46b3b2d3b79'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 14:56:27 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-57c76d75-3b20-4bf1-b937-ae79cc5a74b5 tempest-GroupSnapshotsV319Test-1883608929 None] group_snapshot 12101bf3-d394-40f2-97c7-cbf331f8e40a: deleted successfully Sep 28 14:56:28 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-8c83287f-1dac-4801-97d4-b8f2d9f044e0 tempest-GroupSnapshotsTest-752462418 None] Group tempest-GroupSnapshotsTest-Group-665733316: creating Sep 28 14:56:28 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-8c83287f-1dac-4801-97d4-b8f2d9f044e0 tempest-GroupSnapshotsTest-752462418 None] Group tempest-GroupSnapshotsTest-Group-665733316: created successfully Sep 28 14:56:28 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-8c83287f-1dac-4801-97d4-b8f2d9f044e0 tempest-GroupSnapshotsTest-752462418 None] Create group completed successfully. Sep 28 14:56:28 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3998b96b-c605-48cd-bd87-fb402f38a1bc tempest-GroupSnapshotsV319Test-1883608929 None] Acquiring lock "cinder-quobyte-8d35bb45-33ca-4a61-9359-8526258cbbe0" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:56:28 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3998b96b-c605-48cd-bd87-fb402f38a1bc tempest-GroupSnapshotsV319Test-1883608929 None] Lock "cinder-quobyte-8d35bb45-33ca-4a61-9359-8526258cbbe0" acquired by "delete_volume" :: waited 0.034s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:56:28 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5ccf25-09f0-43a6-832c-fdf6a85eed83]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:56:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3998b96b-c605-48cd-bd87-fb402f38a1bc tempest-GroupSnapshotsV319Test-1883608929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8d35bb45-33ca-4a61-9359-8526258cbbe0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:28 devstack sudo[94421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8d35bb45-33ca-4a61-9359-8526258cbbe0 Sep 28 14:56:28 devstack sudo[94421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:29 devstack sudo[94421]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3998b96b-c605-48cd-bd87-fb402f38a1bc tempest-GroupSnapshotsV319Test-1883608929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8d35bb45-33ca-4a61-9359-8526258cbbe0" returned: 0 in 0.495s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3998b96b-c605-48cd-bd87-fb402f38a1bc tempest-GroupSnapshotsV319Test-1883608929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8d35bb45-33ca-4a61-9359-8526258cbbe0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:29 devstack sudo[94427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8d35bb45-33ca-4a61-9359-8526258cbbe0 Sep 28 14:56:29 devstack sudo[94427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:29 devstack sudo[94427]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3998b96b-c605-48cd-bd87-fb402f38a1bc tempest-GroupSnapshotsV319Test-1883608929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8d35bb45-33ca-4a61-9359-8526258cbbe0" returned: 0 in 0.382s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:29 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3998b96b-c605-48cd-bd87-fb402f38a1bc tempest-GroupSnapshotsV319Test-1883608929 None] Lock "cinder-quobyte-8d35bb45-33ca-4a61-9359-8526258cbbe0" released by "delete_volume" :: held 0.990s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:56:29 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-3998b96b-c605-48cd-bd87-fb402f38a1bc tempest-GroupSnapshotsV319Test-1883608929 None] Created reservations ['35804bfd-9f95-4507-bbc3-9b5c635eb2f7'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 14:56:29 devstack cinder-volume[87116]: WARNING cinder.quota [None req-3998b96b-c605-48cd-bd87-fb402f38a1bc tempest-GroupSnapshotsV319Test-1883608929 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1550721842 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1550721842, it is now deprecated. Please use the default quota class for default quota. Sep 28 14:56:29 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-3998b96b-c605-48cd-bd87-fb402f38a1bc tempest-GroupSnapshotsV319Test-1883608929 None] Created reservations ['0100cf23-e1e1-4b5f-a7d1-aa8391db3547', '78997207-90b1-4d8b-9c3e-268ede955b99', '92d057a7-94d8-4486-b96e-2c8ba9b13e13', '48f48f9b-a449-4229-b06d-e5527818950f'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 14:56:29 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-862d7d5f-67c0-4e46-aae6-248ba56632ed tempest-GroupSnapshotsTest-752462418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 14:56:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-862d7d5f-67c0-4e46-aae6-248ba56632ed tempest-GroupSnapshotsTest-752462418 None] Flow 'volume_create_manager' (079744d4-8a74-40f5-9034-0141235bca68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:56:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-862d7d5f-67c0-4e46-aae6-248ba56632ed tempest-GroupSnapshotsTest-752462418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70cbc373-76f4-4bf8-9783-83f17c36fa55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:56:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-862d7d5f-67c0-4e46-aae6-248ba56632ed tempest-GroupSnapshotsTest-752462418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70cbc373-76f4-4bf8-9783-83f17c36fa55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:56:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-720322635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a56f2812-98e2-4a55-9118-b59159dc217a,host='devstack@QuobyteHD#QuobyteHD',id=e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b8305889c98447e947915146fef1e27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:56:30Z,use_quota=True,user_id='5d4257ffa32f41c7b7429885fdcbf312',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de1710c0-c408-4553-a3ac-e8524c1de9fe),volume_type_id=de1710c0-c408-4553-a3ac-e8524c1de9fe)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:56:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-862d7d5f-67c0-4e46-aae6-248ba56632ed tempest-GroupSnapshotsTest-752462418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8002fc4e-4b74-4d9c-880d-a52ecb22a1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:56:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-862d7d5f-67c0-4e46-aae6-248ba56632ed tempest-GroupSnapshotsTest-752462418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8002fc4e-4b74-4d9c-880d-a52ecb22a1a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:56:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-862d7d5f-67c0-4e46-aae6-248ba56632ed tempest-GroupSnapshotsTest-752462418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cef56319-5178-48c8-a2c6-e5f2b0f3bd25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:56:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-862d7d5f-67c0-4e46-aae6-248ba56632ed tempest-GroupSnapshotsTest-752462418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cef56319-5178-48c8-a2c6-e5f2b0f3bd25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976', 'volume_name': 'volume-e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:56:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-862d7d5f-67c0-4e46-aae6-248ba56632ed tempest-GroupSnapshotsTest-752462418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32ad9a6c-d594-4372-a5f5-0f7df4e14d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:56:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-862d7d5f-67c0-4e46-aae6-248ba56632ed tempest-GroupSnapshotsTest-752462418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32ad9a6c-d594-4372-a5f5-0f7df4e14d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:56:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-862d7d5f-67c0-4e46-aae6-248ba56632ed tempest-GroupSnapshotsTest-752462418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba85d6c2-75d6-4792-bf9e-b5679a5cb223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:56:29 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-862d7d5f-67c0-4e46-aae6-248ba56632ed tempest-GroupSnapshotsTest-752462418 None] Volume e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976', 'volume_size': 1} Sep 28 14:56:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-862d7d5f-67c0-4e46-aae6-248ba56632ed tempest-GroupSnapshotsTest-752462418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:56:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-862d7d5f-67c0-4e46-aae6-248ba56632ed tempest-GroupSnapshotsTest-752462418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:56:29 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-862d7d5f-67c0-4e46-aae6-248ba56632ed tempest-GroupSnapshotsTest-752462418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a56f2812-98e2-4a55-9118-b59159dc217a,created_at=2026-09-28T12:56:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-720322635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a56f2812-98e2-4a55-9118-b59159dc217a,host='devstack@QuobyteHD#QuobyteHD',id=e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b8305889c98447e947915146fef1e27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:56:30Z,use_quota=True,user_id='5d4257ffa32f41c7b7429885fdcbf312',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de1710c0-c408-4553-a3ac-e8524c1de9fe),volume_type_id=de1710c0-c408-4553-a3ac-e8524c1de9fe)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 14:56:29 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-862d7d5f-67c0-4e46-aae6-248ba56632ed tempest-GroupSnapshotsTest-752462418 None] Creating volume e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 14:56:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-862d7d5f-67c0-4e46-aae6-248ba56632ed tempest-GroupSnapshotsTest-752462418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:56:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-862d7d5f-67c0-4e46-aae6-248ba56632ed tempest-GroupSnapshotsTest-752462418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:56:29 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-862d7d5f-67c0-4e46-aae6-248ba56632ed tempest-GroupSnapshotsTest-752462418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:56:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-862d7d5f-67c0-4e46-aae6-248ba56632ed tempest-GroupSnapshotsTest-752462418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:56:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-862d7d5f-67c0-4e46-aae6-248ba56632ed tempest-GroupSnapshotsTest-752462418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:56:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-862d7d5f-67c0-4e46-aae6-248ba56632ed tempest-GroupSnapshotsTest-752462418 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 14:56:30 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-862d7d5f-67c0-4e46-aae6-248ba56632ed tempest-GroupSnapshotsTest-752462418 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 14:56:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-862d7d5f-67c0-4e46-aae6-248ba56632ed tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:30 devstack sudo[94430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976 1073741824 Sep 28 14:56:30 devstack sudo[94430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3998b96b-c605-48cd-bd87-fb402f38a1bc tempest-GroupSnapshotsV319Test-1883608929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:56:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3998b96b-c605-48cd-bd87-fb402f38a1bc tempest-GroupSnapshotsV319Test-1883608929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:56:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3998b96b-c605-48cd-bd87-fb402f38a1bc tempest-GroupSnapshotsV319Test-1883608929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:56:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3998b96b-c605-48cd-bd87-fb402f38a1bc tempest-GroupSnapshotsV319Test-1883608929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:56:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3998b96b-c605-48cd-bd87-fb402f38a1bc tempest-GroupSnapshotsV319Test-1883608929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:56:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3998b96b-c605-48cd-bd87-fb402f38a1bc tempest-GroupSnapshotsV319Test-1883608929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:30 devstack sudo[94433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 14:56:30 devstack sudo[94433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:30 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 14:56:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] Flow 'volume_create_manager' (4fc172fe-7bb7-4d5d-8f35-1f00bde672d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:56:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (057dea82-c123-4b47-90b4-9242a6acc9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:56:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (057dea82-c123-4b47-90b4-9242a6acc9f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2044158384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ab7e1d7-97dc-40ef-9c9d-039faf0615c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f6da66fa0094daf8ab49af063ebe64e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:56:30Z,use_quota=True,user_id='73bb3415cddd4d5e901ce087f4531843',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:56:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c17b111-c126-4d5a-8798-03e5fc1182ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:56:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c17b111-c126-4d5a-8798-03e5fc1182ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:56:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cbcfbef-8b3f-47e4-bb64-4781223a08b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:56:30 devstack cinder-volume[87116]: DEBUG cinder.image.glance [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] Creating Keystone auth plugin from conf {{(pid=87116) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 14:56:30 devstack sudo[94433]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3998b96b-c605-48cd-bd87-fb402f38a1bc tempest-GroupSnapshotsV319Test-1883608929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.291s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:30 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-3998b96b-c605-48cd-bd87-fb402f38a1bc tempest-GroupSnapshotsV319Test-1883608929 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:56:30 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-3998b96b-c605-48cd-bd87-fb402f38a1bc tempest-GroupSnapshotsV319Test-1883608929 None] Delete group completed successfully. Sep 28 14:56:30 devstack sudo[94430]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-862d7d5f-67c0-4e46-aae6-248ba56632ed tempest-GroupSnapshotsTest-752462418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976 1073741824" returned: 0 in 0.563s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-862d7d5f-67c0-4e46-aae6-248ba56632ed tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:30 devstack sudo[94440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976 Sep 28 14:56:30 devstack sudo[94440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cbcfbef-8b3f-47e4-bb64-4781223a08b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5ab7e1d7-97dc-40ef-9c9d-039faf0615c0', 'volume_name': 'volume-5ab7e1d7-97dc-40ef-9c9d-039faf0615c0', 'volume_size': 1, 'image_id': '660a4fad-84c6-40b7-a594-44d16c0701ee', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/660a4fad-84c6-40b7-a594-44d16c0701ee', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca088c9271854d40ba6017d33affee18', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '660a4fad-84c6-40b7-a594-44d16c0701ee', 'created_at': datetime.datetime(2026, 9, 28, 12, 47, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 47, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/660a4fad-84c6-40b7-a594-44d16c0701ee/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:56:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e528f411-5911-4608-ac44-ed2eb5595e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:56:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e528f411-5911-4608-ac44-ed2eb5595e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:56:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dd3c145-6264-47af-a3db-daae84c37703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:56:30 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] Volume 5ab7e1d7-97dc-40ef-9c9d-039faf0615c0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5ab7e1d7-97dc-40ef-9c9d-039faf0615c0', 'volume_size': 1, 'image_id': '660a4fad-84c6-40b7-a594-44d16c0701ee', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/660a4fad-84c6-40b7-a594-44d16c0701ee', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca088c9271854d40ba6017d33affee18', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '660a4fad-84c6-40b7-a594-44d16c0701ee', 'created_at': datetime.datetime(2026, 9, 28, 12, 47, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 47, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/660a4fad-84c6-40b7-a594-44d16c0701ee/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 14:56:30 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] Trying to clone 5ab7e1d7-97dc-40ef-9c9d-039faf0615c0 from image 660a4fad-84c6-40b7-a594-44d16c0701ee at location (None, [{'url': 'file:///opt/stack/data/glance/images/660a4fad-84c6-40b7-a594-44d16c0701ee', 'metadata': {}}]). {{(pid=87116) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 14:56:30 devstack sudo[94440]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-862d7d5f-67c0-4e46-aae6-248ba56632ed tempest-GroupSnapshotsTest-752462418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976" returned: 0 in 0.352s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-862d7d5f-67c0-4e46-aae6-248ba56632ed tempest-GroupSnapshotsTest-752462418 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 14:56:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-862d7d5f-67c0-4e46-aae6-248ba56632ed tempest-GroupSnapshotsTest-752462418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:56:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-862d7d5f-67c0-4e46-aae6-248ba56632ed tempest-GroupSnapshotsTest-752462418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba85d6c2-75d6-4792-bf9e-b5679a5cb223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:56:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-862d7d5f-67c0-4e46-aae6-248ba56632ed tempest-GroupSnapshotsTest-752462418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f99c2e2c-d9f0-4596-b89c-e0e3daa3e5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:56:31 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-862d7d5f-67c0-4e46-aae6-248ba56632ed tempest-GroupSnapshotsTest-752462418 None] Volume volume-e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976 (e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976): created successfully Sep 28 14:56:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-862d7d5f-67c0-4e46-aae6-248ba56632ed tempest-GroupSnapshotsTest-752462418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f99c2e2c-d9f0-4596-b89c-e0e3daa3e5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:56:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-862d7d5f-67c0-4e46-aae6-248ba56632ed tempest-GroupSnapshotsTest-752462418 None] Flow 'volume_create_manager' (079744d4-8a74-40f5-9034-0141235bca68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:56:31 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-862d7d5f-67c0-4e46-aae6-248ba56632ed tempest-GroupSnapshotsTest-752462418 None] Created volume successfully. Sep 28 14:56:31 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_6xitplqydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87116) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 14:56:31 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] Image download 20.69 MB at 20.69 MB/s Sep 28 14:56:31 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba2be47-77ce-4a1f-bdbd-cd5937279381]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:56:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_6xitplqydevstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:31 devstack sudo[94466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_6xitplqydevstack@QuobyteHD Sep 28 14:56:31 devstack sudo[94466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:31 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-eb3edc66-8d06-4cdb-b284-f1a3fce6d00c tempest-GroupSnapshotsTest-752462418 None] GroupSnapshot 305e28e2-314e-4fad-a30a-4c6e46d1ac1a: creating. Sep 28 14:56:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-eb3edc66-8d06-4cdb-b284-f1a3fce6d00c tempest-GroupSnapshotsTest-752462418 None] Group snapshot 305e28e2-314e-4fad-a30a-4c6e46d1ac1a: creating. {{(pid=87116) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 14:56:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-eb3edc66-8d06-4cdb-b284-f1a3fce6d00c tempest-GroupSnapshotsTest-752462418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:56:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-eb3edc66-8d06-4cdb-b284-f1a3fce6d00c tempest-GroupSnapshotsTest-752462418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:56:31 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-eb3edc66-8d06-4cdb-b284-f1a3fce6d00c tempest-GroupSnapshotsTest-752462418 None] Creating offline snapshot 3417c423-157b-4e62-ba87-a3e1a3ef561b of volume e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976 {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 14:56:31 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1fa5f6-7d34-483d-a3bc-1f2c428d7b53]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:56:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-eb3edc66-8d06-4cdb-b284-f1a3fce6d00c tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:31 devstack sudo[94466]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_6xitplqydevstack@QuobyteHD" returned: 0 in 0.472s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:31 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] Temporary image 660a4fad-84c6-40b7-a594-44d16c0701ee is fetched for user 73bb3415cddd4d5e901ce087f4531843. {{(pid=87116) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 14:56:31 devstack sudo[94474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976 Sep 28 14:56:31 devstack sudo[94474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:31 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[519ed49f-c3d2-4107-9d55-b792114ec930]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:56:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_6xitplqydevstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:31 devstack sudo[94480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_6xitplqydevstack@QuobyteHD Sep 28 14:56:31 devstack sudo[94480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:32 devstack sudo[94474]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-eb3edc66-8d06-4cdb-b284-f1a3fce6d00c tempest-GroupSnapshotsTest-752462418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976" returned: 0 in 0.463s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-eb3edc66-8d06-4cdb-b284-f1a3fce6d00c tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976.3417c423-157b-4e62-ba87-a3e1a3ef561b 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:32 devstack sudo[94485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976.3417c423-157b-4e62-ba87-a3e1a3ef561b 1G Sep 28 14:56:32 devstack sudo[94485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:32 devstack sudo[94480]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_6xitplqydevstack@QuobyteHD" returned: 0 in 0.429s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:56:32 devstack sudo[94485]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-eb3edc66-8d06-4cdb-b284-f1a3fce6d00c tempest-GroupSnapshotsTest-752462418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976.3417c423-157b-4e62-ba87-a3e1a3ef561b 1G" returned: 0 in 0.451s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-eb3edc66-8d06-4cdb-b284-f1a3fce6d00c tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976.3417c423-157b-4e62-ba87-a3e1a3ef561b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:32 devstack sudo[94493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976.3417c423-157b-4e62-ba87-a3e1a3ef561b Sep 28 14:56:32 devstack sudo[94493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:32 devstack sudo[94493]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-eb3edc66-8d06-4cdb-b284-f1a3fce6d00c tempest-GroupSnapshotsTest-752462418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976.3417c423-157b-4e62-ba87-a3e1a3ef561b" returned: 0 in 0.326s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:32 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-eb3edc66-8d06-4cdb-b284-f1a3fce6d00c tempest-GroupSnapshotsTest-752462418 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976.3417c423-157b-4e62-ba87-a3e1a3ef561b is being set with open permissions: ugo+rw: NotImplementedError Sep 28 14:56:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-eb3edc66-8d06-4cdb-b284-f1a3fce6d00c tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976.3417c423-157b-4e62-ba87-a3e1a3ef561b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:32 devstack sudo[94499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976.3417c423-157b-4e62-ba87-a3e1a3ef561b Sep 28 14:56:32 devstack sudo[94499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:33 devstack sudo[94499]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-eb3edc66-8d06-4cdb-b284-f1a3fce6d00c tempest-GroupSnapshotsTest-752462418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976.3417c423-157b-4e62-ba87-a3e1a3ef561b" returned: 0 in 0.264s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-eb3edc66-8d06-4cdb-b284-f1a3fce6d00c tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:33 devstack sudo[94502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976.info Sep 28 14:56:33 devstack sudo[94502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:33 devstack sudo[94502]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-eb3edc66-8d06-4cdb-b284-f1a3fce6d00c tempest-GroupSnapshotsTest-752462418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976.info" returned: 0 in 0.266s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:33 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-eb3edc66-8d06-4cdb-b284-f1a3fce6d00c tempest-GroupSnapshotsTest-752462418 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 14:56:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-eb3edc66-8d06-4cdb-b284-f1a3fce6d00c tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:33 devstack sudo[94505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976.info Sep 28 14:56:33 devstack sudo[94505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:33 devstack sudo[94505]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-eb3edc66-8d06-4cdb-b284-f1a3fce6d00c tempest-GroupSnapshotsTest-752462418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976.info" returned: 0 in 0.323s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-eb3edc66-8d06-4cdb-b284-f1a3fce6d00c tempest-GroupSnapshotsTest-752462418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.195s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:56:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.546s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:56:33 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2044158384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ab7e1d7-97dc-40ef-9c9d-039faf0615c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f6da66fa0094daf8ab49af063ebe64e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:56:30Z,use_quota=True,user_id='73bb3415cddd4d5e901ce087f4531843',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 14:56:33 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] Creating volume 5ab7e1d7-97dc-40ef-9c9d-039faf0615c0 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 14:56:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:56:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:56:33 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:56:33 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:56:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:56:33 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 14:56:33 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 14:56:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5ab7e1d7-97dc-40ef-9c9d-039faf0615c0 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:33 devstack sudo[94508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5ab7e1d7-97dc-40ef-9c9d-039faf0615c0 1073741824 Sep 28 14:56:33 devstack sudo[94508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:33 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-eb3edc66-8d06-4cdb-b284-f1a3fce6d00c tempest-GroupSnapshotsTest-752462418 None] group_snapshot 305e28e2-314e-4fad-a30a-4c6e46d1ac1a: created successfully Sep 28 14:56:34 devstack sudo[94508]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5ab7e1d7-97dc-40ef-9c9d-039faf0615c0 1073741824" returned: 0 in 0.469s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5ab7e1d7-97dc-40ef-9c9d-039faf0615c0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:34 devstack sudo[94514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5ab7e1d7-97dc-40ef-9c9d-039faf0615c0 Sep 28 14:56:34 devstack sudo[94514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:34 devstack sudo[94514]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5ab7e1d7-97dc-40ef-9c9d-039faf0615c0" returned: 0 in 0.272s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:34 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 14:56:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:56:34 devstack cinder-volume[87116]: DEBUG cinder.volume.volume_utils [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] Attempting download of 660a4fad-84c6-40b7-a594-44d16c0701ee ((None, [{'url': 'file:///opt/stack/data/glance/images/660a4fad-84c6-40b7-a594-44d16c0701ee', 'metadata': {}}])) to volume 5ab7e1d7-97dc-40ef-9c9d-039faf0615c0. {{(pid=87116) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1208}} Sep 28 14:56:34 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3e484f-6d26-4b71-9361-abbbaba358fb]: (4, 'raw') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:56:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_660a4fad-84c6-40b7-a594-44d16c0701ee_fzls75fg {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:34 devstack sudo[94517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_660a4fad-84c6-40b7-a594-44d16c0701ee_fzls75fg Sep 28 14:56:34 devstack sudo[94517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:35 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-f3412d4a-9854-4c4e-a5cc-aa34764a2ac4 tempest-GroupSnapshotsTest-752462418 None] group_snapshot 305e28e2-314e-4fad-a30a-4c6e46d1ac1a: deleting Sep 28 14:56:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f3412d4a-9854-4c4e-a5cc-aa34764a2ac4 tempest-GroupSnapshotsTest-752462418 None] group_snapshot 305e28e2-314e-4fad-a30a-4c6e46d1ac1a: deleting {{(pid=87116) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 14:56:35 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f3412d4a-9854-4c4e-a5cc-aa34764a2ac4 tempest-GroupSnapshotsTest-752462418 None] Acquiring lock "cinder-quobyte-e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:56:35 devstack sudo[94517]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_660a4fad-84c6-40b7-a594-44d16c0701ee_fzls75fg" returned: 0 in 0.419s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_660a4fad-84c6-40b7-a594-44d16c0701ee_fzls75fg {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:35 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f3412d4a-9854-4c4e-a5cc-aa34764a2ac4 tempest-GroupSnapshotsTest-752462418 None] Lock "cinder-quobyte-e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:56:35 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f3412d4a-9854-4c4e-a5cc-aa34764a2ac4 tempest-GroupSnapshotsTest-752462418 None] Acquiring lock "cinder-quobyte-3417c423-157b-4e62-ba87-a3e1a3ef561b" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:56:35 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f3412d4a-9854-4c4e-a5cc-aa34764a2ac4 tempest-GroupSnapshotsTest-752462418 None] Lock "cinder-quobyte-3417c423-157b-4e62-ba87-a3e1a3ef561b" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:56:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-f3412d4a-9854-4c4e-a5cc-aa34764a2ac4 tempest-GroupSnapshotsTest-752462418 None] Deleting offline snapshot 3417c423-157b-4e62-ba87-a3e1a3ef561b of volume e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 14:56:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-f3412d4a-9854-4c4e-a5cc-aa34764a2ac4 tempest-GroupSnapshotsTest-752462418 None] snapshot_file for this snap is: volume-e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976.3417c423-157b-4e62-ba87-a3e1a3ef561b {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 14:56:35 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ec94f3-dbf1-4c7d-b3f9-ac04e0847d06]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:56:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f3412d4a-9854-4c4e-a5cc-aa34764a2ac4 tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976.3417c423-157b-4e62-ba87-a3e1a3ef561b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:35 devstack sudo[94521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_660a4fad-84c6-40b7-a594-44d16c0701ee_fzls75fg Sep 28 14:56:35 devstack sudo[94521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:35 devstack sudo[94522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976.3417c423-157b-4e62-ba87-a3e1a3ef561b Sep 28 14:56:35 devstack sudo[94522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:35 devstack sudo[94521]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_660a4fad-84c6-40b7-a594-44d16c0701ee_fzls75fg" returned: 1 in 0.610s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_660a4fad-84c6-40b7-a594-44d16c0701ee_fzls75fg' failed. Not Retrying. {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 14:56:35 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89acd98-51b9-45f3-a4e5-6d9d1afd458d]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:56:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_6xitplqydevstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:35 devstack sudo[94522]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f3412d4a-9854-4c4e-a5cc-aa34764a2ac4 tempest-GroupSnapshotsTest-752462418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976.3417c423-157b-4e62-ba87-a3e1a3ef561b" returned: 0 in 0.498s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-f3412d4a-9854-4c4e-a5cc-aa34764a2ac4 tempest-GroupSnapshotsTest-752462418 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 14:56:35 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bfa2e6a-7c32-415a-aa24-6925d7527930]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:56:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f3412d4a-9854-4c4e-a5cc-aa34764a2ac4 tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:35 devstack sudo[94530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_6xitplqydevstack@QuobyteHD Sep 28 14:56:36 devstack sudo[94530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:36 devstack sudo[94531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976 Sep 28 14:56:36 devstack sudo[94531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:36 devstack sudo[94531]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f3412d4a-9854-4c4e-a5cc-aa34764a2ac4 tempest-GroupSnapshotsTest-752462418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976" returned: 0 in 0.467s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f3412d4a-9854-4c4e-a5cc-aa34764a2ac4 tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976.3417c423-157b-4e62-ba87-a3e1a3ef561b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:36 devstack sudo[94530]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_6xitplqydevstack@QuobyteHD" returned: 0 in 0.593s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:36 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] 660a4fad-84c6-40b7-a594-44d16c0701ee was qcow2, converting to qcow2 {{(pid=87116) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 14:56:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_6xitplqydevstack@QuobyteHD /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5ab7e1d7-97dc-40ef-9c9d-039faf0615c0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:36 devstack sudo[94542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976.3417c423-157b-4e62-ba87-a3e1a3ef561b Sep 28 14:56:36 devstack sudo[94542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:36 devstack sudo[94543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_6xitplqydevstack@QuobyteHD /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5ab7e1d7-97dc-40ef-9c9d-039faf0615c0 Sep 28 14:56:36 devstack sudo[94543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:36 devstack sudo[94542]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f3412d4a-9854-4c4e-a5cc-aa34764a2ac4 tempest-GroupSnapshotsTest-752462418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976.3417c423-157b-4e62-ba87-a3e1a3ef561b" returned: 0 in 0.482s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f3412d4a-9854-4c4e-a5cc-aa34764a2ac4 tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976.3417c423-157b-4e62-ba87-a3e1a3ef561b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:36 devstack sudo[94553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976.3417c423-157b-4e62-ba87-a3e1a3ef561b Sep 28 14:56:36 devstack sudo[94553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:37 devstack sudo[94553]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f3412d4a-9854-4c4e-a5cc-aa34764a2ac4 tempest-GroupSnapshotsTest-752462418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976.3417c423-157b-4e62-ba87-a3e1a3ef561b" returned: 0 in 0.332s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:37 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f3412d4a-9854-4c4e-a5cc-aa34764a2ac4 tempest-GroupSnapshotsTest-752462418 None] Lock "cinder-quobyte-3417c423-157b-4e62-ba87-a3e1a3ef561b" released by "_delete_snapshot" :: held 2.017s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:56:37 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f3412d4a-9854-4c4e-a5cc-aa34764a2ac4 tempest-GroupSnapshotsTest-752462418 None] Lock "cinder-quobyte-e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976" released by "delete_snapshot" :: held 2.063s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:56:37 devstack cinder-volume[87116]: WARNING cinder.quota [None req-f3412d4a-9854-4c4e-a5cc-aa34764a2ac4 tempest-GroupSnapshotsTest-752462418 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-548351664 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-548351664, it is now deprecated. Please use the default quota class for default quota. Sep 28 14:56:37 devstack cinder-volume[87116]: WARNING cinder.quota [None req-f3412d4a-9854-4c4e-a5cc-aa34764a2ac4 tempest-GroupSnapshotsTest-752462418 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-548351664 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-548351664, it is now deprecated. Please use the default quota class for default quota. Sep 28 14:56:37 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-f3412d4a-9854-4c4e-a5cc-aa34764a2ac4 tempest-GroupSnapshotsTest-752462418 None] Created reservations ['e2a16b08-e9ed-4387-92ad-0f9f75a71907', '71a90786-350e-4dec-9573-42c6c1a3c4ec', '978f1fa4-a3df-4980-8899-13fac3919b4e', 'fec8d773-5f5f-4e28-a946-c5481c4060a1'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 14:56:37 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-f3412d4a-9854-4c4e-a5cc-aa34764a2ac4 tempest-GroupSnapshotsTest-752462418 None] group_snapshot 305e28e2-314e-4fad-a30a-4c6e46d1ac1a: deleted successfully Sep 28 14:56:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f188847f-f3b0-416e-9361-772c5853da15 tempest-GroupSnapshotsTest-752462418 None] Acquiring lock "cinder-quobyte-e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:56:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f188847f-f3b0-416e-9361-772c5853da15 tempest-GroupSnapshotsTest-752462418 None] Lock "cinder-quobyte-e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976" acquired by "delete_volume" :: waited 0.019s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:56:38 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cfbccda-9f0c-4805-80c6-2946a8b347d8]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:56:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f188847f-f3b0-416e-9361-772c5853da15 tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:38 devstack sudo[94560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976 Sep 28 14:56:38 devstack sudo[94560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:38 devstack sudo[94560]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f188847f-f3b0-416e-9361-772c5853da15 tempest-GroupSnapshotsTest-752462418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976" returned: 0 in 0.514s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f188847f-f3b0-416e-9361-772c5853da15 tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:38 devstack sudo[94573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976 Sep 28 14:56:38 devstack sudo[94573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:39 devstack sudo[94573]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f188847f-f3b0-416e-9361-772c5853da15 tempest-GroupSnapshotsTest-752462418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976" returned: 0 in 0.441s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:39 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f188847f-f3b0-416e-9361-772c5853da15 tempest-GroupSnapshotsTest-752462418 None] Lock "cinder-quobyte-e27d7835-fcb0-41bb-8cc9-b3e1fc9b4976" released by "delete_volume" :: held 1.088s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:56:39 devstack sudo[94543]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_6xitplqydevstack@QuobyteHD /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5ab7e1d7-97dc-40ef-9c9d-039faf0615c0" returned: 0 in 2.812s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:39 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_6xitplqydevstack@QuobyteHD, size 112.00 MB, duration 2.81 sec, destination /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5ab7e1d7-97dc-40ef-9c9d-039faf0615c0 {{(pid=87116) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 14:56:39 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] Converted 112.00 MB image at 39.79 MB/s Sep 28 14:56:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5ab7e1d7-97dc-40ef-9c9d-039faf0615c0 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:39 devstack sudo[94584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5ab7e1d7-97dc-40ef-9c9d-039faf0615c0 1G Sep 28 14:56:39 devstack sudo[94584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:39 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-f188847f-f3b0-416e-9361-772c5853da15 tempest-GroupSnapshotsTest-752462418 None] Created reservations ['68970916-8d40-4dd1-bd96-2461e30f3a43'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 14:56:39 devstack cinder-volume[87116]: WARNING cinder.quota [None req-f188847f-f3b0-416e-9361-772c5853da15 tempest-GroupSnapshotsTest-752462418 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-548351664 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-548351664, it is now deprecated. Please use the default quota class for default quota. Sep 28 14:56:39 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-f188847f-f3b0-416e-9361-772c5853da15 tempest-GroupSnapshotsTest-752462418 None] Created reservations ['974b2bc7-a138-4cb9-ae29-f0eef2d405df', '049f9349-97fa-4899-bdea-519044cb6ff6', '453afdd0-2498-450a-ad1c-158533be85cd', '4b3a9523-9bb4-413f-967f-a61283aff7de'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 14:56:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f188847f-f3b0-416e-9361-772c5853da15 tempest-GroupSnapshotsTest-752462418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:56:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f188847f-f3b0-416e-9361-772c5853da15 tempest-GroupSnapshotsTest-752462418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:56:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f188847f-f3b0-416e-9361-772c5853da15 tempest-GroupSnapshotsTest-752462418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:56:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f188847f-f3b0-416e-9361-772c5853da15 tempest-GroupSnapshotsTest-752462418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:56:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f188847f-f3b0-416e-9361-772c5853da15 tempest-GroupSnapshotsTest-752462418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:56:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f188847f-f3b0-416e-9361-772c5853da15 tempest-GroupSnapshotsTest-752462418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:39 devstack sudo[94588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 14:56:39 devstack sudo[94588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:39 devstack sudo[94584]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5ab7e1d7-97dc-40ef-9c9d-039faf0615c0 1G" returned: 0 in 0.531s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:39 devstack cinder-volume[87116]: DEBUG cinder.volume.volume_utils [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] Downloaded image 660a4fad-84c6-40b7-a594-44d16c0701ee ((None, [{'url': 'file:///opt/stack/data/glance/images/660a4fad-84c6-40b7-a594-44d16c0701ee', 'metadata': {}}])) to volume 5ab7e1d7-97dc-40ef-9c9d-039faf0615c0 successfully. {{(pid=87116) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1253}} Sep 28 14:56:39 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] Temporary image 660a4fad-84c6-40b7-a594-44d16c0701ee for user 73bb3415cddd4d5e901ce087f4531843 is deleted. {{(pid=87116) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 14:56:39 devstack cinder-volume[87116]: DEBUG cinder.volume.volume_utils [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] Marking volume 5ab7e1d7-97dc-40ef-9c9d-039faf0615c0 as bootable. {{(pid=87116) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1157}} Sep 28 14:56:39 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] Copying metadata from image 660a4fad-84c6-40b7-a594-44d16c0701ee to 5ab7e1d7-97dc-40ef-9c9d-039faf0615c0. {{(pid=87116) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 14:56:39 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] Creating volume glance metadata for volume 5ab7e1d7-97dc-40ef-9c9d-039faf0615c0 backed by image 660a4fad-84c6-40b7-a594-44d16c0701ee with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '660a4fad-84c6-40b7-a594-44d16c0701ee', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87116) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 14:56:39 devstack sudo[94588]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:39 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9e1908d-4d6d-4726-9be6-e62948487ad2 tempest-AttachVolumeShelveTestJSON-1367340994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 14:56:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c9e1908d-4d6d-4726-9be6-e62948487ad2 tempest-AttachVolumeShelveTestJSON-1367340994 None] Flow 'volume_create_manager' (9a0a1cca-6714-4881-950d-882252091f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:56:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c9e1908d-4d6d-4726-9be6-e62948487ad2 tempest-AttachVolumeShelveTestJSON-1367340994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86a2f907-ffde-4d67-87e1-d43f973d201c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:56:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f188847f-f3b0-416e-9361-772c5853da15 tempest-GroupSnapshotsTest-752462418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.418s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:39 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-f188847f-f3b0-416e-9361-772c5853da15 tempest-GroupSnapshotsTest-752462418 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:56:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c9e1908d-4d6d-4726-9be6-e62948487ad2 tempest-AttachVolumeShelveTestJSON-1367340994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86a2f907-ffde-4d67-87e1-d43f973d201c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:56:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1715609468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e404531-ddbb-46df-b260-f0c84afa3784,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72ac48bb1d664eb58b52f15702f62a83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:56:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:56:40Z,use_quota=True,user_id='b6cc8152ad70472e8ef69f5759dfdd7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:56:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c9e1908d-4d6d-4726-9be6-e62948487ad2 tempest-AttachVolumeShelveTestJSON-1367340994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46bcc314-6a47-4366-9a0f-009a75541219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:56:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c9e1908d-4d6d-4726-9be6-e62948487ad2 tempest-AttachVolumeShelveTestJSON-1367340994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46bcc314-6a47-4366-9a0f-009a75541219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:56:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c9e1908d-4d6d-4726-9be6-e62948487ad2 tempest-AttachVolumeShelveTestJSON-1367340994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a6229c6-c4b9-4add-b81e-4c50a294b83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:56:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c9e1908d-4d6d-4726-9be6-e62948487ad2 tempest-AttachVolumeShelveTestJSON-1367340994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a6229c6-c4b9-4add-b81e-4c50a294b83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e404531-ddbb-46df-b260-f0c84afa3784', 'volume_name': 'volume-3e404531-ddbb-46df-b260-f0c84afa3784', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:56:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c9e1908d-4d6d-4726-9be6-e62948487ad2 tempest-AttachVolumeShelveTestJSON-1367340994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a313a0d-6b07-4744-8fc1-924b987d2896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:56:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c9e1908d-4d6d-4726-9be6-e62948487ad2 tempest-AttachVolumeShelveTestJSON-1367340994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a313a0d-6b07-4744-8fc1-924b987d2896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:56:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c9e1908d-4d6d-4726-9be6-e62948487ad2 tempest-AttachVolumeShelveTestJSON-1367340994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3263d49f-8fc4-499d-9634-40bb99b20542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:56:40 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-c9e1908d-4d6d-4726-9be6-e62948487ad2 tempest-AttachVolumeShelveTestJSON-1367340994 None] Volume 3e404531-ddbb-46df-b260-f0c84afa3784: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e404531-ddbb-46df-b260-f0c84afa3784', 'volume_size': 1} Sep 28 14:56:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c9e1908d-4d6d-4726-9be6-e62948487ad2 tempest-AttachVolumeShelveTestJSON-1367340994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:56:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c9e1908d-4d6d-4726-9be6-e62948487ad2 tempest-AttachVolumeShelveTestJSON-1367340994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:56:40 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c9e1908d-4d6d-4726-9be6-e62948487ad2 tempest-AttachVolumeShelveTestJSON-1367340994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:56:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1715609468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e404531-ddbb-46df-b260-f0c84afa3784,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72ac48bb1d664eb58b52f15702f62a83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:56:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:56:40Z,use_quota=True,user_id='b6cc8152ad70472e8ef69f5759dfdd7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 14:56:40 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-c9e1908d-4d6d-4726-9be6-e62948487ad2 tempest-AttachVolumeShelveTestJSON-1367340994 None] Creating volume 3e404531-ddbb-46df-b260-f0c84afa3784 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 14:56:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c9e1908d-4d6d-4726-9be6-e62948487ad2 tempest-AttachVolumeShelveTestJSON-1367340994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:56:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c9e1908d-4d6d-4726-9be6-e62948487ad2 tempest-AttachVolumeShelveTestJSON-1367340994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:56:40 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c9e1908d-4d6d-4726-9be6-e62948487ad2 tempest-AttachVolumeShelveTestJSON-1367340994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:56:40 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c9e1908d-4d6d-4726-9be6-e62948487ad2 tempest-AttachVolumeShelveTestJSON-1367340994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:56:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c9e1908d-4d6d-4726-9be6-e62948487ad2 tempest-AttachVolumeShelveTestJSON-1367340994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:56:40 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c9e1908d-4d6d-4726-9be6-e62948487ad2 tempest-AttachVolumeShelveTestJSON-1367340994 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 14:56:40 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-c9e1908d-4d6d-4726-9be6-e62948487ad2 tempest-AttachVolumeShelveTestJSON-1367340994 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 14:56:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c9e1908d-4d6d-4726-9be6-e62948487ad2 tempest-AttachVolumeShelveTestJSON-1367340994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3e404531-ddbb-46df-b260-f0c84afa3784 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:40 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-f188847f-f3b0-416e-9361-772c5853da15 tempest-GroupSnapshotsTest-752462418 None] Delete group completed successfully. Sep 28 14:56:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dd3c145-6264-47af-a3db-daae84c37703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ab7e1d7-97dc-40ef-9c9d-039faf0615c0', 'volume_size': 1, 'image_id': '660a4fad-84c6-40b7-a594-44d16c0701ee', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/660a4fad-84c6-40b7-a594-44d16c0701ee', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca088c9271854d40ba6017d33affee18', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '660a4fad-84c6-40b7-a594-44d16c0701ee', 'created_at': datetime.datetime(2026, 9, 28, 12, 47, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 47, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/660a4fad-84c6-40b7-a594-44d16c0701ee/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:56:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc7f4a98-4733-4c71-b946-8072f74f81e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:56:40 devstack sudo[94593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3e404531-ddbb-46df-b260-f0c84afa3784 1073741824 Sep 28 14:56:40 devstack sudo[94593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:40 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] Volume volume-5ab7e1d7-97dc-40ef-9c9d-039faf0615c0 (5ab7e1d7-97dc-40ef-9c9d-039faf0615c0): created successfully Sep 28 14:56:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc7f4a98-4733-4c71-b946-8072f74f81e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:56:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] Flow 'volume_create_manager' (4fc172fe-7bb7-4d5d-8f35-1f00bde672d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:56:40 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-7aa3a90c-94f5-416e-956e-ac972e96ecce tempest-ServerActionsTestOtherA-1078904851 None] Created volume successfully. Sep 28 14:56:40 devstack sudo[94593]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c9e1908d-4d6d-4726-9be6-e62948487ad2 tempest-AttachVolumeShelveTestJSON-1367340994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3e404531-ddbb-46df-b260-f0c84afa3784 1073741824" returned: 0 in 0.507s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c9e1908d-4d6d-4726-9be6-e62948487ad2 tempest-AttachVolumeShelveTestJSON-1367340994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3e404531-ddbb-46df-b260-f0c84afa3784 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:40 devstack sudo[94599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3e404531-ddbb-46df-b260-f0c84afa3784 Sep 28 14:56:40 devstack sudo[94599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:40 devstack sudo[94599]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c9e1908d-4d6d-4726-9be6-e62948487ad2 tempest-AttachVolumeShelveTestJSON-1367340994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3e404531-ddbb-46df-b260-f0c84afa3784" returned: 0 in 0.278s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:40 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c9e1908d-4d6d-4726-9be6-e62948487ad2 tempest-AttachVolumeShelveTestJSON-1367340994 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 14:56:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c9e1908d-4d6d-4726-9be6-e62948487ad2 tempest-AttachVolumeShelveTestJSON-1367340994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:56:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c9e1908d-4d6d-4726-9be6-e62948487ad2 tempest-AttachVolumeShelveTestJSON-1367340994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3263d49f-8fc4-499d-9634-40bb99b20542) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e404531-ddbb-46df-b260-f0c84afa3784', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:56:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c9e1908d-4d6d-4726-9be6-e62948487ad2 tempest-AttachVolumeShelveTestJSON-1367340994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (501aad2c-8e51-491e-a829-d7319fbf86c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:56:40 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-c9e1908d-4d6d-4726-9be6-e62948487ad2 tempest-AttachVolumeShelveTestJSON-1367340994 None] Volume volume-3e404531-ddbb-46df-b260-f0c84afa3784 (3e404531-ddbb-46df-b260-f0c84afa3784): created successfully Sep 28 14:56:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c9e1908d-4d6d-4726-9be6-e62948487ad2 tempest-AttachVolumeShelveTestJSON-1367340994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (501aad2c-8e51-491e-a829-d7319fbf86c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:56:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c9e1908d-4d6d-4726-9be6-e62948487ad2 tempest-AttachVolumeShelveTestJSON-1367340994 None] Flow 'volume_create_manager' (9a0a1cca-6714-4881-950d-882252091f31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:56:40 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-c9e1908d-4d6d-4726-9be6-e62948487ad2 tempest-AttachVolumeShelveTestJSON-1367340994 None] Created volume successfully. Sep 28 14:56:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-1f573f1c-496c-4e9b-92c8-b0cc651d9a07 req-b086a364-de41-4a97-a906-3e0b313449f9 tempest-ServerActionsTestOtherA-1078904851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:56:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-1f573f1c-496c-4e9b-92c8-b0cc651d9a07 req-b086a364-de41-4a97-a906-3e0b313449f9 tempest-ServerActionsTestOtherA-1078904851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:56:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-1f573f1c-496c-4e9b-92c8-b0cc651d9a07 req-b086a364-de41-4a97-a906-3e0b313449f9 tempest-ServerActionsTestOtherA-1078904851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:56:44 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-1f573f1c-496c-4e9b-92c8-b0cc651d9a07 req-b086a364-de41-4a97-a906-3e0b313449f9 tempest-ServerActionsTestOtherA-1078904851 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1', 'name': 'volume-5ab7e1d7-97dc-40ef-9c9d-039faf0615c0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ce61ca91-6911-47c1-b49c-d59290176838', 'enforce_multipath': True} {{(pid=87116) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 14:56:44 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-1f573f1c-496c-4e9b-92c8-b0cc651d9a07 req-b086a364-de41-4a97-a906-3e0b313449f9 tempest-ServerActionsTestOtherA-1078904851 None] attachment_update completed successfully. Sep 28 14:56:54 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=132,cinder:INSERT=27,cinder:UPDATE=98,cinder:DELETE=4 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:56:54 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=112,cinder:UPDATE=121,cinder:INSERT=36,cinder:DELETE=2 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:56:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-b2f615a4-5e9c-49a7-a222-1672345ae982 req-e224aa0a-f0f9-4fda-af57-3caa37ed7b18 tempest-AttachVolumeShelveTestJSON-1367340994 None] No connector for attachment 2ab09217-29ea-4d54-a77c-ba0d3dca6c49; skipping storage backend terminate_connection call. {{(pid=87116) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 28 14:56:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-b2f615a4-5e9c-49a7-a222-1672345ae982 req-e224aa0a-f0f9-4fda-af57-3caa37ed7b18 tempest-AttachVolumeShelveTestJSON-1367340994 None] Deleting attachment 2ab09217-29ea-4d54-a77c-ba0d3dca6c49. {{(pid=87116) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 14:57:09 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=1 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:57:09 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=1 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:57:12 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-b3b57a32-ae69-499e-87e5-79167fbb9e54 req-0d5e7522-4aab-444e-802d-3faf65dde02e tempest-ServerActionsTestOtherA-1078904851 None] Terminate volume connection completed successfully. Sep 28 14:57:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-b3b57a32-ae69-499e-87e5-79167fbb9e54 req-0d5e7522-4aab-444e-802d-3faf65dde02e tempest-ServerActionsTestOtherA-1078904851 None] Deleting attachment ce61ca91-6911-47c1-b49c-d59290176838. {{(pid=87116) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 14:57:15 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-7c935804-cb74-4768-afeb-3ded30ca4736 tempest-GroupsV314Test-1372784122 None] Group tempest-GroupsV314Test-Group-1080402974: creating Sep 28 14:57:15 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-7c935804-cb74-4768-afeb-3ded30ca4736 tempest-GroupsV314Test-1372784122 None] Group tempest-GroupsV314Test-Group-1080402974: created successfully Sep 28 14:57:15 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-7c935804-cb74-4768-afeb-3ded30ca4736 tempest-GroupsV314Test-1372784122 None] Create group completed successfully. Sep 28 14:57:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-b3b57a32-ae69-499e-87e5-79167fbb9e54 req-c805c092-2bff-45d8-8d41-1ff96e45420f tempest-ServerActionsTestOtherA-1078904851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:57:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-b3b57a32-ae69-499e-87e5-79167fbb9e54 req-c805c092-2bff-45d8-8d41-1ff96e45420f tempest-ServerActionsTestOtherA-1078904851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:57:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-b3b57a32-ae69-499e-87e5-79167fbb9e54 req-c805c092-2bff-45d8-8d41-1ff96e45420f tempest-ServerActionsTestOtherA-1078904851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:57:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-b3b57a32-ae69-499e-87e5-79167fbb9e54 req-c805c092-2bff-45d8-8d41-1ff96e45420f tempest-ServerActionsTestOtherA-1078904851 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1', 'name': 'volume-5ab7e1d7-97dc-40ef-9c9d-039faf0615c0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cb6eabe7-2b7d-4eda-8b74-c2a84933d0db', 'enforce_multipath': True} {{(pid=87116) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 14:57:15 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-b3b57a32-ae69-499e-87e5-79167fbb9e54 req-c805c092-2bff-45d8-8d41-1ff96e45420f tempest-ServerActionsTestOtherA-1078904851 None] attachment_update completed successfully. Sep 28 14:57:16 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:57:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:57:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:57:16 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:57:16 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:57:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:57:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:57:17 devstack sudo[95675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 14:57:17 devstack sudo[95675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:57:17 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-28c2bbb9-d1d2-41e0-8c15-262248d9a6a8 tempest-GroupsV314Test-1372784122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 14:57:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-28c2bbb9-d1d2-41e0-8c15-262248d9a6a8 tempest-GroupsV314Test-1372784122 None] Flow 'volume_create_manager' (a91627ef-e0b5-4bfe-87b3-f2d73b2c4931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:57:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-28c2bbb9-d1d2-41e0-8c15-262248d9a6a8 tempest-GroupsV314Test-1372784122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a34a9f8f-71ee-4930-8b25-e7a601c4a519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:57:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-28c2bbb9-d1d2-41e0-8c15-262248d9a6a8 tempest-GroupsV314Test-1372784122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a34a9f8f-71ee-4930-8b25-e7a601c4a519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:57:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1551399793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=63062e63-ab96-4c9e-b9d6-7f735e3944bc,host='devstack@QuobyteHD#QuobyteHD',id=111f0206-9bcf-4bb9-b73b-f29a512e2232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95664a73305548a5a7f10c4bdce7d271',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:57:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:57:17Z,use_quota=True,user_id='443561d23b474426801b4be58084957c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8dfc8e1-fbbe-4815-b895-e29d4f3fc9ca),volume_type_id=f8dfc8e1-fbbe-4815-b895-e29d4f3fc9ca)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:57:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-28c2bbb9-d1d2-41e0-8c15-262248d9a6a8 tempest-GroupsV314Test-1372784122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9f65e5d-aaa1-4724-9654-1cef6e9631e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:57:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-28c2bbb9-d1d2-41e0-8c15-262248d9a6a8 tempest-GroupsV314Test-1372784122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9f65e5d-aaa1-4724-9654-1cef6e9631e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:57:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-28c2bbb9-d1d2-41e0-8c15-262248d9a6a8 tempest-GroupsV314Test-1372784122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cb417b1-e580-4cbf-9775-2219657b1b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:57:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-28c2bbb9-d1d2-41e0-8c15-262248d9a6a8 tempest-GroupsV314Test-1372784122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cb417b1-e580-4cbf-9775-2219657b1b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '111f0206-9bcf-4bb9-b73b-f29a512e2232', 'volume_name': 'volume-111f0206-9bcf-4bb9-b73b-f29a512e2232', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:57:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-28c2bbb9-d1d2-41e0-8c15-262248d9a6a8 tempest-GroupsV314Test-1372784122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0161d3a-1be7-438a-8c82-80049c5d84a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:57:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-28c2bbb9-d1d2-41e0-8c15-262248d9a6a8 tempest-GroupsV314Test-1372784122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0161d3a-1be7-438a-8c82-80049c5d84a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:57:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-28c2bbb9-d1d2-41e0-8c15-262248d9a6a8 tempest-GroupsV314Test-1372784122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d10f0858-094d-45ba-ad83-03ad1a79d379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:57:17 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-28c2bbb9-d1d2-41e0-8c15-262248d9a6a8 tempest-GroupsV314Test-1372784122 None] Volume 111f0206-9bcf-4bb9-b73b-f29a512e2232: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-111f0206-9bcf-4bb9-b73b-f29a512e2232', 'volume_size': 1} Sep 28 14:57:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-28c2bbb9-d1d2-41e0-8c15-262248d9a6a8 tempest-GroupsV314Test-1372784122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:57:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-28c2bbb9-d1d2-41e0-8c15-262248d9a6a8 tempest-GroupsV314Test-1372784122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:57:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-28c2bbb9-d1d2-41e0-8c15-262248d9a6a8 tempest-GroupsV314Test-1372784122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=63062e63-ab96-4c9e-b9d6-7f735e3944bc,created_at=2026-09-28T12:57:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1551399793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=63062e63-ab96-4c9e-b9d6-7f735e3944bc,host='devstack@QuobyteHD#QuobyteHD',id=111f0206-9bcf-4bb9-b73b-f29a512e2232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95664a73305548a5a7f10c4bdce7d271',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:57:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:57:17Z,use_quota=True,user_id='443561d23b474426801b4be58084957c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8dfc8e1-fbbe-4815-b895-e29d4f3fc9ca),volume_type_id=f8dfc8e1-fbbe-4815-b895-e29d4f3fc9ca)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 14:57:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-28c2bbb9-d1d2-41e0-8c15-262248d9a6a8 tempest-GroupsV314Test-1372784122 None] Creating volume 111f0206-9bcf-4bb9-b73b-f29a512e2232 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 14:57:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-28c2bbb9-d1d2-41e0-8c15-262248d9a6a8 tempest-GroupsV314Test-1372784122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:57:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-28c2bbb9-d1d2-41e0-8c15-262248d9a6a8 tempest-GroupsV314Test-1372784122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:57:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-28c2bbb9-d1d2-41e0-8c15-262248d9a6a8 tempest-GroupsV314Test-1372784122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:57:17 devstack sudo[95675]: pam_unix(sudo:session): session closed for user root Sep 28 14:57:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-28c2bbb9-d1d2-41e0-8c15-262248d9a6a8 tempest-GroupsV314Test-1372784122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:57:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-28c2bbb9-d1d2-41e0-8c15-262248d9a6a8 tempest-GroupsV314Test-1372784122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:57:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-28c2bbb9-d1d2-41e0-8c15-262248d9a6a8 tempest-GroupsV314Test-1372784122 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 14:57:17 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-28c2bbb9-d1d2-41e0-8c15-262248d9a6a8 tempest-GroupsV314Test-1372784122 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 14:57:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-28c2bbb9-d1d2-41e0-8c15-262248d9a6a8 tempest-GroupsV314Test-1372784122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-111f0206-9bcf-4bb9-b73b-f29a512e2232 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:57:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.631s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:57:17 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:57:17 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running periodic task VolumeManager._thread_info {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:57:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] thread count: 28 {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 14:57:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] thread info: [<_MainThread(MainThread, started 135146735652992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 14:57:17 devstack sudo[95685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-111f0206-9bcf-4bb9-b73b-f29a512e2232 1073741824 Sep 28 14:57:17 devstack sudo[95685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:57:18 devstack sudo[95685]: pam_unix(sudo:session): session closed for user root Sep 28 14:57:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-28c2bbb9-d1d2-41e0-8c15-262248d9a6a8 tempest-GroupsV314Test-1372784122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-111f0206-9bcf-4bb9-b73b-f29a512e2232 1073741824" returned: 0 in 1.039s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:57:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-28c2bbb9-d1d2-41e0-8c15-262248d9a6a8 tempest-GroupsV314Test-1372784122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-111f0206-9bcf-4bb9-b73b-f29a512e2232 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:57:18 devstack sudo[95740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-111f0206-9bcf-4bb9-b73b-f29a512e2232 Sep 28 14:57:18 devstack sudo[95740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:57:19 devstack sudo[95740]: pam_unix(sudo:session): session closed for user root Sep 28 14:57:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-28c2bbb9-d1d2-41e0-8c15-262248d9a6a8 tempest-GroupsV314Test-1372784122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-111f0206-9bcf-4bb9-b73b-f29a512e2232" returned: 0 in 0.423s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:57:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-28c2bbb9-d1d2-41e0-8c15-262248d9a6a8 tempest-GroupsV314Test-1372784122 None] <== create_volume: return (1577ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 14:57:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-28c2bbb9-d1d2-41e0-8c15-262248d9a6a8 tempest-GroupsV314Test-1372784122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.580s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:57:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-28c2bbb9-d1d2-41e0-8c15-262248d9a6a8 tempest-GroupsV314Test-1372784122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d10f0858-094d-45ba-ad83-03ad1a79d379) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-111f0206-9bcf-4bb9-b73b-f29a512e2232', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:57:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-28c2bbb9-d1d2-41e0-8c15-262248d9a6a8 tempest-GroupsV314Test-1372784122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eac28640-2938-45ee-93d6-83f5a1c7d677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:57:19 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-28c2bbb9-d1d2-41e0-8c15-262248d9a6a8 tempest-GroupsV314Test-1372784122 None] Volume volume-111f0206-9bcf-4bb9-b73b-f29a512e2232 (111f0206-9bcf-4bb9-b73b-f29a512e2232): created successfully Sep 28 14:57:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-28c2bbb9-d1d2-41e0-8c15-262248d9a6a8 tempest-GroupsV314Test-1372784122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eac28640-2938-45ee-93d6-83f5a1c7d677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:57:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-28c2bbb9-d1d2-41e0-8c15-262248d9a6a8 tempest-GroupsV314Test-1372784122 None] Flow 'volume_create_manager' (a91627ef-e0b5-4bfe-87b3-f2d73b2c4931) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:57:19 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-28c2bbb9-d1d2-41e0-8c15-262248d9a6a8 tempest-GroupsV314Test-1372784122 None] Created volume successfully. Sep 28 14:57:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-33ad3315-e046-45a6-9108-512254191b6f tempest-GroupsV314Test-1372784122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:57:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-33ad3315-e046-45a6-9108-512254191b6f tempest-GroupsV314Test-1372784122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:57:20 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-33ad3315-e046-45a6-9108-512254191b6f tempest-GroupsV314Test-1372784122 None] Cloning volume 111f0206-9bcf-4bb9-b73b-f29a512e2232 to volume 80341e92-97b9-43f7-afbb-351fbbe4d3f4 Sep 28 14:57:20 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-33ad3315-e046-45a6-9108-512254191b6f tempest-GroupsV314Test-1372784122 None] Creating offline snapshot 6f7210ca-8a6e-47dd-aaca-b14f5415b18e of volume 111f0206-9bcf-4bb9-b73b-f29a512e2232 {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 14:57:21 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[35bec6a1-1c03-46ad-ad7b-bfb138dbd021]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:57:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-33ad3315-e046-45a6-9108-512254191b6f tempest-GroupsV314Test-1372784122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-111f0206-9bcf-4bb9-b73b-f29a512e2232 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:57:21 devstack sudo[95798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-111f0206-9bcf-4bb9-b73b-f29a512e2232 Sep 28 14:57:21 devstack sudo[95798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:57:22 devstack sudo[95798]: pam_unix(sudo:session): session closed for user root Sep 28 14:57:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-33ad3315-e046-45a6-9108-512254191b6f tempest-GroupsV314Test-1372784122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-111f0206-9bcf-4bb9-b73b-f29a512e2232" returned: 0 in 1.153s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:57:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-33ad3315-e046-45a6-9108-512254191b6f tempest-GroupsV314Test-1372784122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-111f0206-9bcf-4bb9-b73b-f29a512e2232,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-111f0206-9bcf-4bb9-b73b-f29a512e2232.6f7210ca-8a6e-47dd-aaca-b14f5415b18e 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:57:22 devstack sudo[95804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-111f0206-9bcf-4bb9-b73b-f29a512e2232,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-111f0206-9bcf-4bb9-b73b-f29a512e2232.6f7210ca-8a6e-47dd-aaca-b14f5415b18e 1G Sep 28 14:57:22 devstack sudo[95804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:57:23 devstack sudo[95804]: pam_unix(sudo:session): session closed for user root Sep 28 14:57:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-33ad3315-e046-45a6-9108-512254191b6f tempest-GroupsV314Test-1372784122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-111f0206-9bcf-4bb9-b73b-f29a512e2232,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-111f0206-9bcf-4bb9-b73b-f29a512e2232.6f7210ca-8a6e-47dd-aaca-b14f5415b18e 1G" returned: 0 in 0.966s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:57:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-33ad3315-e046-45a6-9108-512254191b6f tempest-GroupsV314Test-1372784122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-111f0206-9bcf-4bb9-b73b-f29a512e2232 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-111f0206-9bcf-4bb9-b73b-f29a512e2232.6f7210ca-8a6e-47dd-aaca-b14f5415b18e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:57:23 devstack sudo[95812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-111f0206-9bcf-4bb9-b73b-f29a512e2232 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-111f0206-9bcf-4bb9-b73b-f29a512e2232.6f7210ca-8a6e-47dd-aaca-b14f5415b18e Sep 28 14:57:23 devstack sudo[95812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:57:23 devstack sudo[95812]: pam_unix(sudo:session): session closed for user root Sep 28 14:57:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-33ad3315-e046-45a6-9108-512254191b6f tempest-GroupsV314Test-1372784122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-111f0206-9bcf-4bb9-b73b-f29a512e2232 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-111f0206-9bcf-4bb9-b73b-f29a512e2232.6f7210ca-8a6e-47dd-aaca-b14f5415b18e" returned: 0 in 0.557s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:57:23 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-33ad3315-e046-45a6-9108-512254191b6f tempest-GroupsV314Test-1372784122 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-111f0206-9bcf-4bb9-b73b-f29a512e2232.6f7210ca-8a6e-47dd-aaca-b14f5415b18e is being set with open permissions: ugo+rw: NotImplementedError Sep 28 14:57:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-33ad3315-e046-45a6-9108-512254191b6f tempest-GroupsV314Test-1372784122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-111f0206-9bcf-4bb9-b73b-f29a512e2232.6f7210ca-8a6e-47dd-aaca-b14f5415b18e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:57:23 devstack sudo[95818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-111f0206-9bcf-4bb9-b73b-f29a512e2232.6f7210ca-8a6e-47dd-aaca-b14f5415b18e Sep 28 14:57:23 devstack sudo[95818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:57:24 devstack sudo[95818]: pam_unix(sudo:session): session closed for user root Sep 28 14:57:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-33ad3315-e046-45a6-9108-512254191b6f tempest-GroupsV314Test-1372784122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-111f0206-9bcf-4bb9-b73b-f29a512e2232.6f7210ca-8a6e-47dd-aaca-b14f5415b18e" returned: 0 in 0.442s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:57:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-33ad3315-e046-45a6-9108-512254191b6f tempest-GroupsV314Test-1372784122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-111f0206-9bcf-4bb9-b73b-f29a512e2232.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:57:24 devstack sudo[95823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-111f0206-9bcf-4bb9-b73b-f29a512e2232.info Sep 28 14:57:24 devstack sudo[95823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:57:25 devstack sudo[95823]: pam_unix(sudo:session): session closed for user root Sep 28 14:57:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-33ad3315-e046-45a6-9108-512254191b6f tempest-GroupsV314Test-1372784122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-111f0206-9bcf-4bb9-b73b-f29a512e2232.info" returned: 0 in 0.910s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:57:25 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-33ad3315-e046-45a6-9108-512254191b6f tempest-GroupsV314Test-1372784122 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-111f0206-9bcf-4bb9-b73b-f29a512e2232.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 14:57:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-33ad3315-e046-45a6-9108-512254191b6f tempest-GroupsV314Test-1372784122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-111f0206-9bcf-4bb9-b73b-f29a512e2232.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:57:25 devstack sudo[95860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-111f0206-9bcf-4bb9-b73b-f29a512e2232.info Sep 28 14:57:25 devstack sudo[95860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:57:25 devstack sudo[95860]: pam_unix(sudo:session): session closed for user root Sep 28 14:57:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-33ad3315-e046-45a6-9108-512254191b6f tempest-GroupsV314Test-1372784122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-111f0206-9bcf-4bb9-b73b-f29a512e2232.info" returned: 0 in 0.775s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:57:25 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-33ad3315-e046-45a6-9108-512254191b6f tempest-GroupsV314Test-1372784122 None] Acquiring lock "cinder-quobyte-80341e92-97b9-43f7-afbb-351fbbe4d3f4" by "_copy_volume_from_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:57:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-33ad3315-e046-45a6-9108-512254191b6f tempest-GroupsV314Test-1372784122 None] Lock "cinder-quobyte-80341e92-97b9-43f7-afbb-351fbbe4d3f4" acquired by "_copy_volume_from_snapshot" :: waited 0.046s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:57:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-33ad3315-e046-45a6-9108-512254191b6f tempest-GroupsV314Test-1372784122 None] snapshot: 6f7210ca-8a6e-47dd-aaca-b14f5415b18e, volume: 80341e92-97b9-43f7-afbb-351fbbe4d3f4, {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 14:57:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-33ad3315-e046-45a6-9108-512254191b6f tempest-GroupsV314Test-1372784122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:57:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-33ad3315-e046-45a6-9108-512254191b6f tempest-GroupsV314Test-1372784122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:57:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-33ad3315-e046-45a6-9108-512254191b6f tempest-GroupsV314Test-1372784122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:57:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-33ad3315-e046-45a6-9108-512254191b6f tempest-GroupsV314Test-1372784122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:57:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-33ad3315-e046-45a6-9108-512254191b6f tempest-GroupsV314Test-1372784122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:57:26 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e23782b-7c76-4ca3-8b7e-22ce859e2d01]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:57:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-33ad3315-e046-45a6-9108-512254191b6f tempest-GroupsV314Test-1372784122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-111f0206-9bcf-4bb9-b73b-f29a512e2232.6f7210ca-8a6e-47dd-aaca-b14f5415b18e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:57:26 devstack sudo[95863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-111f0206-9bcf-4bb9-b73b-f29a512e2232.6f7210ca-8a6e-47dd-aaca-b14f5415b18e Sep 28 14:57:26 devstack sudo[95863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:57:27 devstack sudo[95863]: pam_unix(sudo:session): session closed for user root Sep 28 14:57:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-33ad3315-e046-45a6-9108-512254191b6f tempest-GroupsV314Test-1372784122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-111f0206-9bcf-4bb9-b73b-f29a512e2232.6f7210ca-8a6e-47dd-aaca-b14f5415b18e" returned: 0 in 0.911s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:57:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-33ad3315-e046-45a6-9108-512254191b6f tempest-GroupsV314Test-1372784122 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-111f0206-9bcf-4bb9-b73b-f29a512e2232(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 14:57:27 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[542aa040-5704-461b-a40f-07ad447891f4]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:57:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-33ad3315-e046-45a6-9108-512254191b6f tempest-GroupsV314Test-1372784122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-111f0206-9bcf-4bb9-b73b-f29a512e2232 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:57:27 devstack sudo[95874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-111f0206-9bcf-4bb9-b73b-f29a512e2232 Sep 28 14:57:27 devstack sudo[95874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:57:27 devstack sudo[95874]: pam_unix(sudo:session): session closed for user root Sep 28 14:57:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-33ad3315-e046-45a6-9108-512254191b6f tempest-GroupsV314Test-1372784122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-111f0206-9bcf-4bb9-b73b-f29a512e2232" returned: 0 in 0.803s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:57:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-33ad3315-e046-45a6-9108-512254191b6f tempest-GroupsV314Test-1372784122 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-111f0206-9bcf-4bb9-b73b-f29a512e2232 {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 14:57:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-33ad3315-e046-45a6-9108-512254191b6f tempest-GroupsV314Test-1372784122 None] Creating direct copy from snapshot {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 14:57:27 devstack cinder-volume[87116]: DEBUG cinder.utils [None req-33ad3315-e046-45a6-9108-512254191b6f tempest-GroupsV314Test-1372784122 None] Path /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-80341e92-97b9-43f7-afbb-351fbbe4d3f4 not found in is_blk_device check {{(pid=87116) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 14:57:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-33ad3315-e046-45a6-9108-512254191b6f tempest-GroupsV314Test-1372784122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-111f0206-9bcf-4bb9-b73b-f29a512e2232 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-80341e92-97b9-43f7-afbb-351fbbe4d3f4 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:57:27 devstack sudo[95880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-111f0206-9bcf-4bb9-b73b-f29a512e2232 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-80341e92-97b9-43f7-afbb-351fbbe4d3f4 Sep 28 14:57:27 devstack sudo[95880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:57:34 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=15,cinder:UPDATE=9,cinder:DELETE=1,cinder:INSERT=1 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:57:34 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=18,cinder:UPDATE=3,cinder:INSERT=2 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:57:41 devstack sudo[95880]: pam_unix(sudo:session): session closed for user root Sep 28 14:57:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-33ad3315-e046-45a6-9108-512254191b6f tempest-GroupsV314Test-1372784122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-111f0206-9bcf-4bb9-b73b-f29a512e2232 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-80341e92-97b9-43f7-afbb-351fbbe4d3f4" returned: 0 in 13.248s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:57:41 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-33ad3315-e046-45a6-9108-512254191b6f tempest-GroupsV314Test-1372784122 None] Image conversion details: src /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-111f0206-9bcf-4bb9-b73b-f29a512e2232, size 1024.00 MB, duration 13.25 sec, destination /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-80341e92-97b9-43f7-afbb-351fbbe4d3f4 {{(pid=87116) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 14:57:41 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-33ad3315-e046-45a6-9108-512254191b6f tempest-GroupsV314Test-1372784122 None] Converted 1024.00 MB image at 77.29 MB/s Sep 28 14:57:41 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-33ad3315-e046-45a6-9108-512254191b6f tempest-GroupsV314Test-1372784122 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-80341e92-97b9-43f7-afbb-351fbbe4d3f4 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 14:57:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-33ad3315-e046-45a6-9108-512254191b6f tempest-GroupsV314Test-1372784122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-80341e92-97b9-43f7-afbb-351fbbe4d3f4 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:57:41 devstack sudo[95967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-80341e92-97b9-43f7-afbb-351fbbe4d3f4 Sep 28 14:57:41 devstack sudo[95967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:57:41 devstack sudo[95967]: pam_unix(sudo:session): session closed for user root Sep 28 14:57:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-33ad3315-e046-45a6-9108-512254191b6f tempest-GroupsV314Test-1372784122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-80341e92-97b9-43f7-afbb-351fbbe4d3f4" returned: 0 in 0.510s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:57:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-33ad3315-e046-45a6-9108-512254191b6f tempest-GroupsV314Test-1372784122 None] Lock "cinder-quobyte-80341e92-97b9-43f7-afbb-351fbbe4d3f4" released by "_copy_volume_from_snapshot" :: held 15.655s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:57:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-33ad3315-e046-45a6-9108-512254191b6f tempest-GroupsV314Test-1372784122 None] Acquiring lock "cinder-quobyte-6f7210ca-8a6e-47dd-aaca-b14f5415b18e" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:57:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-33ad3315-e046-45a6-9108-512254191b6f tempest-GroupsV314Test-1372784122 None] Lock "cinder-quobyte-6f7210ca-8a6e-47dd-aaca-b14f5415b18e" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:57:41 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-33ad3315-e046-45a6-9108-512254191b6f tempest-GroupsV314Test-1372784122 None] Deleting offline snapshot 6f7210ca-8a6e-47dd-aaca-b14f5415b18e of volume 111f0206-9bcf-4bb9-b73b-f29a512e2232 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 14:57:41 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-33ad3315-e046-45a6-9108-512254191b6f tempest-GroupsV314Test-1372784122 None] snapshot_file for this snap is: volume-111f0206-9bcf-4bb9-b73b-f29a512e2232.6f7210ca-8a6e-47dd-aaca-b14f5415b18e {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 14:57:41 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[709f79ca-3005-43e1-b6d1-7f20efc10ea2]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:57:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-33ad3315-e046-45a6-9108-512254191b6f tempest-GroupsV314Test-1372784122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-111f0206-9bcf-4bb9-b73b-f29a512e2232.6f7210ca-8a6e-47dd-aaca-b14f5415b18e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:57:42 devstack sudo[96018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-111f0206-9bcf-4bb9-b73b-f29a512e2232.6f7210ca-8a6e-47dd-aaca-b14f5415b18e Sep 28 14:57:42 devstack sudo[96018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:57:42 devstack sudo[96018]: pam_unix(sudo:session): session closed for user root Sep 28 14:57:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-33ad3315-e046-45a6-9108-512254191b6f tempest-GroupsV314Test-1372784122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-111f0206-9bcf-4bb9-b73b-f29a512e2232.6f7210ca-8a6e-47dd-aaca-b14f5415b18e" returned: 0 in 0.753s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:57:42 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-33ad3315-e046-45a6-9108-512254191b6f tempest-GroupsV314Test-1372784122 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-111f0206-9bcf-4bb9-b73b-f29a512e2232(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 14:57:42 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[4223a969-243e-4de3-b102-add1d4e8dcc3]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:57:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-33ad3315-e046-45a6-9108-512254191b6f tempest-GroupsV314Test-1372784122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-111f0206-9bcf-4bb9-b73b-f29a512e2232 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:57:42 devstack sudo[96039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-111f0206-9bcf-4bb9-b73b-f29a512e2232 Sep 28 14:57:42 devstack sudo[96039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:57:43 devstack sudo[96039]: pam_unix(sudo:session): session closed for user root Sep 28 14:57:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-33ad3315-e046-45a6-9108-512254191b6f tempest-GroupsV314Test-1372784122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-111f0206-9bcf-4bb9-b73b-f29a512e2232" returned: 0 in 0.544s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:57:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-33ad3315-e046-45a6-9108-512254191b6f tempest-GroupsV314Test-1372784122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-111f0206-9bcf-4bb9-b73b-f29a512e2232.6f7210ca-8a6e-47dd-aaca-b14f5415b18e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:57:43 devstack sudo[96064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-111f0206-9bcf-4bb9-b73b-f29a512e2232.6f7210ca-8a6e-47dd-aaca-b14f5415b18e Sep 28 14:57:43 devstack sudo[96064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:57:43 devstack sudo[96064]: pam_unix(sudo:session): session closed for user root Sep 28 14:57:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-33ad3315-e046-45a6-9108-512254191b6f tempest-GroupsV314Test-1372784122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-111f0206-9bcf-4bb9-b73b-f29a512e2232.6f7210ca-8a6e-47dd-aaca-b14f5415b18e" returned: 0 in 0.378s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:57:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-33ad3315-e046-45a6-9108-512254191b6f tempest-GroupsV314Test-1372784122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-111f0206-9bcf-4bb9-b73b-f29a512e2232.6f7210ca-8a6e-47dd-aaca-b14f5415b18e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:57:43 devstack sudo[96069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-111f0206-9bcf-4bb9-b73b-f29a512e2232.6f7210ca-8a6e-47dd-aaca-b14f5415b18e Sep 28 14:57:43 devstack sudo[96069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:57:43 devstack sudo[96069]: pam_unix(sudo:session): session closed for user root Sep 28 14:57:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-33ad3315-e046-45a6-9108-512254191b6f tempest-GroupsV314Test-1372784122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-111f0206-9bcf-4bb9-b73b-f29a512e2232.6f7210ca-8a6e-47dd-aaca-b14f5415b18e" returned: 0 in 0.318s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:57:44 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-33ad3315-e046-45a6-9108-512254191b6f tempest-GroupsV314Test-1372784122 None] Lock "cinder-quobyte-6f7210ca-8a6e-47dd-aaca-b14f5415b18e" released by "_delete_snapshot" :: held 2.234s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:57:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-33ad3315-e046-45a6-9108-512254191b6f tempest-GroupsV314Test-1372784122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 23.244s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:57:44 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-33ad3315-e046-45a6-9108-512254191b6f tempest-GroupsV314Test-1372784122 None] Create group from source-group-63062e63-ab96-4c9e-b9d6-7f735e3944bc completed successfully. Sep 28 14:57:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e4e8aa1a-cb53-4f85-b4d6-407d2a62772a tempest-GroupsV314Test-1372784122 None] Acquiring lock "cinder-quobyte-80341e92-97b9-43f7-afbb-351fbbe4d3f4" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:57:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e4e8aa1a-cb53-4f85-b4d6-407d2a62772a tempest-GroupsV314Test-1372784122 None] Lock "cinder-quobyte-80341e92-97b9-43f7-afbb-351fbbe4d3f4" acquired by "delete_volume" :: waited 0.028s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:57:45 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a34ffb-9cb3-4ecf-86dd-23760545ffe4]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:57:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e4e8aa1a-cb53-4f85-b4d6-407d2a62772a tempest-GroupsV314Test-1372784122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-80341e92-97b9-43f7-afbb-351fbbe4d3f4 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:57:45 devstack sudo[96074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-80341e92-97b9-43f7-afbb-351fbbe4d3f4 Sep 28 14:57:45 devstack sudo[96074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:57:45 devstack sudo[96074]: pam_unix(sudo:session): session closed for user root Sep 28 14:57:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e4e8aa1a-cb53-4f85-b4d6-407d2a62772a tempest-GroupsV314Test-1372784122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-80341e92-97b9-43f7-afbb-351fbbe4d3f4" returned: 0 in 0.592s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:57:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e4e8aa1a-cb53-4f85-b4d6-407d2a62772a tempest-GroupsV314Test-1372784122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-80341e92-97b9-43f7-afbb-351fbbe4d3f4 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:57:45 devstack sudo[96079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-80341e92-97b9-43f7-afbb-351fbbe4d3f4 Sep 28 14:57:45 devstack sudo[96079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:57:45 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-4edd1fd2-cf62-447e-91d7-a6ccea5ddead tempest-VolumesActionsTest-1994849264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 14:57:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4edd1fd2-cf62-447e-91d7-a6ccea5ddead tempest-VolumesActionsTest-1994849264 None] Flow 'volume_create_manager' (8e502436-6788-48fa-ad9f-52e2bdbe12e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:57:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4edd1fd2-cf62-447e-91d7-a6ccea5ddead tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4e1f2c8-743c-488a-b423-a48a2083652c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:57:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4edd1fd2-cf62-447e-91d7-a6ccea5ddead tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4e1f2c8-743c-488a-b423-a48a2083652c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-514118648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57c2e4a5-d538-4e9c-a87a-29e80bb45349,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adcaed9cae5b4aa58fd38e0f3bb8a092',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:57:46Z,use_quota=True,user_id='6bf55dd7e43c4be9b1685be0009227da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:57:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4edd1fd2-cf62-447e-91d7-a6ccea5ddead tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f487231-d549-4e0e-b9c3-962b5bd96034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:57:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4edd1fd2-cf62-447e-91d7-a6ccea5ddead tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f487231-d549-4e0e-b9c3-962b5bd96034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:57:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4edd1fd2-cf62-447e-91d7-a6ccea5ddead tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (835f197e-b5d7-40d6-a5af-1d5d5c71b444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:57:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4edd1fd2-cf62-447e-91d7-a6ccea5ddead tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (835f197e-b5d7-40d6-a5af-1d5d5c71b444) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57c2e4a5-d538-4e9c-a87a-29e80bb45349', 'volume_name': 'volume-57c2e4a5-d538-4e9c-a87a-29e80bb45349', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:57:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4edd1fd2-cf62-447e-91d7-a6ccea5ddead tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39a66ecc-a197-4b7f-b032-da0c44455dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:57:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4edd1fd2-cf62-447e-91d7-a6ccea5ddead tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39a66ecc-a197-4b7f-b032-da0c44455dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:57:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4edd1fd2-cf62-447e-91d7-a6ccea5ddead tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5bc4fef-7d90-4e30-b2e4-b44a03b1d9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:57:46 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-4edd1fd2-cf62-447e-91d7-a6ccea5ddead tempest-VolumesActionsTest-1994849264 None] Volume 57c2e4a5-d538-4e9c-a87a-29e80bb45349: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57c2e4a5-d538-4e9c-a87a-29e80bb45349', 'volume_size': 1} Sep 28 14:57:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4edd1fd2-cf62-447e-91d7-a6ccea5ddead tempest-VolumesActionsTest-1994849264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:57:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4edd1fd2-cf62-447e-91d7-a6ccea5ddead tempest-VolumesActionsTest-1994849264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:57:46 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4edd1fd2-cf62-447e-91d7-a6ccea5ddead tempest-VolumesActionsTest-1994849264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-514118648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57c2e4a5-d538-4e9c-a87a-29e80bb45349,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adcaed9cae5b4aa58fd38e0f3bb8a092',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:57:46Z,use_quota=True,user_id='6bf55dd7e43c4be9b1685be0009227da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 14:57:46 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-4edd1fd2-cf62-447e-91d7-a6ccea5ddead tempest-VolumesActionsTest-1994849264 None] Creating volume 57c2e4a5-d538-4e9c-a87a-29e80bb45349 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 14:57:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4edd1fd2-cf62-447e-91d7-a6ccea5ddead tempest-VolumesActionsTest-1994849264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:57:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4edd1fd2-cf62-447e-91d7-a6ccea5ddead tempest-VolumesActionsTest-1994849264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:57:46 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4edd1fd2-cf62-447e-91d7-a6ccea5ddead tempest-VolumesActionsTest-1994849264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:57:46 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4edd1fd2-cf62-447e-91d7-a6ccea5ddead tempest-VolumesActionsTest-1994849264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:57:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4edd1fd2-cf62-447e-91d7-a6ccea5ddead tempest-VolumesActionsTest-1994849264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:57:46 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4edd1fd2-cf62-447e-91d7-a6ccea5ddead tempest-VolumesActionsTest-1994849264 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 14:57:46 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-4edd1fd2-cf62-447e-91d7-a6ccea5ddead tempest-VolumesActionsTest-1994849264 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 14:57:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4edd1fd2-cf62-447e-91d7-a6ccea5ddead tempest-VolumesActionsTest-1994849264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-57c2e4a5-d538-4e9c-a87a-29e80bb45349 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:57:46 devstack sudo[96081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-57c2e4a5-d538-4e9c-a87a-29e80bb45349 1073741824 Sep 28 14:57:46 devstack sudo[96081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:57:46 devstack sudo[96079]: pam_unix(sudo:session): session closed for user root Sep 28 14:57:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e4e8aa1a-cb53-4f85-b4d6-407d2a62772a tempest-GroupsV314Test-1372784122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-80341e92-97b9-43f7-afbb-351fbbe4d3f4" returned: 0 in 0.335s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:57:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e4e8aa1a-cb53-4f85-b4d6-407d2a62772a tempest-GroupsV314Test-1372784122 None] Lock "cinder-quobyte-80341e92-97b9-43f7-afbb-351fbbe4d3f4" released by "delete_volume" :: held 1.012s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:57:46 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-e4e8aa1a-cb53-4f85-b4d6-407d2a62772a tempest-GroupsV314Test-1372784122 None] Created reservations ['a7d7201d-b69f-4050-a95f-121de48b0b88'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 14:57:46 devstack cinder-volume[87116]: WARNING cinder.quota [None req-e4e8aa1a-cb53-4f85-b4d6-407d2a62772a tempest-GroupsV314Test-1372784122 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1517435258 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1517435258, it is now deprecated. Please use the default quota class for default quota. Sep 28 14:57:46 devstack cinder-volume[87116]: WARNING cinder.quota [None req-e4e8aa1a-cb53-4f85-b4d6-407d2a62772a tempest-GroupsV314Test-1372784122 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1517435258 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1517435258, it is now deprecated. Please use the default quota class for default quota. Sep 28 14:57:46 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-e4e8aa1a-cb53-4f85-b4d6-407d2a62772a tempest-GroupsV314Test-1372784122 None] Created reservations ['8eb672ea-6877-4971-a6a7-cea461059b75', '8b81dddd-675f-48b7-9837-3064a1aad332', 'fc68d804-d1ff-4ef0-9bde-3fed0adb94f3', '1aae9d63-1901-4883-a1cc-c90b2c3703d7'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 14:57:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e4e8aa1a-cb53-4f85-b4d6-407d2a62772a tempest-GroupsV314Test-1372784122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:57:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e4e8aa1a-cb53-4f85-b4d6-407d2a62772a tempest-GroupsV314Test-1372784122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:57:46 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e4e8aa1a-cb53-4f85-b4d6-407d2a62772a tempest-GroupsV314Test-1372784122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:57:46 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e4e8aa1a-cb53-4f85-b4d6-407d2a62772a tempest-GroupsV314Test-1372784122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:57:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e4e8aa1a-cb53-4f85-b4d6-407d2a62772a tempest-GroupsV314Test-1372784122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:57:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e4e8aa1a-cb53-4f85-b4d6-407d2a62772a tempest-GroupsV314Test-1372784122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:57:46 devstack sudo[96087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 14:57:46 devstack sudo[96087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:57:46 devstack sudo[96081]: pam_unix(sudo:session): session closed for user root Sep 28 14:57:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4edd1fd2-cf62-447e-91d7-a6ccea5ddead tempest-VolumesActionsTest-1994849264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-57c2e4a5-d538-4e9c-a87a-29e80bb45349 1073741824" returned: 0 in 0.909s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:57:47 devstack sudo[96087]: pam_unix(sudo:session): session closed for user root Sep 28 14:57:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e4e8aa1a-cb53-4f85-b4d6-407d2a62772a tempest-GroupsV314Test-1372784122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.505s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:57:47 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-e4e8aa1a-cb53-4f85-b4d6-407d2a62772a tempest-GroupsV314Test-1372784122 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:57:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4edd1fd2-cf62-447e-91d7-a6ccea5ddead tempest-VolumesActionsTest-1994849264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-57c2e4a5-d538-4e9c-a87a-29e80bb45349 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:57:47 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2bbea287-758e-4950-982a-3e51ab6743b6 tempest-GroupsV314Test-1372784122 None] Acquiring lock "cinder-quobyte-111f0206-9bcf-4bb9-b73b-f29a512e2232" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:57:47 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-e4e8aa1a-cb53-4f85-b4d6-407d2a62772a tempest-GroupsV314Test-1372784122 None] Delete group completed successfully. Sep 28 14:57:47 devstack sudo[96093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-57c2e4a5-d538-4e9c-a87a-29e80bb45349 Sep 28 14:57:47 devstack sudo[96093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:57:47 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2bbea287-758e-4950-982a-3e51ab6743b6 tempest-GroupsV314Test-1372784122 None] Lock "cinder-quobyte-111f0206-9bcf-4bb9-b73b-f29a512e2232" acquired by "delete_volume" :: waited 0.048s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:57:47 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[88bffa9e-f283-4ad4-9798-7c46438ca30d]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:57:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2bbea287-758e-4950-982a-3e51ab6743b6 tempest-GroupsV314Test-1372784122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-111f0206-9bcf-4bb9-b73b-f29a512e2232 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:57:47 devstack sudo[96093]: pam_unix(sudo:session): session closed for user root Sep 28 14:57:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4edd1fd2-cf62-447e-91d7-a6ccea5ddead tempest-VolumesActionsTest-1994849264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-57c2e4a5-d538-4e9c-a87a-29e80bb45349" returned: 0 in 0.451s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:57:47 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4edd1fd2-cf62-447e-91d7-a6ccea5ddead tempest-VolumesActionsTest-1994849264 None] <== create_volume: return (1484ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 14:57:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4edd1fd2-cf62-447e-91d7-a6ccea5ddead tempest-VolumesActionsTest-1994849264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.492s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:57:47 devstack sudo[96095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-111f0206-9bcf-4bb9-b73b-f29a512e2232 Sep 28 14:57:47 devstack sudo[96095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:57:47 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4edd1fd2-cf62-447e-91d7-a6ccea5ddead tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5bc4fef-7d90-4e30-b2e4-b44a03b1d9f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57c2e4a5-d538-4e9c-a87a-29e80bb45349', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:57:47 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4edd1fd2-cf62-447e-91d7-a6ccea5ddead tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4e41f9e-ba69-487c-adf8-a8bdb0f04025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:57:47 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-4edd1fd2-cf62-447e-91d7-a6ccea5ddead tempest-VolumesActionsTest-1994849264 None] Volume volume-57c2e4a5-d538-4e9c-a87a-29e80bb45349 (57c2e4a5-d538-4e9c-a87a-29e80bb45349): created successfully Sep 28 14:57:47 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4edd1fd2-cf62-447e-91d7-a6ccea5ddead tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4e41f9e-ba69-487c-adf8-a8bdb0f04025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:57:47 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4edd1fd2-cf62-447e-91d7-a6ccea5ddead tempest-VolumesActionsTest-1994849264 None] Flow 'volume_create_manager' (8e502436-6788-48fa-ad9f-52e2bdbe12e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:57:47 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-4edd1fd2-cf62-447e-91d7-a6ccea5ddead tempest-VolumesActionsTest-1994849264 None] Created volume successfully. Sep 28 14:57:47 devstack sudo[96095]: pam_unix(sudo:session): session closed for user root Sep 28 14:57:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2bbea287-758e-4950-982a-3e51ab6743b6 tempest-GroupsV314Test-1372784122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-111f0206-9bcf-4bb9-b73b-f29a512e2232" returned: 0 in 0.684s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:57:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2bbea287-758e-4950-982a-3e51ab6743b6 tempest-GroupsV314Test-1372784122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-111f0206-9bcf-4bb9-b73b-f29a512e2232 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:57:47 devstack sudo[96103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-111f0206-9bcf-4bb9-b73b-f29a512e2232 Sep 28 14:57:47 devstack sudo[96103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:57:48 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b0640131-9dcc-4b96-9c8c-3415ceca05ab tempest-VolumesActionsTest-1994849264 None] Acquiring lock "cinder-57c2e4a5-d538-4e9c-a87a-29e80bb45349" by "attach_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:57:48 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b0640131-9dcc-4b96-9c8c-3415ceca05ab tempest-VolumesActionsTest-1994849264 None] Lock "cinder-57c2e4a5-d538-4e9c-a87a-29e80bb45349" acquired by "attach_volume" :: waited 0.033s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:57:48 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-b0640131-9dcc-4b96-9c8c-3415ceca05ab tempest-VolumesActionsTest-1994849264 None] Attaching volume 57c2e4a5-d538-4e9c-a87a-29e80bb45349 to instance ad02499d-84c7-46f2-b1c2-8373327d209b at mountpoint /dev/vdb on host None. Sep 28 14:57:48 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-b0640131-9dcc-4b96-9c8c-3415ceca05ab tempest-VolumesActionsTest-1994849264 None] Attach volume completed successfully. Sep 28 14:57:48 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b0640131-9dcc-4b96-9c8c-3415ceca05ab tempest-VolumesActionsTest-1994849264 None] Lock "cinder-57c2e4a5-d538-4e9c-a87a-29e80bb45349" released by "attach_volume" :: held 0.230s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:57:48 devstack sudo[96103]: pam_unix(sudo:session): session closed for user root Sep 28 14:57:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2bbea287-758e-4950-982a-3e51ab6743b6 tempest-GroupsV314Test-1372784122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-111f0206-9bcf-4bb9-b73b-f29a512e2232" returned: 0 in 0.710s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:57:48 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2bbea287-758e-4950-982a-3e51ab6743b6 tempest-GroupsV314Test-1372784122 None] Lock "cinder-quobyte-111f0206-9bcf-4bb9-b73b-f29a512e2232" released by "delete_volume" :: held 1.592s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:57:48 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-2bbea287-758e-4950-982a-3e51ab6743b6 tempest-GroupsV314Test-1372784122 None] Created reservations ['3f374fa8-d3e9-4e22-bb58-e0c6ab9cf8b4'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 14:57:49 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-2bbea287-758e-4950-982a-3e51ab6743b6 tempest-GroupsV314Test-1372784122 None] Created reservations ['7638a021-292b-45ad-a5c1-9b323848dff3', '443fef5f-8c1f-4b9e-a6c3-cd681c1c2914', 'cc426d8d-dd0c-4be9-b35c-7dd7e58965f6', 'b034b070-bd38-4717-a0c6-6f08672aa69a'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 14:57:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2bbea287-758e-4950-982a-3e51ab6743b6 tempest-GroupsV314Test-1372784122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:57:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2bbea287-758e-4950-982a-3e51ab6743b6 tempest-GroupsV314Test-1372784122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:57:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2bbea287-758e-4950-982a-3e51ab6743b6 tempest-GroupsV314Test-1372784122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:57:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2bbea287-758e-4950-982a-3e51ab6743b6 tempest-GroupsV314Test-1372784122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:57:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2bbea287-758e-4950-982a-3e51ab6743b6 tempest-GroupsV314Test-1372784122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:57:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2bbea287-758e-4950-982a-3e51ab6743b6 tempest-GroupsV314Test-1372784122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:57:49 devstack sudo[96130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 14:57:49 devstack sudo[96130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:57:49 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-39a94ef0-b0ce-43ea-a53a-bfd97ec8f2d4 tempest-VolumesActionsTest-1610201749 None] Terminate volume connection completed successfully. Sep 28 14:57:49 devstack sudo[96130]: pam_unix(sudo:session): session closed for user root Sep 28 14:57:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2bbea287-758e-4950-982a-3e51ab6743b6 tempest-GroupsV314Test-1372784122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.734s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:57:49 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-2bbea287-758e-4950-982a-3e51ab6743b6 tempest-GroupsV314Test-1372784122 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:57:49 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-2bbea287-758e-4950-982a-3e51ab6743b6 tempest-GroupsV314Test-1372784122 None] Delete group completed successfully. Sep 28 14:57:50 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-39a94ef0-b0ce-43ea-a53a-bfd97ec8f2d4 tempest-VolumesActionsTest-1610201749 None] Acquiring lock "cinder-57c2e4a5-d538-4e9c-a87a-29e80bb45349-detach_volume" by "detach_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:57:50 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-39a94ef0-b0ce-43ea-a53a-bfd97ec8f2d4 tempest-VolumesActionsTest-1610201749 None] Lock "cinder-57c2e4a5-d538-4e9c-a87a-29e80bb45349-detach_volume" acquired by "detach_volume" :: waited 0.053s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:57:50 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-39a94ef0-b0ce-43ea-a53a-bfd97ec8f2d4 tempest-VolumesActionsTest-1610201749 None] Detaching volume 57c2e4a5-d538-4e9c-a87a-29e80bb45349 from instance ad02499d-84c7-46f2-b1c2-8373327d209b. Sep 28 14:57:50 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-39a94ef0-b0ce-43ea-a53a-bfd97ec8f2d4 tempest-VolumesActionsTest-1610201749 None] Detach volume completed successfully. Sep 28 14:57:50 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-39a94ef0-b0ce-43ea-a53a-bfd97ec8f2d4 tempest-VolumesActionsTest-1610201749 None] Lock "cinder-57c2e4a5-d538-4e9c-a87a-29e80bb45349-detach_volume" released by "detach_volume" :: held 0.155s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:57:50 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5f54cae7-6506-423b-9581-5153f629d737 tempest-VolumesActionsTest-1994849264 None] Acquiring lock "cinder-57c2e4a5-d538-4e9c-a87a-29e80bb45349-detach_volume" by "detach_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:57:50 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5f54cae7-6506-423b-9581-5153f629d737 tempest-VolumesActionsTest-1994849264 None] Lock "cinder-57c2e4a5-d538-4e9c-a87a-29e80bb45349-detach_volume" acquired by "detach_volume" :: waited 0.067s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:57:50 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-5f54cae7-6506-423b-9581-5153f629d737 tempest-VolumesActionsTest-1994849264 None] Volume detach called, but volume not attached. Sep 28 14:57:50 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5f54cae7-6506-423b-9581-5153f629d737 tempest-VolumesActionsTest-1994849264 None] Lock "cinder-57c2e4a5-d538-4e9c-a87a-29e80bb45349-detach_volume" released by "detach_volume" :: held 0.068s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:57:51 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fe0d92f7-280c-4a35-9eb4-06046fcbd7b5 tempest-VolumesActionsTest-1994849264 None] Acquiring lock "cinder-57c2e4a5-d538-4e9c-a87a-29e80bb45349-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:57:51 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fe0d92f7-280c-4a35-9eb4-06046fcbd7b5 tempest-VolumesActionsTest-1994849264 None] Lock "cinder-57c2e4a5-d538-4e9c-a87a-29e80bb45349-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:57:51 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fe0d92f7-280c-4a35-9eb4-06046fcbd7b5 tempest-VolumesActionsTest-1994849264 None] Acquiring lock "cinder-quobyte-57c2e4a5-d538-4e9c-a87a-29e80bb45349" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:57:51 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fe0d92f7-280c-4a35-9eb4-06046fcbd7b5 tempest-VolumesActionsTest-1994849264 None] Lock "cinder-quobyte-57c2e4a5-d538-4e9c-a87a-29e80bb45349" acquired by "delete_volume" :: waited 0.023s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:57:51 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a4fec1-0fd7-48c3-9b0a-0c15b6f7d6ae]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:57:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fe0d92f7-280c-4a35-9eb4-06046fcbd7b5 tempest-VolumesActionsTest-1994849264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-57c2e4a5-d538-4e9c-a87a-29e80bb45349 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:57:51 devstack sudo[96137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-57c2e4a5-d538-4e9c-a87a-29e80bb45349 Sep 28 14:57:51 devstack sudo[96137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:57:52 devstack sudo[96137]: pam_unix(sudo:session): session closed for user root Sep 28 14:57:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fe0d92f7-280c-4a35-9eb4-06046fcbd7b5 tempest-VolumesActionsTest-1994849264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-57c2e4a5-d538-4e9c-a87a-29e80bb45349" returned: 0 in 0.754s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:57:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fe0d92f7-280c-4a35-9eb4-06046fcbd7b5 tempest-VolumesActionsTest-1994849264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-57c2e4a5-d538-4e9c-a87a-29e80bb45349 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:57:52 devstack sudo[96142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-57c2e4a5-d538-4e9c-a87a-29e80bb45349 Sep 28 14:57:52 devstack sudo[96142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:57:52 devstack sudo[96142]: pam_unix(sudo:session): session closed for user root Sep 28 14:57:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fe0d92f7-280c-4a35-9eb4-06046fcbd7b5 tempest-VolumesActionsTest-1994849264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-57c2e4a5-d538-4e9c-a87a-29e80bb45349" returned: 0 in 0.458s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:57:52 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fe0d92f7-280c-4a35-9eb4-06046fcbd7b5 tempest-VolumesActionsTest-1994849264 None] Lock "cinder-quobyte-57c2e4a5-d538-4e9c-a87a-29e80bb45349" released by "delete_volume" :: held 1.282s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:57:53 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-fe0d92f7-280c-4a35-9eb4-06046fcbd7b5 tempest-VolumesActionsTest-1994849264 None] Created reservations ['7b4ed582-4450-4e24-ae37-76cdb361aebb', 'e688efe1-5d95-4825-98c5-9a067fe5bc23', '91a2c528-41d9-4a7e-8fcb-b61a5655a22d', '7b6831b0-75f5-4781-a954-00435b8e6ae3'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 14:57:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-fe0d92f7-280c-4a35-9eb4-06046fcbd7b5 tempest-VolumesActionsTest-1994849264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:57:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-fe0d92f7-280c-4a35-9eb4-06046fcbd7b5 tempest-VolumesActionsTest-1994849264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:57:53 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-fe0d92f7-280c-4a35-9eb4-06046fcbd7b5 tempest-VolumesActionsTest-1994849264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:57:53 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-fe0d92f7-280c-4a35-9eb4-06046fcbd7b5 tempest-VolumesActionsTest-1994849264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:57:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-fe0d92f7-280c-4a35-9eb4-06046fcbd7b5 tempest-VolumesActionsTest-1994849264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:57:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fe0d92f7-280c-4a35-9eb4-06046fcbd7b5 tempest-VolumesActionsTest-1994849264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:57:53 devstack sudo[96160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 14:57:53 devstack sudo[96160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:57:53 devstack sudo[96160]: pam_unix(sudo:session): session closed for user root Sep 28 14:57:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fe0d92f7-280c-4a35-9eb4-06046fcbd7b5 tempest-VolumesActionsTest-1994849264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.539s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:57:53 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-fe0d92f7-280c-4a35-9eb4-06046fcbd7b5 tempest-VolumesActionsTest-1994849264 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:57:53 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-fe0d92f7-280c-4a35-9eb4-06046fcbd7b5 tempest-VolumesActionsTest-1994849264 None] Deleted volume successfully. Sep 28 14:57:53 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fe0d92f7-280c-4a35-9eb4-06046fcbd7b5 tempest-VolumesActionsTest-1994849264 None] Lock "cinder-57c2e4a5-d538-4e9c-a87a-29e80bb45349-delete_volume" released by "delete_volume" :: held 2.387s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:57:54 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6f2b5d6c-1469-42d4-84d8-f991664469a8 tempest-AttachVolumeShelveTestJSON-1367340994 None] Acquiring lock "cinder-3e404531-ddbb-46df-b260-f0c84afa3784-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:57:54 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6f2b5d6c-1469-42d4-84d8-f991664469a8 tempest-AttachVolumeShelveTestJSON-1367340994 None] Lock "cinder-3e404531-ddbb-46df-b260-f0c84afa3784-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:57:54 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6f2b5d6c-1469-42d4-84d8-f991664469a8 tempest-AttachVolumeShelveTestJSON-1367340994 None] Acquiring lock "cinder-quobyte-3e404531-ddbb-46df-b260-f0c84afa3784" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:57:54 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6f2b5d6c-1469-42d4-84d8-f991664469a8 tempest-AttachVolumeShelveTestJSON-1367340994 None] Lock "cinder-quobyte-3e404531-ddbb-46df-b260-f0c84afa3784" acquired by "delete_volume" :: waited 0.025s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:57:54 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa3f907-7bdd-47d3-9f91-e97d0228b175]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:57:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6f2b5d6c-1469-42d4-84d8-f991664469a8 tempest-AttachVolumeShelveTestJSON-1367340994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3e404531-ddbb-46df-b260-f0c84afa3784 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:57:54 devstack sudo[96174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3e404531-ddbb-46df-b260-f0c84afa3784 Sep 28 14:57:54 devstack sudo[96174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:57:55 devstack sudo[96174]: pam_unix(sudo:session): session closed for user root Sep 28 14:57:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6f2b5d6c-1469-42d4-84d8-f991664469a8 tempest-AttachVolumeShelveTestJSON-1367340994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3e404531-ddbb-46df-b260-f0c84afa3784" returned: 0 in 0.661s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:57:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6f2b5d6c-1469-42d4-84d8-f991664469a8 tempest-AttachVolumeShelveTestJSON-1367340994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3e404531-ddbb-46df-b260-f0c84afa3784 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:57:55 devstack sudo[96197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3e404531-ddbb-46df-b260-f0c84afa3784 Sep 28 14:57:55 devstack sudo[96197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:57:55 devstack sudo[96197]: pam_unix(sudo:session): session closed for user root Sep 28 14:57:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6f2b5d6c-1469-42d4-84d8-f991664469a8 tempest-AttachVolumeShelveTestJSON-1367340994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3e404531-ddbb-46df-b260-f0c84afa3784" returned: 0 in 0.360s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:57:55 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6f2b5d6c-1469-42d4-84d8-f991664469a8 tempest-AttachVolumeShelveTestJSON-1367340994 None] Lock "cinder-quobyte-3e404531-ddbb-46df-b260-f0c84afa3784" released by "delete_volume" :: held 1.111s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:57:55 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-6f2b5d6c-1469-42d4-84d8-f991664469a8 tempest-AttachVolumeShelveTestJSON-1367340994 None] Created reservations ['9356999e-ad68-405b-990a-f39ecacd3fd8', '378fde62-20cb-48c8-a25b-4c75bb296401', '33d91f13-a90c-4ff7-99d6-775cea94c865', 'aca72a7c-5a3c-4720-91b7-14b6d88b6d06'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 14:57:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6f2b5d6c-1469-42d4-84d8-f991664469a8 tempest-AttachVolumeShelveTestJSON-1367340994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:57:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6f2b5d6c-1469-42d4-84d8-f991664469a8 tempest-AttachVolumeShelveTestJSON-1367340994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:57:56 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-6f2b5d6c-1469-42d4-84d8-f991664469a8 tempest-AttachVolumeShelveTestJSON-1367340994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:57:56 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-6f2b5d6c-1469-42d4-84d8-f991664469a8 tempest-AttachVolumeShelveTestJSON-1367340994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:57:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6f2b5d6c-1469-42d4-84d8-f991664469a8 tempest-AttachVolumeShelveTestJSON-1367340994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:57:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6f2b5d6c-1469-42d4-84d8-f991664469a8 tempest-AttachVolumeShelveTestJSON-1367340994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:57:56 devstack sudo[96206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 14:57:56 devstack sudo[96206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:57:56 devstack sudo[96206]: pam_unix(sudo:session): session closed for user root Sep 28 14:57:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6f2b5d6c-1469-42d4-84d8-f991664469a8 tempest-AttachVolumeShelveTestJSON-1367340994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.626s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:57:56 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-6f2b5d6c-1469-42d4-84d8-f991664469a8 tempest-AttachVolumeShelveTestJSON-1367340994 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:57:56 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-6f2b5d6c-1469-42d4-84d8-f991664469a8 tempest-AttachVolumeShelveTestJSON-1367340994 None] Deleted volume successfully. Sep 28 14:57:56 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6f2b5d6c-1469-42d4-84d8-f991664469a8 tempest-AttachVolumeShelveTestJSON-1367340994 None] Lock "cinder-3e404531-ddbb-46df-b260-f0c84afa3784-delete_volume" released by "delete_volume" :: held 2.105s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:57:58 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd010fde-6420-43e5-a905-da45a6de73e4 tempest-VolumesActionsTest-1994849264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 14:57:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-cd010fde-6420-43e5-a905-da45a6de73e4 tempest-VolumesActionsTest-1994849264 None] Flow 'volume_create_manager' (7e0ec235-561d-45ed-a67f-654b1879c7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:57:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-cd010fde-6420-43e5-a905-da45a6de73e4 tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9b25fad-c3dd-4e93-92e8-fa9ca811c573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:57:58 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-53a81b29-f024-4bbc-8d43-7d71939682fe req-7048ac52-5bda-46e4-bfe3-31c25608276a tempest-ServerActionsTestOtherA-1078904851 None] Terminate volume connection completed successfully. Sep 28 14:57:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-53a81b29-f024-4bbc-8d43-7d71939682fe req-7048ac52-5bda-46e4-bfe3-31c25608276a tempest-ServerActionsTestOtherA-1078904851 None] Deleting attachment cb6eabe7-2b7d-4eda-8b74-c2a84933d0db. {{(pid=87116) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 14:57:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-cd010fde-6420-43e5-a905-da45a6de73e4 tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9b25fad-c3dd-4e93-92e8-fa9ca811c573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2030182626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90b73574-8eae-4d3b-b75a-aebf83096de0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adcaed9cae5b4aa58fd38e0f3bb8a092',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:57:58Z,use_quota=True,user_id='6bf55dd7e43c4be9b1685be0009227da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:57:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-cd010fde-6420-43e5-a905-da45a6de73e4 tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd8793e4-c407-437f-804b-a7fd3a173ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:57:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-cd010fde-6420-43e5-a905-da45a6de73e4 tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd8793e4-c407-437f-804b-a7fd3a173ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:57:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-cd010fde-6420-43e5-a905-da45a6de73e4 tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a79b884-2d41-455d-9273-b1d712e27393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:57:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-cd010fde-6420-43e5-a905-da45a6de73e4 tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a79b884-2d41-455d-9273-b1d712e27393) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90b73574-8eae-4d3b-b75a-aebf83096de0', 'volume_name': 'volume-90b73574-8eae-4d3b-b75a-aebf83096de0', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:57:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-cd010fde-6420-43e5-a905-da45a6de73e4 tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34adaca6-235c-48e4-b694-3f46f5250a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:57:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-cd010fde-6420-43e5-a905-da45a6de73e4 tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34adaca6-235c-48e4-b694-3f46f5250a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:57:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-cd010fde-6420-43e5-a905-da45a6de73e4 tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (177dc96f-5324-40c7-8ffa-9399674f334d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:57:58 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-cd010fde-6420-43e5-a905-da45a6de73e4 tempest-VolumesActionsTest-1994849264 None] Volume 90b73574-8eae-4d3b-b75a-aebf83096de0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90b73574-8eae-4d3b-b75a-aebf83096de0', 'volume_size': 1} Sep 28 14:57:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-cd010fde-6420-43e5-a905-da45a6de73e4 tempest-VolumesActionsTest-1994849264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:57:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-cd010fde-6420-43e5-a905-da45a6de73e4 tempest-VolumesActionsTest-1994849264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:57:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-cd010fde-6420-43e5-a905-da45a6de73e4 tempest-VolumesActionsTest-1994849264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2030182626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90b73574-8eae-4d3b-b75a-aebf83096de0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adcaed9cae5b4aa58fd38e0f3bb8a092',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:57:58Z,use_quota=True,user_id='6bf55dd7e43c4be9b1685be0009227da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 14:57:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-cd010fde-6420-43e5-a905-da45a6de73e4 tempest-VolumesActionsTest-1994849264 None] Creating volume 90b73574-8eae-4d3b-b75a-aebf83096de0 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 14:57:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-cd010fde-6420-43e5-a905-da45a6de73e4 tempest-VolumesActionsTest-1994849264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:57:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-cd010fde-6420-43e5-a905-da45a6de73e4 tempest-VolumesActionsTest-1994849264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:57:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-cd010fde-6420-43e5-a905-da45a6de73e4 tempest-VolumesActionsTest-1994849264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:57:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-cd010fde-6420-43e5-a905-da45a6de73e4 tempest-VolumesActionsTest-1994849264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:57:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-cd010fde-6420-43e5-a905-da45a6de73e4 tempest-VolumesActionsTest-1994849264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:57:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-cd010fde-6420-43e5-a905-da45a6de73e4 tempest-VolumesActionsTest-1994849264 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 14:57:58 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-cd010fde-6420-43e5-a905-da45a6de73e4 tempest-VolumesActionsTest-1994849264 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 14:57:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cd010fde-6420-43e5-a905-da45a6de73e4 tempest-VolumesActionsTest-1994849264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-90b73574-8eae-4d3b-b75a-aebf83096de0 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:57:58 devstack sudo[96233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-90b73574-8eae-4d3b-b75a-aebf83096de0 1073741824 Sep 28 14:57:58 devstack sudo[96233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:57:58 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-53a81b29-f024-4bbc-8d43-7d71939682fe req-bf0df17c-210b-4caf-bd60-3b22577fe375 tempest-ServerActionsTestOtherA-1078904851 None] Acquiring lock "cinder-5ab7e1d7-97dc-40ef-9c9d-039faf0615c0-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:57:58 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-53a81b29-f024-4bbc-8d43-7d71939682fe req-bf0df17c-210b-4caf-bd60-3b22577fe375 tempest-ServerActionsTestOtherA-1078904851 None] Lock "cinder-5ab7e1d7-97dc-40ef-9c9d-039faf0615c0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:57:58 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-53a81b29-f024-4bbc-8d43-7d71939682fe req-bf0df17c-210b-4caf-bd60-3b22577fe375 tempest-ServerActionsTestOtherA-1078904851 None] Acquiring lock "cinder-quobyte-5ab7e1d7-97dc-40ef-9c9d-039faf0615c0" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:57:58 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-53a81b29-f024-4bbc-8d43-7d71939682fe req-bf0df17c-210b-4caf-bd60-3b22577fe375 tempest-ServerActionsTestOtherA-1078904851 None] Lock "cinder-quobyte-5ab7e1d7-97dc-40ef-9c9d-039faf0615c0" acquired by "delete_volume" :: waited 0.040s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:57:58 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a982f5b-5529-4ce7-8962-d8849f6d3b90]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:57:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-53a81b29-f024-4bbc-8d43-7d71939682fe req-bf0df17c-210b-4caf-bd60-3b22577fe375 tempest-ServerActionsTestOtherA-1078904851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5ab7e1d7-97dc-40ef-9c9d-039faf0615c0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:57:59 devstack sudo[96236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5ab7e1d7-97dc-40ef-9c9d-039faf0615c0 Sep 28 14:57:59 devstack sudo[96236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:57:59 devstack sudo[96233]: pam_unix(sudo:session): session closed for user root Sep 28 14:57:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cd010fde-6420-43e5-a905-da45a6de73e4 tempest-VolumesActionsTest-1994849264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-90b73574-8eae-4d3b-b75a-aebf83096de0 1073741824" returned: 0 in 0.788s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:57:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cd010fde-6420-43e5-a905-da45a6de73e4 tempest-VolumesActionsTest-1994849264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-90b73574-8eae-4d3b-b75a-aebf83096de0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:57:59 devstack sudo[96243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-90b73574-8eae-4d3b-b75a-aebf83096de0 Sep 28 14:57:59 devstack sudo[96243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:57:59 devstack sudo[96236]: pam_unix(sudo:session): session closed for user root Sep 28 14:57:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-53a81b29-f024-4bbc-8d43-7d71939682fe req-bf0df17c-210b-4caf-bd60-3b22577fe375 tempest-ServerActionsTestOtherA-1078904851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5ab7e1d7-97dc-40ef-9c9d-039faf0615c0" returned: 0 in 0.671s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:57:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-53a81b29-f024-4bbc-8d43-7d71939682fe req-bf0df17c-210b-4caf-bd60-3b22577fe375 tempest-ServerActionsTestOtherA-1078904851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5ab7e1d7-97dc-40ef-9c9d-039faf0615c0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:57:59 devstack sudo[96247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5ab7e1d7-97dc-40ef-9c9d-039faf0615c0 Sep 28 14:57:59 devstack sudo[96247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:57:59 devstack sudo[96243]: pam_unix(sudo:session): session closed for user root Sep 28 14:57:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cd010fde-6420-43e5-a905-da45a6de73e4 tempest-VolumesActionsTest-1994849264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-90b73574-8eae-4d3b-b75a-aebf83096de0" returned: 0 in 0.371s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:57:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-cd010fde-6420-43e5-a905-da45a6de73e4 tempest-VolumesActionsTest-1994849264 None] <== create_volume: return (1240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 14:57:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-cd010fde-6420-43e5-a905-da45a6de73e4 tempest-VolumesActionsTest-1994849264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.242s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:57:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-cd010fde-6420-43e5-a905-da45a6de73e4 tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (177dc96f-5324-40c7-8ffa-9399674f334d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90b73574-8eae-4d3b-b75a-aebf83096de0', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:57:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-cd010fde-6420-43e5-a905-da45a6de73e4 tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (150b7432-42ca-4c16-959f-f045bf038b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:57:59 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-cd010fde-6420-43e5-a905-da45a6de73e4 tempest-VolumesActionsTest-1994849264 None] Volume volume-90b73574-8eae-4d3b-b75a-aebf83096de0 (90b73574-8eae-4d3b-b75a-aebf83096de0): created successfully Sep 28 14:57:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-cd010fde-6420-43e5-a905-da45a6de73e4 tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (150b7432-42ca-4c16-959f-f045bf038b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:57:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-cd010fde-6420-43e5-a905-da45a6de73e4 tempest-VolumesActionsTest-1994849264 None] Flow 'volume_create_manager' (7e0ec235-561d-45ed-a67f-654b1879c7c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:57:59 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-cd010fde-6420-43e5-a905-da45a6de73e4 tempest-VolumesActionsTest-1994849264 None] Created volume successfully. Sep 28 14:57:59 devstack sudo[96247]: pam_unix(sudo:session): session closed for user root Sep 28 14:57:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-53a81b29-f024-4bbc-8d43-7d71939682fe req-bf0df17c-210b-4caf-bd60-3b22577fe375 tempest-ServerActionsTestOtherA-1078904851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5ab7e1d7-97dc-40ef-9c9d-039faf0615c0" returned: 0 in 0.362s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:57:59 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-53a81b29-f024-4bbc-8d43-7d71939682fe req-bf0df17c-210b-4caf-bd60-3b22577fe375 tempest-ServerActionsTestOtherA-1078904851 None] Lock "cinder-quobyte-5ab7e1d7-97dc-40ef-9c9d-039faf0615c0" released by "delete_volume" :: held 1.105s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:58:00 devstack cinder-volume[87116]: DEBUG cinder.quota [req-53a81b29-f024-4bbc-8d43-7d71939682fe req-bf0df17c-210b-4caf-bd60-3b22577fe375 tempest-ServerActionsTestOtherA-1078904851 None] Created reservations ['f32d7c7c-356f-4728-a327-fa631c9f14bf', '4eb41a86-1121-4d18-9ae9-4e4d8f17f1ef', '8677686e-7eb6-4a5e-8150-59d72cc9402b', 'efeadd23-5231-419a-bcb2-6c934bd02b94'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 14:58:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-53a81b29-f024-4bbc-8d43-7d71939682fe req-bf0df17c-210b-4caf-bd60-3b22577fe375 tempest-ServerActionsTestOtherA-1078904851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:58:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-53a81b29-f024-4bbc-8d43-7d71939682fe req-bf0df17c-210b-4caf-bd60-3b22577fe375 tempest-ServerActionsTestOtherA-1078904851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:58:00 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [req-53a81b29-f024-4bbc-8d43-7d71939682fe req-bf0df17c-210b-4caf-bd60-3b22577fe375 tempest-ServerActionsTestOtherA-1078904851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:58:00 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [req-53a81b29-f024-4bbc-8d43-7d71939682fe req-bf0df17c-210b-4caf-bd60-3b22577fe375 tempest-ServerActionsTestOtherA-1078904851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:58:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-53a81b29-f024-4bbc-8d43-7d71939682fe req-bf0df17c-210b-4caf-bd60-3b22577fe375 tempest-ServerActionsTestOtherA-1078904851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:58:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-53a81b29-f024-4bbc-8d43-7d71939682fe req-bf0df17c-210b-4caf-bd60-3b22577fe375 tempest-ServerActionsTestOtherA-1078904851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:00 devstack sudo[96251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 14:58:00 devstack sudo[96251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:00 devstack sudo[96251]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-53a81b29-f024-4bbc-8d43-7d71939682fe req-bf0df17c-210b-4caf-bd60-3b22577fe375 tempest-ServerActionsTestOtherA-1078904851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.269s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:00 devstack cinder-volume[87116]: DEBUG cinder.manager [req-53a81b29-f024-4bbc-8d43-7d71939682fe req-bf0df17c-210b-4caf-bd60-3b22577fe375 tempest-ServerActionsTestOtherA-1078904851 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:58:00 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-53a81b29-f024-4bbc-8d43-7d71939682fe req-bf0df17c-210b-4caf-bd60-3b22577fe375 tempest-ServerActionsTestOtherA-1078904851 None] Deleted volume successfully. Sep 28 14:58:00 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-53a81b29-f024-4bbc-8d43-7d71939682fe req-bf0df17c-210b-4caf-bd60-3b22577fe375 tempest-ServerActionsTestOtherA-1078904851 None] Lock "cinder-5ab7e1d7-97dc-40ef-9c9d-039faf0615c0-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:58:00 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-81b87a73-403c-4d1a-91ae-fc6e6459a867 tempest-VolumesActionsTest-1610201749 None] Acquiring lock "cinder-90b73574-8eae-4d3b-b75a-aebf83096de0-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:58:00 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-81b87a73-403c-4d1a-91ae-fc6e6459a867 tempest-VolumesActionsTest-1610201749 None] Lock "cinder-90b73574-8eae-4d3b-b75a-aebf83096de0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:58:00 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-81b87a73-403c-4d1a-91ae-fc6e6459a867 tempest-VolumesActionsTest-1610201749 None] Acquiring lock "cinder-quobyte-90b73574-8eae-4d3b-b75a-aebf83096de0" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:58:00 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-81b87a73-403c-4d1a-91ae-fc6e6459a867 tempest-VolumesActionsTest-1610201749 None] Lock "cinder-quobyte-90b73574-8eae-4d3b-b75a-aebf83096de0" acquired by "delete_volume" :: waited 0.027s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:58:00 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6996c2a-1db6-4ea4-a6e2-6bfeaa487220]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:58:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-81b87a73-403c-4d1a-91ae-fc6e6459a867 tempest-VolumesActionsTest-1610201749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-90b73574-8eae-4d3b-b75a-aebf83096de0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:01 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ef2d21ac-547c-4e6b-95a4-4d520283c881 tempest-ServerActionsTestOtherA-1078904851 None] Acquiring lock "cinder-c35c06be-12ba-4c6e-8ce6-cf5e912fec8e-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:58:01 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ef2d21ac-547c-4e6b-95a4-4d520283c881 tempest-ServerActionsTestOtherA-1078904851 None] Lock "cinder-c35c06be-12ba-4c6e-8ce6-cf5e912fec8e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:58:01 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ef2d21ac-547c-4e6b-95a4-4d520283c881 tempest-ServerActionsTestOtherA-1078904851 None] Acquiring lock "cinder-quobyte-c35c06be-12ba-4c6e-8ce6-cf5e912fec8e" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:58:01 devstack sudo[96255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-90b73574-8eae-4d3b-b75a-aebf83096de0 Sep 28 14:58:01 devstack sudo[96255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:01 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ef2d21ac-547c-4e6b-95a4-4d520283c881 tempest-ServerActionsTestOtherA-1078904851 None] Lock "cinder-quobyte-c35c06be-12ba-4c6e-8ce6-cf5e912fec8e" acquired by "delete_volume" :: waited 0.014s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:58:01 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[407705ee-ff58-4047-b69f-4b6cea2294da]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:58:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ef2d21ac-547c-4e6b-95a4-4d520283c881 tempest-ServerActionsTestOtherA-1078904851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c35c06be-12ba-4c6e-8ce6-cf5e912fec8e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:01 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-fabf6f56-28f4-417e-903e-d2bc3f24d2fa tempest-GroupsV320Test-303243319 None] Group tempest-GroupsV320Test-Group-118134001: creating Sep 28 14:58:01 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-fabf6f56-28f4-417e-903e-d2bc3f24d2fa tempest-GroupsV320Test-303243319 None] Group tempest-GroupsV320Test-Group-118134001: created successfully Sep 28 14:58:01 devstack sudo[96257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c35c06be-12ba-4c6e-8ce6-cf5e912fec8e Sep 28 14:58:01 devstack sudo[96257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:01 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-fabf6f56-28f4-417e-903e-d2bc3f24d2fa tempest-GroupsV320Test-303243319 None] Create group completed successfully. Sep 28 14:58:01 devstack sudo[96255]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-81b87a73-403c-4d1a-91ae-fc6e6459a867 tempest-VolumesActionsTest-1610201749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-90b73574-8eae-4d3b-b75a-aebf83096de0" returned: 0 in 0.483s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-81b87a73-403c-4d1a-91ae-fc6e6459a867 tempest-VolumesActionsTest-1610201749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-90b73574-8eae-4d3b-b75a-aebf83096de0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:01 devstack sudo[96262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-90b73574-8eae-4d3b-b75a-aebf83096de0 Sep 28 14:58:01 devstack sudo[96262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:01 devstack sudo[96257]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ef2d21ac-547c-4e6b-95a4-4d520283c881 tempest-ServerActionsTestOtherA-1078904851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c35c06be-12ba-4c6e-8ce6-cf5e912fec8e" returned: 0 in 0.424s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ef2d21ac-547c-4e6b-95a4-4d520283c881 tempest-ServerActionsTestOtherA-1078904851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c35c06be-12ba-4c6e-8ce6-cf5e912fec8e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:01 devstack sudo[96267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c35c06be-12ba-4c6e-8ce6-cf5e912fec8e Sep 28 14:58:01 devstack sudo[96267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:01 devstack sudo[96262]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-81b87a73-403c-4d1a-91ae-fc6e6459a867 tempest-VolumesActionsTest-1610201749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-90b73574-8eae-4d3b-b75a-aebf83096de0" returned: 0 in 0.367s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:01 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-81b87a73-403c-4d1a-91ae-fc6e6459a867 tempest-VolumesActionsTest-1610201749 None] Lock "cinder-quobyte-90b73574-8eae-4d3b-b75a-aebf83096de0" released by "delete_volume" :: held 0.924s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:58:01 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-81b87a73-403c-4d1a-91ae-fc6e6459a867 tempest-VolumesActionsTest-1610201749 None] Created reservations ['3bafd163-b6af-4aa0-9feb-d97cf0ea669a', 'b4f6407c-9072-4e37-85d5-d48dd3fca05b', 'd8fd1a9d-a1f0-47ae-b5b3-fe2ae2205057', '91ce9957-9e04-40fd-a0f4-57158d219121'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 14:58:01 devstack sudo[96267]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ef2d21ac-547c-4e6b-95a4-4d520283c881 tempest-ServerActionsTestOtherA-1078904851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c35c06be-12ba-4c6e-8ce6-cf5e912fec8e" returned: 0 in 0.364s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:01 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ef2d21ac-547c-4e6b-95a4-4d520283c881 tempest-ServerActionsTestOtherA-1078904851 None] Lock "cinder-quobyte-c35c06be-12ba-4c6e-8ce6-cf5e912fec8e" released by "delete_volume" :: held 0.844s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:58:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-81b87a73-403c-4d1a-91ae-fc6e6459a867 tempest-VolumesActionsTest-1610201749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:58:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-81b87a73-403c-4d1a-91ae-fc6e6459a867 tempest-VolumesActionsTest-1610201749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:58:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-81b87a73-403c-4d1a-91ae-fc6e6459a867 tempest-VolumesActionsTest-1610201749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:58:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-81b87a73-403c-4d1a-91ae-fc6e6459a867 tempest-VolumesActionsTest-1610201749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:58:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-81b87a73-403c-4d1a-91ae-fc6e6459a867 tempest-VolumesActionsTest-1610201749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:58:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-81b87a73-403c-4d1a-91ae-fc6e6459a867 tempest-VolumesActionsTest-1610201749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:02 devstack sudo[96271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 14:58:02 devstack sudo[96271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:02 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-ef2d21ac-547c-4e6b-95a4-4d520283c881 tempest-ServerActionsTestOtherA-1078904851 None] Created reservations ['6099cc76-bb78-42f0-ad1b-db716efb3b4b', '478c0eca-8b4a-45e2-9ce1-85f9e86c151c', '97144940-ffdb-4618-a5b0-18bef80188a7', '9f0c646a-658b-4ab2-af9c-1c0d4cfd56c2'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 14:58:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ef2d21ac-547c-4e6b-95a4-4d520283c881 tempest-ServerActionsTestOtherA-1078904851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:58:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ef2d21ac-547c-4e6b-95a4-4d520283c881 tempest-ServerActionsTestOtherA-1078904851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:58:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ef2d21ac-547c-4e6b-95a4-4d520283c881 tempest-ServerActionsTestOtherA-1078904851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:58:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ef2d21ac-547c-4e6b-95a4-4d520283c881 tempest-ServerActionsTestOtherA-1078904851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:58:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ef2d21ac-547c-4e6b-95a4-4d520283c881 tempest-ServerActionsTestOtherA-1078904851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:58:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ef2d21ac-547c-4e6b-95a4-4d520283c881 tempest-ServerActionsTestOtherA-1078904851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:02 devstack sudo[96273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 14:58:02 devstack sudo[96273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:02 devstack sudo[96271]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-81b87a73-403c-4d1a-91ae-fc6e6459a867 tempest-VolumesActionsTest-1610201749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.382s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:02 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-81b87a73-403c-4d1a-91ae-fc6e6459a867 tempest-VolumesActionsTest-1610201749 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:58:02 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-81b87a73-403c-4d1a-91ae-fc6e6459a867 tempest-VolumesActionsTest-1610201749 None] Deleted volume successfully. Sep 28 14:58:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-81b87a73-403c-4d1a-91ae-fc6e6459a867 tempest-VolumesActionsTest-1610201749 None] Lock "cinder-90b73574-8eae-4d3b-b75a-aebf83096de0-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:58:02 devstack sudo[96273]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ef2d21ac-547c-4e6b-95a4-4d520283c881 tempest-ServerActionsTestOtherA-1078904851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.463s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:02 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-ef2d21ac-547c-4e6b-95a4-4d520283c881 tempest-ServerActionsTestOtherA-1078904851 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:58:02 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-ef2d21ac-547c-4e6b-95a4-4d520283c881 tempest-ServerActionsTestOtherA-1078904851 None] Deleted volume successfully. Sep 28 14:58:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ef2d21ac-547c-4e6b-95a4-4d520283c881 tempest-ServerActionsTestOtherA-1078904851 None] Lock "cinder-c35c06be-12ba-4c6e-8ce6-cf5e912fec8e-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:58:03 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-7ae4bf06-c90a-4e36-8134-01d90b8bc7f2 tempest-GroupsV320Test-303243319 None] Created reservations ['8fe9beed-2452-42ba-a6b0-739c71599952'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 14:58:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7ae4bf06-c90a-4e36-8134-01d90b8bc7f2 tempest-GroupsV320Test-303243319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:58:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7ae4bf06-c90a-4e36-8134-01d90b8bc7f2 tempest-GroupsV320Test-303243319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:58:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7ae4bf06-c90a-4e36-8134-01d90b8bc7f2 tempest-GroupsV320Test-303243319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:58:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7ae4bf06-c90a-4e36-8134-01d90b8bc7f2 tempest-GroupsV320Test-303243319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:58:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7ae4bf06-c90a-4e36-8134-01d90b8bc7f2 tempest-GroupsV320Test-303243319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:58:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7ae4bf06-c90a-4e36-8134-01d90b8bc7f2 tempest-GroupsV320Test-303243319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:03 devstack sudo[96303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 14:58:03 devstack sudo[96303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:03 devstack sudo[96303]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7ae4bf06-c90a-4e36-8134-01d90b8bc7f2 tempest-GroupsV320Test-303243319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.402s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:03 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-7ae4bf06-c90a-4e36-8134-01d90b8bc7f2 tempest-GroupsV320Test-303243319 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:58:03 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-7ae4bf06-c90a-4e36-8134-01d90b8bc7f2 tempest-GroupsV320Test-303243319 None] Delete group completed successfully. Sep 28 14:58:04 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8aa38b0-3dac-44cd-b999-5577b692c9e8 tempest-VolumesActionsTest-1994849264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 14:58:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e8aa38b0-3dac-44cd-b999-5577b692c9e8 tempest-VolumesActionsTest-1994849264 None] Flow 'volume_create_manager' (2bab7e51-4557-4d9a-b081-e202301e0068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:58:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e8aa38b0-3dac-44cd-b999-5577b692c9e8 tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf3b6a33-a958-4388-a74f-928a19b7b5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:58:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e8aa38b0-3dac-44cd-b999-5577b692c9e8 tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf3b6a33-a958-4388-a74f-928a19b7b5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:58:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-300314156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c49543b8-55f5-4ae2-818a-3d086352927d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adcaed9cae5b4aa58fd38e0f3bb8a092',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:58:04Z,use_quota=True,user_id='6bf55dd7e43c4be9b1685be0009227da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:58:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e8aa38b0-3dac-44cd-b999-5577b692c9e8 tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e372c19b-563a-4cca-a44d-ab3511196a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:58:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e8aa38b0-3dac-44cd-b999-5577b692c9e8 tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e372c19b-563a-4cca-a44d-ab3511196a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:58:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e8aa38b0-3dac-44cd-b999-5577b692c9e8 tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af44deec-655d-453f-b1b6-b1c8e959a73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:58:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e8aa38b0-3dac-44cd-b999-5577b692c9e8 tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af44deec-655d-453f-b1b6-b1c8e959a73b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c49543b8-55f5-4ae2-818a-3d086352927d', 'volume_name': 'volume-c49543b8-55f5-4ae2-818a-3d086352927d', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:58:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e8aa38b0-3dac-44cd-b999-5577b692c9e8 tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26656fea-261d-4060-be46-625edf276791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:58:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e8aa38b0-3dac-44cd-b999-5577b692c9e8 tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26656fea-261d-4060-be46-625edf276791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:58:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e8aa38b0-3dac-44cd-b999-5577b692c9e8 tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b0eaf4a-4730-4b22-8b80-1d0ba1d4cb94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:58:04 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-e8aa38b0-3dac-44cd-b999-5577b692c9e8 tempest-VolumesActionsTest-1994849264 None] Volume c49543b8-55f5-4ae2-818a-3d086352927d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c49543b8-55f5-4ae2-818a-3d086352927d', 'volume_size': 1} Sep 28 14:58:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e8aa38b0-3dac-44cd-b999-5577b692c9e8 tempest-VolumesActionsTest-1994849264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:58:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e8aa38b0-3dac-44cd-b999-5577b692c9e8 tempest-VolumesActionsTest-1994849264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:58:04 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e8aa38b0-3dac-44cd-b999-5577b692c9e8 tempest-VolumesActionsTest-1994849264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:58:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-300314156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c49543b8-55f5-4ae2-818a-3d086352927d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adcaed9cae5b4aa58fd38e0f3bb8a092',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:58:04Z,use_quota=True,user_id='6bf55dd7e43c4be9b1685be0009227da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 14:58:04 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-e8aa38b0-3dac-44cd-b999-5577b692c9e8 tempest-VolumesActionsTest-1994849264 None] Creating volume c49543b8-55f5-4ae2-818a-3d086352927d {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 14:58:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e8aa38b0-3dac-44cd-b999-5577b692c9e8 tempest-VolumesActionsTest-1994849264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:58:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e8aa38b0-3dac-44cd-b999-5577b692c9e8 tempest-VolumesActionsTest-1994849264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:58:04 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e8aa38b0-3dac-44cd-b999-5577b692c9e8 tempest-VolumesActionsTest-1994849264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:58:04 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e8aa38b0-3dac-44cd-b999-5577b692c9e8 tempest-VolumesActionsTest-1994849264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:58:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e8aa38b0-3dac-44cd-b999-5577b692c9e8 tempest-VolumesActionsTest-1994849264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:58:04 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e8aa38b0-3dac-44cd-b999-5577b692c9e8 tempest-VolumesActionsTest-1994849264 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 14:58:04 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-e8aa38b0-3dac-44cd-b999-5577b692c9e8 tempest-VolumesActionsTest-1994849264 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 14:58:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e8aa38b0-3dac-44cd-b999-5577b692c9e8 tempest-VolumesActionsTest-1994849264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c49543b8-55f5-4ae2-818a-3d086352927d 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:04 devstack sudo[96307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c49543b8-55f5-4ae2-818a-3d086352927d 1073741824 Sep 28 14:58:04 devstack sudo[96307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:04 devstack sudo[96307]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e8aa38b0-3dac-44cd-b999-5577b692c9e8 tempest-VolumesActionsTest-1994849264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c49543b8-55f5-4ae2-818a-3d086352927d 1073741824" returned: 0 in 0.693s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e8aa38b0-3dac-44cd-b999-5577b692c9e8 tempest-VolumesActionsTest-1994849264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c49543b8-55f5-4ae2-818a-3d086352927d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:05 devstack sudo[96315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c49543b8-55f5-4ae2-818a-3d086352927d Sep 28 14:58:05 devstack sudo[96315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:05 devstack sudo[96315]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e8aa38b0-3dac-44cd-b999-5577b692c9e8 tempest-VolumesActionsTest-1994849264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c49543b8-55f5-4ae2-818a-3d086352927d" returned: 0 in 0.374s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:05 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e8aa38b0-3dac-44cd-b999-5577b692c9e8 tempest-VolumesActionsTest-1994849264 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 14:58:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e8aa38b0-3dac-44cd-b999-5577b692c9e8 tempest-VolumesActionsTest-1994849264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:58:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e8aa38b0-3dac-44cd-b999-5577b692c9e8 tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b0eaf4a-4730-4b22-8b80-1d0ba1d4cb94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c49543b8-55f5-4ae2-818a-3d086352927d', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:58:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e8aa38b0-3dac-44cd-b999-5577b692c9e8 tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59e1006d-a14f-4595-a513-60054fed33eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:58:05 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-e8aa38b0-3dac-44cd-b999-5577b692c9e8 tempest-VolumesActionsTest-1994849264 None] Volume volume-c49543b8-55f5-4ae2-818a-3d086352927d (c49543b8-55f5-4ae2-818a-3d086352927d): created successfully Sep 28 14:58:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e8aa38b0-3dac-44cd-b999-5577b692c9e8 tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59e1006d-a14f-4595-a513-60054fed33eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:58:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e8aa38b0-3dac-44cd-b999-5577b692c9e8 tempest-VolumesActionsTest-1994849264 None] Flow 'volume_create_manager' (2bab7e51-4557-4d9a-b081-e202301e0068) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:58:05 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-e8aa38b0-3dac-44cd-b999-5577b692c9e8 tempest-VolumesActionsTest-1994849264 None] Created volume successfully. Sep 28 14:58:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ad8a1513-45f7-4e49-a759-c47d3c427ed4 tempest-VolumesActionsTest-1610201749 None] Acquiring lock "cinder-c49543b8-55f5-4ae2-818a-3d086352927d-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:58:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ad8a1513-45f7-4e49-a759-c47d3c427ed4 tempest-VolumesActionsTest-1610201749 None] Lock "cinder-c49543b8-55f5-4ae2-818a-3d086352927d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:58:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ad8a1513-45f7-4e49-a759-c47d3c427ed4 tempest-VolumesActionsTest-1610201749 None] Acquiring lock "cinder-quobyte-c49543b8-55f5-4ae2-818a-3d086352927d" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:58:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ad8a1513-45f7-4e49-a759-c47d3c427ed4 tempest-VolumesActionsTest-1610201749 None] Lock "cinder-quobyte-c49543b8-55f5-4ae2-818a-3d086352927d" acquired by "delete_volume" :: waited 0.020s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:58:06 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14b0975-603e-4c0e-9365-3251cb210178]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:58:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ad8a1513-45f7-4e49-a759-c47d3c427ed4 tempest-VolumesActionsTest-1610201749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c49543b8-55f5-4ae2-818a-3d086352927d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:06 devstack sudo[96318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c49543b8-55f5-4ae2-818a-3d086352927d Sep 28 14:58:06 devstack sudo[96318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:07 devstack sudo[96318]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ad8a1513-45f7-4e49-a759-c47d3c427ed4 tempest-VolumesActionsTest-1610201749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c49543b8-55f5-4ae2-818a-3d086352927d" returned: 0 in 0.504s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ad8a1513-45f7-4e49-a759-c47d3c427ed4 tempest-VolumesActionsTest-1610201749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c49543b8-55f5-4ae2-818a-3d086352927d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:07 devstack sudo[96323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c49543b8-55f5-4ae2-818a-3d086352927d Sep 28 14:58:07 devstack sudo[96323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:07 devstack sudo[96323]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ad8a1513-45f7-4e49-a759-c47d3c427ed4 tempest-VolumesActionsTest-1610201749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c49543b8-55f5-4ae2-818a-3d086352927d" returned: 0 in 0.292s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:07 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ad8a1513-45f7-4e49-a759-c47d3c427ed4 tempest-VolumesActionsTest-1610201749 None] Lock "cinder-quobyte-c49543b8-55f5-4ae2-818a-3d086352927d" released by "delete_volume" :: held 0.872s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:58:07 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-ad8a1513-45f7-4e49-a759-c47d3c427ed4 tempest-VolumesActionsTest-1610201749 None] Created reservations ['a1e7ad45-f5bd-4c67-aa89-69e7879381fb', 'd37105eb-f6d7-4c5d-a23c-0b8a86206f01', '3b641bf7-86c4-4692-9164-ecb1b9d38487', '72dc3c0a-cec0-4810-b767-e3c8d34da9ed'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 14:58:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ad8a1513-45f7-4e49-a759-c47d3c427ed4 tempest-VolumesActionsTest-1610201749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:58:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ad8a1513-45f7-4e49-a759-c47d3c427ed4 tempest-VolumesActionsTest-1610201749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:58:07 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ad8a1513-45f7-4e49-a759-c47d3c427ed4 tempest-VolumesActionsTest-1610201749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:58:07 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ad8a1513-45f7-4e49-a759-c47d3c427ed4 tempest-VolumesActionsTest-1610201749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:58:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ad8a1513-45f7-4e49-a759-c47d3c427ed4 tempest-VolumesActionsTest-1610201749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:58:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ad8a1513-45f7-4e49-a759-c47d3c427ed4 tempest-VolumesActionsTest-1610201749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:07 devstack sudo[96326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 14:58:07 devstack sudo[96326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:08 devstack sudo[96326]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ad8a1513-45f7-4e49-a759-c47d3c427ed4 tempest-VolumesActionsTest-1610201749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.410s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:08 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-ad8a1513-45f7-4e49-a759-c47d3c427ed4 tempest-VolumesActionsTest-1610201749 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:58:08 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-ad8a1513-45f7-4e49-a759-c47d3c427ed4 tempest-VolumesActionsTest-1610201749 None] Deleted volume successfully. Sep 28 14:58:08 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ad8a1513-45f7-4e49-a759-c47d3c427ed4 tempest-VolumesActionsTest-1610201749 None] Lock "cinder-c49543b8-55f5-4ae2-818a-3d086352927d-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:58:08 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-e617f003-5d62-4787-b380-47d8d92fab08 tempest-VolumesActionsTest-1994849264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 14:58:08 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e617f003-5d62-4787-b380-47d8d92fab08 tempest-VolumesActionsTest-1994849264 None] Flow 'volume_create_manager' (e1fde46b-7006-4b6d-ab00-dc68cc4daa8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:58:08 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e617f003-5d62-4787-b380-47d8d92fab08 tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8c8c5ff-4d6f-48e6-ad4c-24a5c0cff5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:58:08 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e617f003-5d62-4787-b380-47d8d92fab08 tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8c8c5ff-4d6f-48e6-ad4c-24a5c0cff5be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:58:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-927793706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae78c84e-bac5-434c-bf9d-2b643f3c0dd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adcaed9cae5b4aa58fd38e0f3bb8a092',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:58:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:58:08Z,use_quota=True,user_id='6bf55dd7e43c4be9b1685be0009227da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:58:08 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e617f003-5d62-4787-b380-47d8d92fab08 tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cc0d3e0-8dd0-4d32-b046-5474d476ea26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:58:08 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e617f003-5d62-4787-b380-47d8d92fab08 tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cc0d3e0-8dd0-4d32-b046-5474d476ea26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:58:08 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e617f003-5d62-4787-b380-47d8d92fab08 tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7abfd355-fb3d-40db-a9e5-c96d78cc8b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:58:08 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e617f003-5d62-4787-b380-47d8d92fab08 tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7abfd355-fb3d-40db-a9e5-c96d78cc8b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae78c84e-bac5-434c-bf9d-2b643f3c0dd6', 'volume_name': 'volume-ae78c84e-bac5-434c-bf9d-2b643f3c0dd6', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:58:08 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e617f003-5d62-4787-b380-47d8d92fab08 tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f89494fc-f40e-4015-8cf1-8467fafee2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:58:08 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e617f003-5d62-4787-b380-47d8d92fab08 tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f89494fc-f40e-4015-8cf1-8467fafee2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:58:08 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e617f003-5d62-4787-b380-47d8d92fab08 tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (387a5ead-b7c0-4e8b-b49c-13b8118d9a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:58:08 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-e617f003-5d62-4787-b380-47d8d92fab08 tempest-VolumesActionsTest-1994849264 None] Volume ae78c84e-bac5-434c-bf9d-2b643f3c0dd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae78c84e-bac5-434c-bf9d-2b643f3c0dd6', 'volume_size': 1} Sep 28 14:58:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e617f003-5d62-4787-b380-47d8d92fab08 tempest-VolumesActionsTest-1994849264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:58:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e617f003-5d62-4787-b380-47d8d92fab08 tempest-VolumesActionsTest-1994849264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:58:08 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e617f003-5d62-4787-b380-47d8d92fab08 tempest-VolumesActionsTest-1994849264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:58:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-927793706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae78c84e-bac5-434c-bf9d-2b643f3c0dd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adcaed9cae5b4aa58fd38e0f3bb8a092',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:58:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:58:08Z,use_quota=True,user_id='6bf55dd7e43c4be9b1685be0009227da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 14:58:08 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-e617f003-5d62-4787-b380-47d8d92fab08 tempest-VolumesActionsTest-1994849264 None] Creating volume ae78c84e-bac5-434c-bf9d-2b643f3c0dd6 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 14:58:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e617f003-5d62-4787-b380-47d8d92fab08 tempest-VolumesActionsTest-1994849264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:58:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e617f003-5d62-4787-b380-47d8d92fab08 tempest-VolumesActionsTest-1994849264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:58:08 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e617f003-5d62-4787-b380-47d8d92fab08 tempest-VolumesActionsTest-1994849264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:58:08 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e617f003-5d62-4787-b380-47d8d92fab08 tempest-VolumesActionsTest-1994849264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:58:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e617f003-5d62-4787-b380-47d8d92fab08 tempest-VolumesActionsTest-1994849264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:58:08 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e617f003-5d62-4787-b380-47d8d92fab08 tempest-VolumesActionsTest-1994849264 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 14:58:08 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-e617f003-5d62-4787-b380-47d8d92fab08 tempest-VolumesActionsTest-1994849264 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 14:58:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e617f003-5d62-4787-b380-47d8d92fab08 tempest-VolumesActionsTest-1994849264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae78c84e-bac5-434c-bf9d-2b643f3c0dd6 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:08 devstack sudo[96329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae78c84e-bac5-434c-bf9d-2b643f3c0dd6 1073741824 Sep 28 14:58:08 devstack sudo[96329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:09 devstack sudo[96329]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e617f003-5d62-4787-b380-47d8d92fab08 tempest-VolumesActionsTest-1994849264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae78c84e-bac5-434c-bf9d-2b643f3c0dd6 1073741824" returned: 0 in 0.581s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e617f003-5d62-4787-b380-47d8d92fab08 tempest-VolumesActionsTest-1994849264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae78c84e-bac5-434c-bf9d-2b643f3c0dd6 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:09 devstack sudo[96335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae78c84e-bac5-434c-bf9d-2b643f3c0dd6 Sep 28 14:58:09 devstack sudo[96335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:09 devstack sudo[96335]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e617f003-5d62-4787-b380-47d8d92fab08 tempest-VolumesActionsTest-1994849264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae78c84e-bac5-434c-bf9d-2b643f3c0dd6" returned: 0 in 0.298s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:09 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e617f003-5d62-4787-b380-47d8d92fab08 tempest-VolumesActionsTest-1994849264 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 14:58:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e617f003-5d62-4787-b380-47d8d92fab08 tempest-VolumesActionsTest-1994849264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:58:09 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e617f003-5d62-4787-b380-47d8d92fab08 tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (387a5ead-b7c0-4e8b-b49c-13b8118d9a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae78c84e-bac5-434c-bf9d-2b643f3c0dd6', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:58:09 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e617f003-5d62-4787-b380-47d8d92fab08 tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf25055f-8bad-4391-9cc4-b9952e4e1ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:58:09 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-e617f003-5d62-4787-b380-47d8d92fab08 tempest-VolumesActionsTest-1994849264 None] Volume volume-ae78c84e-bac5-434c-bf9d-2b643f3c0dd6 (ae78c84e-bac5-434c-bf9d-2b643f3c0dd6): created successfully Sep 28 14:58:09 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e617f003-5d62-4787-b380-47d8d92fab08 tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf25055f-8bad-4391-9cc4-b9952e4e1ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:58:09 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e617f003-5d62-4787-b380-47d8d92fab08 tempest-VolumesActionsTest-1994849264 None] Flow 'volume_create_manager' (e1fde46b-7006-4b6d-ab00-dc68cc4daa8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:58:09 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-e617f003-5d62-4787-b380-47d8d92fab08 tempest-VolumesActionsTest-1994849264 None] Created volume successfully. Sep 28 14:58:10 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ac3ba32f-0ec8-4baa-8d8f-aa3da6091b35 tempest-VolumesActionsTest-1610201749 None] Acquiring lock "cinder-ae78c84e-bac5-434c-bf9d-2b643f3c0dd6-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:58:10 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ac3ba32f-0ec8-4baa-8d8f-aa3da6091b35 tempest-VolumesActionsTest-1610201749 None] Lock "cinder-ae78c84e-bac5-434c-bf9d-2b643f3c0dd6-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:58:10 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ac3ba32f-0ec8-4baa-8d8f-aa3da6091b35 tempest-VolumesActionsTest-1610201749 None] Acquiring lock "cinder-quobyte-ae78c84e-bac5-434c-bf9d-2b643f3c0dd6" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:58:10 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ac3ba32f-0ec8-4baa-8d8f-aa3da6091b35 tempest-VolumesActionsTest-1610201749 None] Lock "cinder-quobyte-ae78c84e-bac5-434c-bf9d-2b643f3c0dd6" acquired by "delete_volume" :: waited 0.014s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:58:10 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[f227a9ad-ceb4-47e7-938c-44e3387efdb7]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:58:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ac3ba32f-0ec8-4baa-8d8f-aa3da6091b35 tempest-VolumesActionsTest-1610201749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae78c84e-bac5-434c-bf9d-2b643f3c0dd6 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:10 devstack sudo[96340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae78c84e-bac5-434c-bf9d-2b643f3c0dd6 Sep 28 14:58:10 devstack sudo[96340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:11 devstack sudo[96340]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ac3ba32f-0ec8-4baa-8d8f-aa3da6091b35 tempest-VolumesActionsTest-1610201749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae78c84e-bac5-434c-bf9d-2b643f3c0dd6" returned: 0 in 0.470s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ac3ba32f-0ec8-4baa-8d8f-aa3da6091b35 tempest-VolumesActionsTest-1610201749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae78c84e-bac5-434c-bf9d-2b643f3c0dd6 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:11 devstack sudo[96345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae78c84e-bac5-434c-bf9d-2b643f3c0dd6 Sep 28 14:58:11 devstack sudo[96345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:11 devstack sudo[96345]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ac3ba32f-0ec8-4baa-8d8f-aa3da6091b35 tempest-VolumesActionsTest-1610201749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae78c84e-bac5-434c-bf9d-2b643f3c0dd6" returned: 0 in 0.338s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:11 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ac3ba32f-0ec8-4baa-8d8f-aa3da6091b35 tempest-VolumesActionsTest-1610201749 None] Lock "cinder-quobyte-ae78c84e-bac5-434c-bf9d-2b643f3c0dd6" released by "delete_volume" :: held 0.862s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:58:11 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-ac3ba32f-0ec8-4baa-8d8f-aa3da6091b35 tempest-VolumesActionsTest-1610201749 None] Created reservations ['8915c2c5-dc56-4714-bc2b-14e5d0c57182', '9f4576eb-fe95-45b6-ad87-5a1a6036f98c', '98913a04-c5f2-4e01-bf9e-9529573b9495', 'c079b363-24dd-4992-82d9-157d20f27747'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 14:58:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ac3ba32f-0ec8-4baa-8d8f-aa3da6091b35 tempest-VolumesActionsTest-1610201749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:58:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ac3ba32f-0ec8-4baa-8d8f-aa3da6091b35 tempest-VolumesActionsTest-1610201749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:58:11 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ac3ba32f-0ec8-4baa-8d8f-aa3da6091b35 tempest-VolumesActionsTest-1610201749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:58:11 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ac3ba32f-0ec8-4baa-8d8f-aa3da6091b35 tempest-VolumesActionsTest-1610201749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:58:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ac3ba32f-0ec8-4baa-8d8f-aa3da6091b35 tempest-VolumesActionsTest-1610201749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:58:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ac3ba32f-0ec8-4baa-8d8f-aa3da6091b35 tempest-VolumesActionsTest-1610201749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:11 devstack sudo[96348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 14:58:11 devstack sudo[96348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:12 devstack sudo[96348]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ac3ba32f-0ec8-4baa-8d8f-aa3da6091b35 tempest-VolumesActionsTest-1610201749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.387s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:12 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-ac3ba32f-0ec8-4baa-8d8f-aa3da6091b35 tempest-VolumesActionsTest-1610201749 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:58:12 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-ac3ba32f-0ec8-4baa-8d8f-aa3da6091b35 tempest-VolumesActionsTest-1610201749 None] Deleted volume successfully. Sep 28 14:58:12 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ac3ba32f-0ec8-4baa-8d8f-aa3da6091b35 tempest-VolumesActionsTest-1610201749 None] Lock "cinder-ae78c84e-bac5-434c-bf9d-2b643f3c0dd6-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:58:12 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-88b601f7-890a-4cd7-8aa7-bdc3de390986 tempest-VolumesActionsTest-1994849264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 14:58:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-88b601f7-890a-4cd7-8aa7-bdc3de390986 tempest-VolumesActionsTest-1994849264 None] Flow 'volume_create_manager' (290d4585-3d67-4726-899c-463a6153ebe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:58:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-88b601f7-890a-4cd7-8aa7-bdc3de390986 tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b724d0a9-22b5-4a57-9db7-763a7484724b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:58:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-88b601f7-890a-4cd7-8aa7-bdc3de390986 tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b724d0a9-22b5-4a57-9db7-763a7484724b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:58:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1047376611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d75d887-4d25-48a2-96e1-11add7870f58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adcaed9cae5b4aa58fd38e0f3bb8a092',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:58:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:58:13Z,use_quota=True,user_id='6bf55dd7e43c4be9b1685be0009227da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:58:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-88b601f7-890a-4cd7-8aa7-bdc3de390986 tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26983feb-51fe-4234-9a72-e2b0af042055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:58:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-88b601f7-890a-4cd7-8aa7-bdc3de390986 tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26983feb-51fe-4234-9a72-e2b0af042055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:58:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-88b601f7-890a-4cd7-8aa7-bdc3de390986 tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ff46c26-e8b2-4615-8e2a-a0c90f5f2a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:58:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-88b601f7-890a-4cd7-8aa7-bdc3de390986 tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ff46c26-e8b2-4615-8e2a-a0c90f5f2a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d75d887-4d25-48a2-96e1-11add7870f58', 'volume_name': 'volume-6d75d887-4d25-48a2-96e1-11add7870f58', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:58:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-88b601f7-890a-4cd7-8aa7-bdc3de390986 tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (215d1ca6-6873-4e80-8430-862ab0c6172a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:58:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-88b601f7-890a-4cd7-8aa7-bdc3de390986 tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (215d1ca6-6873-4e80-8430-862ab0c6172a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:58:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-88b601f7-890a-4cd7-8aa7-bdc3de390986 tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec1d80bb-19e9-4a49-8d86-d13b9be594ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:58:12 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-88b601f7-890a-4cd7-8aa7-bdc3de390986 tempest-VolumesActionsTest-1994849264 None] Volume 6d75d887-4d25-48a2-96e1-11add7870f58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d75d887-4d25-48a2-96e1-11add7870f58', 'volume_size': 1} Sep 28 14:58:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-88b601f7-890a-4cd7-8aa7-bdc3de390986 tempest-VolumesActionsTest-1994849264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:58:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-88b601f7-890a-4cd7-8aa7-bdc3de390986 tempest-VolumesActionsTest-1994849264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:58:12 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-88b601f7-890a-4cd7-8aa7-bdc3de390986 tempest-VolumesActionsTest-1994849264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:58:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1047376611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d75d887-4d25-48a2-96e1-11add7870f58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adcaed9cae5b4aa58fd38e0f3bb8a092',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:58:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:58:13Z,use_quota=True,user_id='6bf55dd7e43c4be9b1685be0009227da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 14:58:12 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-88b601f7-890a-4cd7-8aa7-bdc3de390986 tempest-VolumesActionsTest-1994849264 None] Creating volume 6d75d887-4d25-48a2-96e1-11add7870f58 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 14:58:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-88b601f7-890a-4cd7-8aa7-bdc3de390986 tempest-VolumesActionsTest-1994849264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:58:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-88b601f7-890a-4cd7-8aa7-bdc3de390986 tempest-VolumesActionsTest-1994849264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:58:12 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-88b601f7-890a-4cd7-8aa7-bdc3de390986 tempest-VolumesActionsTest-1994849264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:58:12 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-88b601f7-890a-4cd7-8aa7-bdc3de390986 tempest-VolumesActionsTest-1994849264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:58:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-88b601f7-890a-4cd7-8aa7-bdc3de390986 tempest-VolumesActionsTest-1994849264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:58:12 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-88b601f7-890a-4cd7-8aa7-bdc3de390986 tempest-VolumesActionsTest-1994849264 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 14:58:12 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-88b601f7-890a-4cd7-8aa7-bdc3de390986 tempest-VolumesActionsTest-1994849264 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 14:58:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-88b601f7-890a-4cd7-8aa7-bdc3de390986 tempest-VolumesActionsTest-1994849264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6d75d887-4d25-48a2-96e1-11add7870f58 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:13 devstack sudo[96351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6d75d887-4d25-48a2-96e1-11add7870f58 1073741824 Sep 28 14:58:13 devstack sudo[96351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:13 devstack sudo[96351]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-88b601f7-890a-4cd7-8aa7-bdc3de390986 tempest-VolumesActionsTest-1994849264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6d75d887-4d25-48a2-96e1-11add7870f58 1073741824" returned: 0 in 0.754s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-88b601f7-890a-4cd7-8aa7-bdc3de390986 tempest-VolumesActionsTest-1994849264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6d75d887-4d25-48a2-96e1-11add7870f58 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:13 devstack sudo[96357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6d75d887-4d25-48a2-96e1-11add7870f58 Sep 28 14:58:13 devstack sudo[96357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:14 devstack sudo[96357]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-88b601f7-890a-4cd7-8aa7-bdc3de390986 tempest-VolumesActionsTest-1994849264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6d75d887-4d25-48a2-96e1-11add7870f58" returned: 0 in 0.332s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:14 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-88b601f7-890a-4cd7-8aa7-bdc3de390986 tempest-VolumesActionsTest-1994849264 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 14:58:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-88b601f7-890a-4cd7-8aa7-bdc3de390986 tempest-VolumesActionsTest-1994849264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:58:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-88b601f7-890a-4cd7-8aa7-bdc3de390986 tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec1d80bb-19e9-4a49-8d86-d13b9be594ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d75d887-4d25-48a2-96e1-11add7870f58', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:58:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-88b601f7-890a-4cd7-8aa7-bdc3de390986 tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1716821-d2db-4293-b0bf-e182b7fc0081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:58:14 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-88b601f7-890a-4cd7-8aa7-bdc3de390986 tempest-VolumesActionsTest-1994849264 None] Volume volume-6d75d887-4d25-48a2-96e1-11add7870f58 (6d75d887-4d25-48a2-96e1-11add7870f58): created successfully Sep 28 14:58:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-88b601f7-890a-4cd7-8aa7-bdc3de390986 tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1716821-d2db-4293-b0bf-e182b7fc0081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:58:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-88b601f7-890a-4cd7-8aa7-bdc3de390986 tempest-VolumesActionsTest-1994849264 None] Flow 'volume_create_manager' (290d4585-3d67-4726-899c-463a6153ebe8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:58:14 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-88b601f7-890a-4cd7-8aa7-bdc3de390986 tempest-VolumesActionsTest-1994849264 None] Created volume successfully. Sep 28 14:58:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-62641deb-4935-459e-ab2b-1bc97c89ff57 tempest-VolumesActionsTest-1610201749 None] Acquiring lock "cinder-6d75d887-4d25-48a2-96e1-11add7870f58-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:58:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-62641deb-4935-459e-ab2b-1bc97c89ff57 tempest-VolumesActionsTest-1610201749 None] Lock "cinder-6d75d887-4d25-48a2-96e1-11add7870f58-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:58:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-62641deb-4935-459e-ab2b-1bc97c89ff57 tempest-VolumesActionsTest-1610201749 None] Acquiring lock "cinder-quobyte-6d75d887-4d25-48a2-96e1-11add7870f58" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:58:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-62641deb-4935-459e-ab2b-1bc97c89ff57 tempest-VolumesActionsTest-1610201749 None] Lock "cinder-quobyte-6d75d887-4d25-48a2-96e1-11add7870f58" acquired by "delete_volume" :: waited 0.025s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:58:15 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[022f9b6b-5b0e-4824-97db-37b8e5d4d88b]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:58:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-62641deb-4935-459e-ab2b-1bc97c89ff57 tempest-VolumesActionsTest-1610201749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6d75d887-4d25-48a2-96e1-11add7870f58 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:15 devstack sudo[96361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6d75d887-4d25-48a2-96e1-11add7870f58 Sep 28 14:58:15 devstack sudo[96361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:15 devstack sudo[96361]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-62641deb-4935-459e-ab2b-1bc97c89ff57 tempest-VolumesActionsTest-1610201749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6d75d887-4d25-48a2-96e1-11add7870f58" returned: 0 in 0.533s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-62641deb-4935-459e-ab2b-1bc97c89ff57 tempest-VolumesActionsTest-1610201749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6d75d887-4d25-48a2-96e1-11add7870f58 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:15 devstack sudo[96366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6d75d887-4d25-48a2-96e1-11add7870f58 Sep 28 14:58:15 devstack sudo[96366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:16 devstack sudo[96366]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-62641deb-4935-459e-ab2b-1bc97c89ff57 tempest-VolumesActionsTest-1610201749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6d75d887-4d25-48a2-96e1-11add7870f58" returned: 0 in 0.444s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:16 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-62641deb-4935-459e-ab2b-1bc97c89ff57 tempest-VolumesActionsTest-1610201749 None] Lock "cinder-quobyte-6d75d887-4d25-48a2-96e1-11add7870f58" released by "delete_volume" :: held 1.068s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:58:16 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-62641deb-4935-459e-ab2b-1bc97c89ff57 tempest-VolumesActionsTest-1610201749 None] Created reservations ['8cff37e0-7487-47a3-92e5-6d9e77bbe406', '844833df-d1e9-4d27-9e83-3829ddbf88ed', '661ea6b0-4833-470c-8864-ae889b6deb4c', '2e31cbf0-6514-4557-a315-e54c7cb633a2'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 14:58:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-62641deb-4935-459e-ab2b-1bc97c89ff57 tempest-VolumesActionsTest-1610201749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:58:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-62641deb-4935-459e-ab2b-1bc97c89ff57 tempest-VolumesActionsTest-1610201749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:58:16 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-62641deb-4935-459e-ab2b-1bc97c89ff57 tempest-VolumesActionsTest-1610201749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:58:16 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-62641deb-4935-459e-ab2b-1bc97c89ff57 tempest-VolumesActionsTest-1610201749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:58:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-62641deb-4935-459e-ab2b-1bc97c89ff57 tempest-VolumesActionsTest-1610201749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:58:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-62641deb-4935-459e-ab2b-1bc97c89ff57 tempest-VolumesActionsTest-1610201749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:16 devstack sudo[96369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 14:58:16 devstack sudo[96369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:16 devstack sudo[96369]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-62641deb-4935-459e-ab2b-1bc97c89ff57 tempest-VolumesActionsTest-1610201749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.325s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:16 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-62641deb-4935-459e-ab2b-1bc97c89ff57 tempest-VolumesActionsTest-1610201749 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:58:16 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:58:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:58:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:58:16 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:58:16 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:58:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:58:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:17 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-62641deb-4935-459e-ab2b-1bc97c89ff57 tempest-VolumesActionsTest-1610201749 None] Deleted volume successfully. Sep 28 14:58:17 devstack sudo[96372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 14:58:17 devstack sudo[96372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:17 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-62641deb-4935-459e-ab2b-1bc97c89ff57 tempest-VolumesActionsTest-1610201749 None] Lock "cinder-6d75d887-4d25-48a2-96e1-11add7870f58-delete_volume" released by "delete_volume" :: held 1.812s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:58:17 devstack sudo[96372]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.381s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:17 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:58:17 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running periodic task VolumeManager._thread_info {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:58:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] thread count: 28 {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 14:58:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] thread info: [<_MainThread(MainThread, started 135146735652992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 14:58:18 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-8471ac01-d718-4cb0-9159-b3e3ab6a0d07 tempest-VolumesActionsTest-1994849264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 14:58:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8471ac01-d718-4cb0-9159-b3e3ab6a0d07 tempest-VolumesActionsTest-1994849264 None] Flow 'volume_create_manager' (f3e7455d-4d32-4933-93ed-39614981ed26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:58:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8471ac01-d718-4cb0-9159-b3e3ab6a0d07 tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49a4807b-8ee1-469c-aad6-1266b57c39f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:58:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8471ac01-d718-4cb0-9159-b3e3ab6a0d07 tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49a4807b-8ee1-469c-aad6-1266b57c39f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1743822649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6a95f08-6509-4012-a7d8-5846f04050f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adcaed9cae5b4aa58fd38e0f3bb8a092',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:58:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:58:18Z,use_quota=True,user_id='6bf55dd7e43c4be9b1685be0009227da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:58:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8471ac01-d718-4cb0-9159-b3e3ab6a0d07 tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f61f2622-c447-4bbb-aaa7-e9dff2370700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:58:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8471ac01-d718-4cb0-9159-b3e3ab6a0d07 tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f61f2622-c447-4bbb-aaa7-e9dff2370700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:58:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8471ac01-d718-4cb0-9159-b3e3ab6a0d07 tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (904e5b51-f5d2-4532-a8b5-52cc5fa7d2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:58:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8471ac01-d718-4cb0-9159-b3e3ab6a0d07 tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (904e5b51-f5d2-4532-a8b5-52cc5fa7d2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6a95f08-6509-4012-a7d8-5846f04050f8', 'volume_name': 'volume-f6a95f08-6509-4012-a7d8-5846f04050f8', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:58:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8471ac01-d718-4cb0-9159-b3e3ab6a0d07 tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (360baa40-dd48-4f8e-8a1b-0b76ceaf638d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:58:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8471ac01-d718-4cb0-9159-b3e3ab6a0d07 tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (360baa40-dd48-4f8e-8a1b-0b76ceaf638d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:58:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8471ac01-d718-4cb0-9159-b3e3ab6a0d07 tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db4321af-722b-44d4-8aef-012de6343602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:58:18 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-8471ac01-d718-4cb0-9159-b3e3ab6a0d07 tempest-VolumesActionsTest-1994849264 None] Volume f6a95f08-6509-4012-a7d8-5846f04050f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6a95f08-6509-4012-a7d8-5846f04050f8', 'volume_size': 1} Sep 28 14:58:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8471ac01-d718-4cb0-9159-b3e3ab6a0d07 tempest-VolumesActionsTest-1994849264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:58:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8471ac01-d718-4cb0-9159-b3e3ab6a0d07 tempest-VolumesActionsTest-1994849264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:58:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8471ac01-d718-4cb0-9159-b3e3ab6a0d07 tempest-VolumesActionsTest-1994849264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1743822649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6a95f08-6509-4012-a7d8-5846f04050f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adcaed9cae5b4aa58fd38e0f3bb8a092',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:58:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:58:18Z,use_quota=True,user_id='6bf55dd7e43c4be9b1685be0009227da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 14:58:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-8471ac01-d718-4cb0-9159-b3e3ab6a0d07 tempest-VolumesActionsTest-1994849264 None] Creating volume f6a95f08-6509-4012-a7d8-5846f04050f8 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 14:58:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8471ac01-d718-4cb0-9159-b3e3ab6a0d07 tempest-VolumesActionsTest-1994849264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:58:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8471ac01-d718-4cb0-9159-b3e3ab6a0d07 tempest-VolumesActionsTest-1994849264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:58:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8471ac01-d718-4cb0-9159-b3e3ab6a0d07 tempest-VolumesActionsTest-1994849264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:58:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8471ac01-d718-4cb0-9159-b3e3ab6a0d07 tempest-VolumesActionsTest-1994849264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:58:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8471ac01-d718-4cb0-9159-b3e3ab6a0d07 tempest-VolumesActionsTest-1994849264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:58:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8471ac01-d718-4cb0-9159-b3e3ab6a0d07 tempest-VolumesActionsTest-1994849264 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 14:58:18 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-8471ac01-d718-4cb0-9159-b3e3ab6a0d07 tempest-VolumesActionsTest-1994849264 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 14:58:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8471ac01-d718-4cb0-9159-b3e3ab6a0d07 tempest-VolumesActionsTest-1994849264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f6a95f08-6509-4012-a7d8-5846f04050f8 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:18 devstack sudo[96375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f6a95f08-6509-4012-a7d8-5846f04050f8 1073741824 Sep 28 14:58:18 devstack sudo[96375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:19 devstack sudo[96375]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8471ac01-d718-4cb0-9159-b3e3ab6a0d07 tempest-VolumesActionsTest-1994849264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f6a95f08-6509-4012-a7d8-5846f04050f8 1073741824" returned: 0 in 0.734s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8471ac01-d718-4cb0-9159-b3e3ab6a0d07 tempest-VolumesActionsTest-1994849264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f6a95f08-6509-4012-a7d8-5846f04050f8 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:19 devstack sudo[96381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f6a95f08-6509-4012-a7d8-5846f04050f8 Sep 28 14:58:19 devstack sudo[96381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:19 devstack sudo[96381]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8471ac01-d718-4cb0-9159-b3e3ab6a0d07 tempest-VolumesActionsTest-1994849264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f6a95f08-6509-4012-a7d8-5846f04050f8" returned: 0 in 0.379s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8471ac01-d718-4cb0-9159-b3e3ab6a0d07 tempest-VolumesActionsTest-1994849264 None] <== create_volume: return (1197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 14:58:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8471ac01-d718-4cb0-9159-b3e3ab6a0d07 tempest-VolumesActionsTest-1994849264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.204s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:58:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8471ac01-d718-4cb0-9159-b3e3ab6a0d07 tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db4321af-722b-44d4-8aef-012de6343602) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6a95f08-6509-4012-a7d8-5846f04050f8', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:58:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8471ac01-d718-4cb0-9159-b3e3ab6a0d07 tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e43c3f2f-4d32-49f2-bdc4-85fffd21f3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:58:19 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-8471ac01-d718-4cb0-9159-b3e3ab6a0d07 tempest-VolumesActionsTest-1994849264 None] Volume volume-f6a95f08-6509-4012-a7d8-5846f04050f8 (f6a95f08-6509-4012-a7d8-5846f04050f8): created successfully Sep 28 14:58:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8471ac01-d718-4cb0-9159-b3e3ab6a0d07 tempest-VolumesActionsTest-1994849264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e43c3f2f-4d32-49f2-bdc4-85fffd21f3fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:58:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8471ac01-d718-4cb0-9159-b3e3ab6a0d07 tempest-VolumesActionsTest-1994849264 None] Flow 'volume_create_manager' (f3e7455d-4d32-4933-93ed-39614981ed26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:58:19 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-8471ac01-d718-4cb0-9159-b3e3ab6a0d07 tempest-VolumesActionsTest-1994849264 None] Created volume successfully. Sep 28 14:58:21 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3e17d822-a8e0-432f-ba29-5bb26c021f04 tempest-VolumesActionsTest-1994849264 None] Acquiring lock "cinder-f6a95f08-6509-4012-a7d8-5846f04050f8-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:58:21 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3e17d822-a8e0-432f-ba29-5bb26c021f04 tempest-VolumesActionsTest-1994849264 None] Lock "cinder-f6a95f08-6509-4012-a7d8-5846f04050f8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:58:21 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3e17d822-a8e0-432f-ba29-5bb26c021f04 tempest-VolumesActionsTest-1994849264 None] Acquiring lock "cinder-quobyte-f6a95f08-6509-4012-a7d8-5846f04050f8" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:58:21 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3e17d822-a8e0-432f-ba29-5bb26c021f04 tempest-VolumesActionsTest-1994849264 None] Lock "cinder-quobyte-f6a95f08-6509-4012-a7d8-5846f04050f8" acquired by "delete_volume" :: waited 0.025s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:58:21 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad76f715-5a63-43b0-a0bf-e6b8b1f51cc0]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:58:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3e17d822-a8e0-432f-ba29-5bb26c021f04 tempest-VolumesActionsTest-1994849264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f6a95f08-6509-4012-a7d8-5846f04050f8 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:21 devstack sudo[96385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f6a95f08-6509-4012-a7d8-5846f04050f8 Sep 28 14:58:21 devstack sudo[96385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:22 devstack sudo[96385]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3e17d822-a8e0-432f-ba29-5bb26c021f04 tempest-VolumesActionsTest-1994849264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f6a95f08-6509-4012-a7d8-5846f04050f8" returned: 0 in 0.555s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3e17d822-a8e0-432f-ba29-5bb26c021f04 tempest-VolumesActionsTest-1994849264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f6a95f08-6509-4012-a7d8-5846f04050f8 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:22 devstack sudo[96390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f6a95f08-6509-4012-a7d8-5846f04050f8 Sep 28 14:58:22 devstack sudo[96390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:22 devstack sudo[96390]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3e17d822-a8e0-432f-ba29-5bb26c021f04 tempest-VolumesActionsTest-1994849264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f6a95f08-6509-4012-a7d8-5846f04050f8" returned: 0 in 0.346s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:22 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3e17d822-a8e0-432f-ba29-5bb26c021f04 tempest-VolumesActionsTest-1994849264 None] Lock "cinder-quobyte-f6a95f08-6509-4012-a7d8-5846f04050f8" released by "delete_volume" :: held 0.972s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:58:22 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-3e17d822-a8e0-432f-ba29-5bb26c021f04 tempest-VolumesActionsTest-1994849264 None] Created reservations ['351c7081-5bd7-4f1c-9ae5-dfc9b2e83dcf', '129f6ced-4c15-47a8-a4b4-18548476aeeb', '82d534a2-bc85-4c6c-8731-713f711ca03c', '259dadae-549b-410b-8c7c-030c67013b73'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 14:58:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3e17d822-a8e0-432f-ba29-5bb26c021f04 tempest-VolumesActionsTest-1994849264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:58:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3e17d822-a8e0-432f-ba29-5bb26c021f04 tempest-VolumesActionsTest-1994849264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:58:22 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3e17d822-a8e0-432f-ba29-5bb26c021f04 tempest-VolumesActionsTest-1994849264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:58:22 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3e17d822-a8e0-432f-ba29-5bb26c021f04 tempest-VolumesActionsTest-1994849264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:58:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3e17d822-a8e0-432f-ba29-5bb26c021f04 tempest-VolumesActionsTest-1994849264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:58:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3e17d822-a8e0-432f-ba29-5bb26c021f04 tempest-VolumesActionsTest-1994849264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:22 devstack sudo[96393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 14:58:22 devstack sudo[96393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:23 devstack sudo[96393]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3e17d822-a8e0-432f-ba29-5bb26c021f04 tempest-VolumesActionsTest-1994849264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.305s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:23 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-3e17d822-a8e0-432f-ba29-5bb26c021f04 tempest-VolumesActionsTest-1994849264 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:58:23 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-3e17d822-a8e0-432f-ba29-5bb26c021f04 tempest-VolumesActionsTest-1994849264 None] Deleted volume successfully. Sep 28 14:58:23 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3e17d822-a8e0-432f-ba29-5bb26c021f04 tempest-VolumesActionsTest-1994849264 None] Lock "cinder-f6a95f08-6509-4012-a7d8-5846f04050f8-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:58:28 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-68e80817-88d9-4ee8-9dab-f1b14e9809b0 tempest-SnapshotsActionsTest-2008821915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 14:58:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-68e80817-88d9-4ee8-9dab-f1b14e9809b0 tempest-SnapshotsActionsTest-2008821915 None] Flow 'volume_create_manager' (50c9eba7-bb13-4258-883f-784b2ce48072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:58:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-68e80817-88d9-4ee8-9dab-f1b14e9809b0 tempest-SnapshotsActionsTest-2008821915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ea1a023-d3d8-43fd-9489-3e3d2b5339bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:58:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-68e80817-88d9-4ee8-9dab-f1b14e9809b0 tempest-SnapshotsActionsTest-2008821915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ea1a023-d3d8-43fd-9489-3e3d2b5339bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:58:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-164591187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='409a205918b1421fbd8f2b73f9f8c98b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:58:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:58:28Z,use_quota=True,user_id='1884e93cfca14b3ca14452fa14c94b0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:58:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-68e80817-88d9-4ee8-9dab-f1b14e9809b0 tempest-SnapshotsActionsTest-2008821915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e985cd6-9559-405b-804c-02aaa4258404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:58:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-68e80817-88d9-4ee8-9dab-f1b14e9809b0 tempest-SnapshotsActionsTest-2008821915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e985cd6-9559-405b-804c-02aaa4258404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:58:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-68e80817-88d9-4ee8-9dab-f1b14e9809b0 tempest-SnapshotsActionsTest-2008821915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9683eba4-0ce2-4362-8cbb-829548c9ba07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:58:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-68e80817-88d9-4ee8-9dab-f1b14e9809b0 tempest-SnapshotsActionsTest-2008821915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9683eba4-0ce2-4362-8cbb-829548c9ba07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0', 'volume_name': 'volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:58:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-68e80817-88d9-4ee8-9dab-f1b14e9809b0 tempest-SnapshotsActionsTest-2008821915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02ca43d2-d4ed-4c6a-9e6b-f19338a2c4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:58:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-68e80817-88d9-4ee8-9dab-f1b14e9809b0 tempest-SnapshotsActionsTest-2008821915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02ca43d2-d4ed-4c6a-9e6b-f19338a2c4c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:58:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-68e80817-88d9-4ee8-9dab-f1b14e9809b0 tempest-SnapshotsActionsTest-2008821915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (643a577f-6de9-423e-998e-359b7d5f5e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:58:28 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-68e80817-88d9-4ee8-9dab-f1b14e9809b0 tempest-SnapshotsActionsTest-2008821915 None] Volume 4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0', 'volume_size': 1} Sep 28 14:58:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-68e80817-88d9-4ee8-9dab-f1b14e9809b0 tempest-SnapshotsActionsTest-2008821915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:58:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-68e80817-88d9-4ee8-9dab-f1b14e9809b0 tempest-SnapshotsActionsTest-2008821915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:58:28 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-68e80817-88d9-4ee8-9dab-f1b14e9809b0 tempest-SnapshotsActionsTest-2008821915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:58:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-164591187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='409a205918b1421fbd8f2b73f9f8c98b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:58:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:58:28Z,use_quota=True,user_id='1884e93cfca14b3ca14452fa14c94b0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 14:58:28 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-68e80817-88d9-4ee8-9dab-f1b14e9809b0 tempest-SnapshotsActionsTest-2008821915 None] Creating volume 4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 14:58:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-68e80817-88d9-4ee8-9dab-f1b14e9809b0 tempest-SnapshotsActionsTest-2008821915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:58:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-68e80817-88d9-4ee8-9dab-f1b14e9809b0 tempest-SnapshotsActionsTest-2008821915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:58:28 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-68e80817-88d9-4ee8-9dab-f1b14e9809b0 tempest-SnapshotsActionsTest-2008821915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:58:28 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-68e80817-88d9-4ee8-9dab-f1b14e9809b0 tempest-SnapshotsActionsTest-2008821915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:58:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-68e80817-88d9-4ee8-9dab-f1b14e9809b0 tempest-SnapshotsActionsTest-2008821915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:58:28 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-68e80817-88d9-4ee8-9dab-f1b14e9809b0 tempest-SnapshotsActionsTest-2008821915 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 14:58:28 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-68e80817-88d9-4ee8-9dab-f1b14e9809b0 tempest-SnapshotsActionsTest-2008821915 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 14:58:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-68e80817-88d9-4ee8-9dab-f1b14e9809b0 tempest-SnapshotsActionsTest-2008821915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:28 devstack sudo[96434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0 1073741824 Sep 28 14:58:28 devstack sudo[96434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:29 devstack sudo[96434]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-68e80817-88d9-4ee8-9dab-f1b14e9809b0 tempest-SnapshotsActionsTest-2008821915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0 1073741824" returned: 0 in 0.629s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-68e80817-88d9-4ee8-9dab-f1b14e9809b0 tempest-SnapshotsActionsTest-2008821915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:29 devstack sudo[96442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0 Sep 28 14:58:29 devstack sudo[96442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:29 devstack sudo[96442]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-68e80817-88d9-4ee8-9dab-f1b14e9809b0 tempest-SnapshotsActionsTest-2008821915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0" returned: 0 in 0.365s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:29 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-68e80817-88d9-4ee8-9dab-f1b14e9809b0 tempest-SnapshotsActionsTest-2008821915 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 14:58:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-68e80817-88d9-4ee8-9dab-f1b14e9809b0 tempest-SnapshotsActionsTest-2008821915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:58:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-68e80817-88d9-4ee8-9dab-f1b14e9809b0 tempest-SnapshotsActionsTest-2008821915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (643a577f-6de9-423e-998e-359b7d5f5e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:58:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-68e80817-88d9-4ee8-9dab-f1b14e9809b0 tempest-SnapshotsActionsTest-2008821915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (880a911c-f969-4021-a744-fcb93b37897a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:58:29 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-68e80817-88d9-4ee8-9dab-f1b14e9809b0 tempest-SnapshotsActionsTest-2008821915 None] Volume volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0 (4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0): created successfully Sep 28 14:58:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-68e80817-88d9-4ee8-9dab-f1b14e9809b0 tempest-SnapshotsActionsTest-2008821915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (880a911c-f969-4021-a744-fcb93b37897a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:58:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-68e80817-88d9-4ee8-9dab-f1b14e9809b0 tempest-SnapshotsActionsTest-2008821915 None] Flow 'volume_create_manager' (50c9eba7-bb13-4258-883f-784b2ce48072) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:58:29 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-68e80817-88d9-4ee8-9dab-f1b14e9809b0 tempest-SnapshotsActionsTest-2008821915 None] Created volume successfully. Sep 28 14:58:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b752b279-e5ce-4fae-9e55-fab48e312d6c tempest-SnapshotsActionsTest-2008821915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:58:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b752b279-e5ce-4fae-9e55-fab48e312d6c tempest-SnapshotsActionsTest-2008821915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:58:31 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-b752b279-e5ce-4fae-9e55-fab48e312d6c tempest-SnapshotsActionsTest-2008821915 None] Creating offline snapshot 73a05ef3-452c-4103-b49d-367cbcfe409c of volume 4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0 {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 14:58:31 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c35ba4-cf1c-4cf9-bd36-d916bc2524fe]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:58:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b752b279-e5ce-4fae-9e55-fab48e312d6c tempest-SnapshotsActionsTest-2008821915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:31 devstack sudo[96448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0 Sep 28 14:58:31 devstack sudo[96448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:31 devstack sudo[96448]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b752b279-e5ce-4fae-9e55-fab48e312d6c tempest-SnapshotsActionsTest-2008821915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0" returned: 0 in 0.477s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b752b279-e5ce-4fae-9e55-fab48e312d6c tempest-SnapshotsActionsTest-2008821915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:31 devstack sudo[96453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c 1G Sep 28 14:58:31 devstack sudo[96453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:32 devstack sudo[96453]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b752b279-e5ce-4fae-9e55-fab48e312d6c tempest-SnapshotsActionsTest-2008821915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c 1G" returned: 0 in 0.703s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b752b279-e5ce-4fae-9e55-fab48e312d6c tempest-SnapshotsActionsTest-2008821915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:32 devstack sudo[96466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c Sep 28 14:58:32 devstack sudo[96466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:32 devstack sudo[96466]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b752b279-e5ce-4fae-9e55-fab48e312d6c tempest-SnapshotsActionsTest-2008821915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c" returned: 0 in 0.375s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:32 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-b752b279-e5ce-4fae-9e55-fab48e312d6c tempest-SnapshotsActionsTest-2008821915 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c is being set with open permissions: ugo+rw Sep 28 14:58:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b752b279-e5ce-4fae-9e55-fab48e312d6c tempest-SnapshotsActionsTest-2008821915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:32 devstack sudo[96471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c Sep 28 14:58:32 devstack sudo[96471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:32 devstack sudo[96471]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b752b279-e5ce-4fae-9e55-fab48e312d6c tempest-SnapshotsActionsTest-2008821915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c" returned: 0 in 0.299s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b752b279-e5ce-4fae-9e55-fab48e312d6c tempest-SnapshotsActionsTest-2008821915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:33 devstack sudo[96474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.info Sep 28 14:58:33 devstack sudo[96474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:33 devstack sudo[96474]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b752b279-e5ce-4fae-9e55-fab48e312d6c tempest-SnapshotsActionsTest-2008821915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.info" returned: 0 in 0.304s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:33 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-b752b279-e5ce-4fae-9e55-fab48e312d6c tempest-SnapshotsActionsTest-2008821915 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.info is being set with open permissions: ugo+rw Sep 28 14:58:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b752b279-e5ce-4fae-9e55-fab48e312d6c tempest-SnapshotsActionsTest-2008821915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:33 devstack sudo[96477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.info Sep 28 14:58:33 devstack sudo[96477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:33 devstack sudo[96477]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b752b279-e5ce-4fae-9e55-fab48e312d6c tempest-SnapshotsActionsTest-2008821915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.info" returned: 0 in 0.312s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b752b279-e5ce-4fae-9e55-fab48e312d6c tempest-SnapshotsActionsTest-2008821915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.603s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:58:33 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-b752b279-e5ce-4fae-9e55-fab48e312d6c tempest-SnapshotsActionsTest-2008821915 None] Create snapshot completed successfully Sep 28 14:58:34 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=96,cinder:UPDATE=129,cinder:INSERT=29,cinder:DELETE=5 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:58:34 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:UPDATE=125,cinder:SELECT=97,cinder:INSERT=28,cinder:DELETE=12 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:58:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-20e2db06-053e-4fa5-9460-f108efbef8cd tempest-SnapshotsActionsTest-2008821915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:58:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-20e2db06-053e-4fa5-9460-f108efbef8cd tempest-SnapshotsActionsTest-2008821915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:58:34 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-20e2db06-053e-4fa5-9460-f108efbef8cd tempest-SnapshotsActionsTest-2008821915 None] Creating offline snapshot 0a3806ee-a53c-4294-b479-14e55868f622 of volume 4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0 {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 14:58:35 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54a36a9-b2fe-4cec-bb0e-bcb81f044e65]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:58:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-20e2db06-053e-4fa5-9460-f108efbef8cd tempest-SnapshotsActionsTest-2008821915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:35 devstack sudo[96481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c Sep 28 14:58:35 devstack sudo[96481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:35 devstack sudo[96481]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-20e2db06-053e-4fa5-9460-f108efbef8cd tempest-SnapshotsActionsTest-2008821915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c" returned: 0 in 0.494s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-20e2db06-053e-4fa5-9460-f108efbef8cd tempest-SnapshotsActionsTest-2008821915 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 14:58:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-20e2db06-053e-4fa5-9460-f108efbef8cd tempest-SnapshotsActionsTest-2008821915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.0a3806ee-a53c-4294-b479-14e55868f622 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:35 devstack sudo[96486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.0a3806ee-a53c-4294-b479-14e55868f622 1G Sep 28 14:58:35 devstack sudo[96486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:36 devstack sudo[96486]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-20e2db06-053e-4fa5-9460-f108efbef8cd tempest-SnapshotsActionsTest-2008821915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.0a3806ee-a53c-4294-b479-14e55868f622 1G" returned: 0 in 0.748s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-20e2db06-053e-4fa5-9460-f108efbef8cd tempest-SnapshotsActionsTest-2008821915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.0a3806ee-a53c-4294-b479-14e55868f622 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:36 devstack sudo[96495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.0a3806ee-a53c-4294-b479-14e55868f622 Sep 28 14:58:36 devstack sudo[96495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:36 devstack sudo[96495]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-20e2db06-053e-4fa5-9460-f108efbef8cd tempest-SnapshotsActionsTest-2008821915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.0a3806ee-a53c-4294-b479-14e55868f622" returned: 0 in 0.447s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:36 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-20e2db06-053e-4fa5-9460-f108efbef8cd tempest-SnapshotsActionsTest-2008821915 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.0a3806ee-a53c-4294-b479-14e55868f622 is being set with open permissions: ugo+rw Sep 28 14:58:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-20e2db06-053e-4fa5-9460-f108efbef8cd tempest-SnapshotsActionsTest-2008821915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.0a3806ee-a53c-4294-b479-14e55868f622 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:36 devstack sudo[96501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.0a3806ee-a53c-4294-b479-14e55868f622 Sep 28 14:58:36 devstack sudo[96501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:37 devstack sudo[96501]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-20e2db06-053e-4fa5-9460-f108efbef8cd tempest-SnapshotsActionsTest-2008821915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.0a3806ee-a53c-4294-b479-14e55868f622" returned: 0 in 0.428s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-20e2db06-053e-4fa5-9460-f108efbef8cd tempest-SnapshotsActionsTest-2008821915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.284s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:58:37 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-20e2db06-053e-4fa5-9460-f108efbef8cd tempest-SnapshotsActionsTest-2008821915 None] Create snapshot completed successfully Sep 28 14:58:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-cb6eb7c2-c4bf-4aae-9a6a-c08af8ff7caa tempest-SnapshotsActionsTest-2062761561 None] Acquiring lock "cinder-0a3806ee-a53c-4294-b479-14e55868f622-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:58:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-cb6eb7c2-c4bf-4aae-9a6a-c08af8ff7caa tempest-SnapshotsActionsTest-2062761561 None] Lock "cinder-0a3806ee-a53c-4294-b479-14e55868f622-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:58:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-cb6eb7c2-c4bf-4aae-9a6a-c08af8ff7caa tempest-SnapshotsActionsTest-2062761561 None] Acquiring lock "cinder-quobyte-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:58:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-cb6eb7c2-c4bf-4aae-9a6a-c08af8ff7caa tempest-SnapshotsActionsTest-2062761561 None] Lock "cinder-quobyte-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:58:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-cb6eb7c2-c4bf-4aae-9a6a-c08af8ff7caa tempest-SnapshotsActionsTest-2062761561 None] Acquiring lock "cinder-quobyte-0a3806ee-a53c-4294-b479-14e55868f622" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:58:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-cb6eb7c2-c4bf-4aae-9a6a-c08af8ff7caa tempest-SnapshotsActionsTest-2062761561 None] Lock "cinder-quobyte-0a3806ee-a53c-4294-b479-14e55868f622" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:58:38 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-cb6eb7c2-c4bf-4aae-9a6a-c08af8ff7caa tempest-SnapshotsActionsTest-2062761561 None] Deleting offline snapshot 0a3806ee-a53c-4294-b479-14e55868f622 of volume 4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 14:58:38 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-cb6eb7c2-c4bf-4aae-9a6a-c08af8ff7caa tempest-SnapshotsActionsTest-2062761561 None] snapshot_file for this snap is: volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.0a3806ee-a53c-4294-b479-14e55868f622 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 14:58:38 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec6d4a5-421f-425c-83e3-e472a1ee343b]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:58:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cb6eb7c2-c4bf-4aae-9a6a-c08af8ff7caa tempest-SnapshotsActionsTest-2062761561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.0a3806ee-a53c-4294-b479-14e55868f622 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:38 devstack sudo[96521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.0a3806ee-a53c-4294-b479-14e55868f622 Sep 28 14:58:38 devstack sudo[96521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:39 devstack sudo[96521]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cb6eb7c2-c4bf-4aae-9a6a-c08af8ff7caa tempest-SnapshotsActionsTest-2062761561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.0a3806ee-a53c-4294-b479-14e55868f622" returned: 0 in 0.601s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-cb6eb7c2-c4bf-4aae-9a6a-c08af8ff7caa tempest-SnapshotsActionsTest-2062761561 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 14:58:39 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3ca5e2-6403-40c3-bc81-1c39e60d2617]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:58:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cb6eb7c2-c4bf-4aae-9a6a-c08af8ff7caa tempest-SnapshotsActionsTest-2062761561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:39 devstack sudo[96529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c Sep 28 14:58:39 devstack sudo[96529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:39 devstack sudo[96529]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cb6eb7c2-c4bf-4aae-9a6a-c08af8ff7caa tempest-SnapshotsActionsTest-2062761561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c" returned: 0 in 0.706s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-cb6eb7c2-c4bf-4aae-9a6a-c08af8ff7caa tempest-SnapshotsActionsTest-2062761561 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 14:58:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cb6eb7c2-c4bf-4aae-9a6a-c08af8ff7caa tempest-SnapshotsActionsTest-2062761561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.0a3806ee-a53c-4294-b479-14e55868f622 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:39 devstack sudo[96535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.0a3806ee-a53c-4294-b479-14e55868f622 Sep 28 14:58:39 devstack sudo[96535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:40 devstack sudo[96535]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cb6eb7c2-c4bf-4aae-9a6a-c08af8ff7caa tempest-SnapshotsActionsTest-2062761561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.0a3806ee-a53c-4294-b479-14e55868f622" returned: 0 in 0.657s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cb6eb7c2-c4bf-4aae-9a6a-c08af8ff7caa tempest-SnapshotsActionsTest-2062761561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.0a3806ee-a53c-4294-b479-14e55868f622 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:40 devstack sudo[96545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.0a3806ee-a53c-4294-b479-14e55868f622 Sep 28 14:58:40 devstack sudo[96545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:40 devstack sudo[96545]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cb6eb7c2-c4bf-4aae-9a6a-c08af8ff7caa tempest-SnapshotsActionsTest-2062761561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.0a3806ee-a53c-4294-b479-14e55868f622" returned: 0 in 0.378s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:40 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-cb6eb7c2-c4bf-4aae-9a6a-c08af8ff7caa tempest-SnapshotsActionsTest-2062761561 None] Lock "cinder-quobyte-0a3806ee-a53c-4294-b479-14e55868f622" released by "_delete_snapshot" :: held 2.519s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:58:40 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-cb6eb7c2-c4bf-4aae-9a6a-c08af8ff7caa tempest-SnapshotsActionsTest-2062761561 None] Lock "cinder-quobyte-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0" released by "delete_snapshot" :: held 2.558s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:58:41 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-cb6eb7c2-c4bf-4aae-9a6a-c08af8ff7caa tempest-SnapshotsActionsTest-2062761561 None] Created reservations ['14e2a408-47fe-4145-881c-e1dfc8726668', '628186c4-7833-4159-945a-3035a7ae27cc', '01d3a261-038e-476f-b866-97ca441209c7', '9bfd78bb-8e51-4635-8b43-10494ca3f11c'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 14:58:41 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-cb6eb7c2-c4bf-4aae-9a6a-c08af8ff7caa tempest-SnapshotsActionsTest-2062761561 None] Delete snapshot completed successfully. Sep 28 14:58:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-cb6eb7c2-c4bf-4aae-9a6a-c08af8ff7caa tempest-SnapshotsActionsTest-2062761561 None] Lock "cinder-0a3806ee-a53c-4294-b479-14e55868f622-delete_snapshot" released by "delete_snapshot" :: held 2.881s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:58:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3b78c301-d686-43ee-b052-22c851c16723 tempest-SnapshotsActionsTest-2008821915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:58:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3b78c301-d686-43ee-b052-22c851c16723 tempest-SnapshotsActionsTest-2008821915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:58:42 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-3b78c301-d686-43ee-b052-22c851c16723 tempest-SnapshotsActionsTest-2008821915 None] Creating offline snapshot aeb9dc27-e729-4a3c-b2a8-cbfd997dbc88 of volume 4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0 {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 14:58:42 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[135f0859-10d7-4acf-815a-05b458239de8]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:58:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3b78c301-d686-43ee-b052-22c851c16723 tempest-SnapshotsActionsTest-2008821915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:42 devstack sudo[96565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c Sep 28 14:58:42 devstack sudo[96565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:43 devstack sudo[96565]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3b78c301-d686-43ee-b052-22c851c16723 tempest-SnapshotsActionsTest-2008821915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c" returned: 0 in 0.874s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:43 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-3b78c301-d686-43ee-b052-22c851c16723 tempest-SnapshotsActionsTest-2008821915 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 14:58:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3b78c301-d686-43ee-b052-22c851c16723 tempest-SnapshotsActionsTest-2008821915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.aeb9dc27-e729-4a3c-b2a8-cbfd997dbc88 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:43 devstack sudo[96573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.aeb9dc27-e729-4a3c-b2a8-cbfd997dbc88 1G Sep 28 14:58:43 devstack sudo[96573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:44 devstack sudo[96573]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3b78c301-d686-43ee-b052-22c851c16723 tempest-SnapshotsActionsTest-2008821915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.aeb9dc27-e729-4a3c-b2a8-cbfd997dbc88 1G" returned: 0 in 1.129s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3b78c301-d686-43ee-b052-22c851c16723 tempest-SnapshotsActionsTest-2008821915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.aeb9dc27-e729-4a3c-b2a8-cbfd997dbc88 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:44 devstack sudo[96615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.aeb9dc27-e729-4a3c-b2a8-cbfd997dbc88 Sep 28 14:58:44 devstack sudo[96615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:45 devstack sudo[96615]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3b78c301-d686-43ee-b052-22c851c16723 tempest-SnapshotsActionsTest-2008821915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.aeb9dc27-e729-4a3c-b2a8-cbfd997dbc88" returned: 0 in 0.773s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:45 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-3b78c301-d686-43ee-b052-22c851c16723 tempest-SnapshotsActionsTest-2008821915 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.aeb9dc27-e729-4a3c-b2a8-cbfd997dbc88 is being set with open permissions: ugo+rw Sep 28 14:58:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3b78c301-d686-43ee-b052-22c851c16723 tempest-SnapshotsActionsTest-2008821915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.aeb9dc27-e729-4a3c-b2a8-cbfd997dbc88 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:45 devstack sudo[96643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.aeb9dc27-e729-4a3c-b2a8-cbfd997dbc88 Sep 28 14:58:45 devstack sudo[96643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:45 devstack sudo[96643]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3b78c301-d686-43ee-b052-22c851c16723 tempest-SnapshotsActionsTest-2008821915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.aeb9dc27-e729-4a3c-b2a8-cbfd997dbc88" returned: 0 in 0.527s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3b78c301-d686-43ee-b052-22c851c16723 tempest-SnapshotsActionsTest-2008821915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.584s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:58:45 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-3b78c301-d686-43ee-b052-22c851c16723 tempest-SnapshotsActionsTest-2008821915 None] Create snapshot completed successfully Sep 28 14:58:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-31bf35ad-4b65-4d32-bec5-3245ed99dff3 tempest-SnapshotsActionsTest-2062761561 None] Acquiring lock "cinder-aeb9dc27-e729-4a3c-b2a8-cbfd997dbc88-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:58:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-31bf35ad-4b65-4d32-bec5-3245ed99dff3 tempest-SnapshotsActionsTest-2062761561 None] Lock "cinder-aeb9dc27-e729-4a3c-b2a8-cbfd997dbc88-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:58:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-31bf35ad-4b65-4d32-bec5-3245ed99dff3 tempest-SnapshotsActionsTest-2062761561 None] Acquiring lock "cinder-quobyte-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:58:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-31bf35ad-4b65-4d32-bec5-3245ed99dff3 tempest-SnapshotsActionsTest-2062761561 None] Lock "cinder-quobyte-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:58:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-31bf35ad-4b65-4d32-bec5-3245ed99dff3 tempest-SnapshotsActionsTest-2062761561 None] Acquiring lock "cinder-quobyte-aeb9dc27-e729-4a3c-b2a8-cbfd997dbc88" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:58:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-31bf35ad-4b65-4d32-bec5-3245ed99dff3 tempest-SnapshotsActionsTest-2062761561 None] Lock "cinder-quobyte-aeb9dc27-e729-4a3c-b2a8-cbfd997dbc88" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:58:46 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-31bf35ad-4b65-4d32-bec5-3245ed99dff3 tempest-SnapshotsActionsTest-2062761561 None] Deleting offline snapshot aeb9dc27-e729-4a3c-b2a8-cbfd997dbc88 of volume 4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 14:58:47 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-31bf35ad-4b65-4d32-bec5-3245ed99dff3 tempest-SnapshotsActionsTest-2062761561 None] snapshot_file for this snap is: volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.aeb9dc27-e729-4a3c-b2a8-cbfd997dbc88 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 14:58:47 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a38b86-3ea0-4338-8bfe-bb0795c310fd]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:58:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-31bf35ad-4b65-4d32-bec5-3245ed99dff3 tempest-SnapshotsActionsTest-2062761561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.aeb9dc27-e729-4a3c-b2a8-cbfd997dbc88 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:47 devstack sudo[96681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.aeb9dc27-e729-4a3c-b2a8-cbfd997dbc88 Sep 28 14:58:47 devstack sudo[96681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:48 devstack sudo[96681]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-31bf35ad-4b65-4d32-bec5-3245ed99dff3 tempest-SnapshotsActionsTest-2062761561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.aeb9dc27-e729-4a3c-b2a8-cbfd997dbc88" returned: 0 in 1.024s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:48 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-31bf35ad-4b65-4d32-bec5-3245ed99dff3 tempest-SnapshotsActionsTest-2062761561 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 14:58:48 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8bddba-f0ba-43d7-8df7-3d2812dcf879]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:58:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-31bf35ad-4b65-4d32-bec5-3245ed99dff3 tempest-SnapshotsActionsTest-2062761561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:48 devstack sudo[96697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c Sep 28 14:58:48 devstack sudo[96697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:48 devstack sudo[96697]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-31bf35ad-4b65-4d32-bec5-3245ed99dff3 tempest-SnapshotsActionsTest-2062761561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c" returned: 0 in 0.763s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:48 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-31bf35ad-4b65-4d32-bec5-3245ed99dff3 tempest-SnapshotsActionsTest-2062761561 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 14:58:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-31bf35ad-4b65-4d32-bec5-3245ed99dff3 tempest-SnapshotsActionsTest-2062761561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.aeb9dc27-e729-4a3c-b2a8-cbfd997dbc88 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:48 devstack sudo[96703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.aeb9dc27-e729-4a3c-b2a8-cbfd997dbc88 Sep 28 14:58:48 devstack sudo[96703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-31bf35ad-4b65-4d32-bec5-3245ed99dff3 tempest-SnapshotsActionsTest-2062761561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.aeb9dc27-e729-4a3c-b2a8-cbfd997dbc88" returned: 0 in 0.714s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-31bf35ad-4b65-4d32-bec5-3245ed99dff3 tempest-SnapshotsActionsTest-2062761561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.aeb9dc27-e729-4a3c-b2a8-cbfd997dbc88 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:49 devstack sudo[96703]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:49 devstack sudo[96717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.aeb9dc27-e729-4a3c-b2a8-cbfd997dbc88 Sep 28 14:58:49 devstack sudo[96717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:50 devstack sudo[96717]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-31bf35ad-4b65-4d32-bec5-3245ed99dff3 tempest-SnapshotsActionsTest-2062761561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.aeb9dc27-e729-4a3c-b2a8-cbfd997dbc88" returned: 0 in 0.899s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:50 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-31bf35ad-4b65-4d32-bec5-3245ed99dff3 tempest-SnapshotsActionsTest-2062761561 None] Lock "cinder-quobyte-aeb9dc27-e729-4a3c-b2a8-cbfd997dbc88" released by "_delete_snapshot" :: held 3.696s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:58:50 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-31bf35ad-4b65-4d32-bec5-3245ed99dff3 tempest-SnapshotsActionsTest-2062761561 None] Lock "cinder-quobyte-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0" released by "delete_snapshot" :: held 3.750s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:58:50 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-31bf35ad-4b65-4d32-bec5-3245ed99dff3 tempest-SnapshotsActionsTest-2062761561 None] Created reservations ['dbdf7c76-880f-4029-9282-a82d060fb56b', 'a4346885-0933-4481-9372-d3fc3aeb4921', 'b605ac5d-730a-40e8-93fe-289c23ca498e', 'cd725af0-2bb7-48bf-8c47-0fc4a5dd6f2a'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 14:58:51 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-31bf35ad-4b65-4d32-bec5-3245ed99dff3 tempest-SnapshotsActionsTest-2062761561 None] Delete snapshot completed successfully. Sep 28 14:58:51 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-31bf35ad-4b65-4d32-bec5-3245ed99dff3 tempest-SnapshotsActionsTest-2062761561 None] Lock "cinder-aeb9dc27-e729-4a3c-b2a8-cbfd997dbc88-delete_snapshot" released by "delete_snapshot" :: held 4.271s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:58:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ac3d2282-077d-43ce-8fc0-51aedeb0587c tempest-SnapshotsActionsTest-2008821915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:58:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ac3d2282-077d-43ce-8fc0-51aedeb0587c tempest-SnapshotsActionsTest-2008821915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:58:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-ac3d2282-077d-43ce-8fc0-51aedeb0587c tempest-SnapshotsActionsTest-2008821915 None] Creating offline snapshot 78d77366-9478-4c20-8bfa-3ee7cfadd69f of volume 4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0 {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 14:58:52 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[43bcf4fe-f00e-4111-9622-f1131139cd0a]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:58:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ac3d2282-077d-43ce-8fc0-51aedeb0587c tempest-SnapshotsActionsTest-2008821915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:52 devstack sudo[96790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c Sep 28 14:58:52 devstack sudo[96790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:53 devstack sudo[96790]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ac3d2282-077d-43ce-8fc0-51aedeb0587c tempest-SnapshotsActionsTest-2008821915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c" returned: 0 in 1.048s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:53 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-ac3d2282-077d-43ce-8fc0-51aedeb0587c tempest-SnapshotsActionsTest-2008821915 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 14:58:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ac3d2282-077d-43ce-8fc0-51aedeb0587c tempest-SnapshotsActionsTest-2008821915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.78d77366-9478-4c20-8bfa-3ee7cfadd69f 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:53 devstack sudo[96801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.78d77366-9478-4c20-8bfa-3ee7cfadd69f 1G Sep 28 14:58:53 devstack sudo[96801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:54 devstack sudo[96801]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ac3d2282-077d-43ce-8fc0-51aedeb0587c tempest-SnapshotsActionsTest-2008821915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.78d77366-9478-4c20-8bfa-3ee7cfadd69f 1G" returned: 0 in 0.799s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ac3d2282-077d-43ce-8fc0-51aedeb0587c tempest-SnapshotsActionsTest-2008821915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.78d77366-9478-4c20-8bfa-3ee7cfadd69f {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:54 devstack sudo[96809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.78d77366-9478-4c20-8bfa-3ee7cfadd69f Sep 28 14:58:54 devstack sudo[96809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:55 devstack sudo[96809]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ac3d2282-077d-43ce-8fc0-51aedeb0587c tempest-SnapshotsActionsTest-2008821915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.78d77366-9478-4c20-8bfa-3ee7cfadd69f" returned: 0 in 1.179s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:55 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-ac3d2282-077d-43ce-8fc0-51aedeb0587c tempest-SnapshotsActionsTest-2008821915 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.78d77366-9478-4c20-8bfa-3ee7cfadd69f is being set with open permissions: ugo+rw Sep 28 14:58:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ac3d2282-077d-43ce-8fc0-51aedeb0587c tempest-SnapshotsActionsTest-2008821915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.78d77366-9478-4c20-8bfa-3ee7cfadd69f {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:55 devstack sudo[96833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.78d77366-9478-4c20-8bfa-3ee7cfadd69f Sep 28 14:58:55 devstack sudo[96833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:56 devstack sudo[96833]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ac3d2282-077d-43ce-8fc0-51aedeb0587c tempest-SnapshotsActionsTest-2008821915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.78d77366-9478-4c20-8bfa-3ee7cfadd69f" returned: 0 in 1.092s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ac3d2282-077d-43ce-8fc0-51aedeb0587c tempest-SnapshotsActionsTest-2008821915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.451s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:58:56 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-ac3d2282-077d-43ce-8fc0-51aedeb0587c tempest-SnapshotsActionsTest-2008821915 None] Create snapshot completed successfully Sep 28 14:58:58 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-02535fe4-b008-4df2-a0d2-c63d7cc681d0 tempest-SnapshotsActionsTest-2062761561 None] Acquiring lock "cinder-78d77366-9478-4c20-8bfa-3ee7cfadd69f-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:58:58 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-02535fe4-b008-4df2-a0d2-c63d7cc681d0 tempest-SnapshotsActionsTest-2062761561 None] Lock "cinder-78d77366-9478-4c20-8bfa-3ee7cfadd69f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:58:58 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-02535fe4-b008-4df2-a0d2-c63d7cc681d0 tempest-SnapshotsActionsTest-2062761561 None] Acquiring lock "cinder-quobyte-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:58:58 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-02535fe4-b008-4df2-a0d2-c63d7cc681d0 tempest-SnapshotsActionsTest-2062761561 None] Lock "cinder-quobyte-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0" acquired by "delete_snapshot" :: waited 0.056s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:58:58 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-02535fe4-b008-4df2-a0d2-c63d7cc681d0 tempest-SnapshotsActionsTest-2062761561 None] Acquiring lock "cinder-quobyte-78d77366-9478-4c20-8bfa-3ee7cfadd69f" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:58:58 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-02535fe4-b008-4df2-a0d2-c63d7cc681d0 tempest-SnapshotsActionsTest-2062761561 None] Lock "cinder-quobyte-78d77366-9478-4c20-8bfa-3ee7cfadd69f" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:58:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-02535fe4-b008-4df2-a0d2-c63d7cc681d0 tempest-SnapshotsActionsTest-2062761561 None] Deleting offline snapshot 78d77366-9478-4c20-8bfa-3ee7cfadd69f of volume 4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 14:58:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-02535fe4-b008-4df2-a0d2-c63d7cc681d0 tempest-SnapshotsActionsTest-2062761561 None] snapshot_file for this snap is: volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.78d77366-9478-4c20-8bfa-3ee7cfadd69f {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 14:58:58 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26e3317-601b-4634-bbad-d8bdc53aab9f]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:58:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-02535fe4-b008-4df2-a0d2-c63d7cc681d0 tempest-SnapshotsActionsTest-2062761561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.78d77366-9478-4c20-8bfa-3ee7cfadd69f {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:58 devstack sudo[96874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.78d77366-9478-4c20-8bfa-3ee7cfadd69f Sep 28 14:58:58 devstack sudo[96874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:59 devstack sudo[96874]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-02535fe4-b008-4df2-a0d2-c63d7cc681d0 tempest-SnapshotsActionsTest-2062761561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.78d77366-9478-4c20-8bfa-3ee7cfadd69f" returned: 0 in 1.000s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-02535fe4-b008-4df2-a0d2-c63d7cc681d0 tempest-SnapshotsActionsTest-2062761561 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 14:58:59 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b72860-35fc-42ad-9d55-74ddab2614ad]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:58:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-02535fe4-b008-4df2-a0d2-c63d7cc681d0 tempest-SnapshotsActionsTest-2062761561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:59 devstack sudo[96879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c Sep 28 14:58:59 devstack sudo[96879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:00 devstack sudo[96879]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-02535fe4-b008-4df2-a0d2-c63d7cc681d0 tempest-SnapshotsActionsTest-2062761561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c" returned: 0 in 0.710s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:00 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-02535fe4-b008-4df2-a0d2-c63d7cc681d0 tempest-SnapshotsActionsTest-2062761561 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 14:59:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-02535fe4-b008-4df2-a0d2-c63d7cc681d0 tempest-SnapshotsActionsTest-2062761561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.78d77366-9478-4c20-8bfa-3ee7cfadd69f {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:00 devstack sudo[96887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.78d77366-9478-4c20-8bfa-3ee7cfadd69f Sep 28 14:59:00 devstack sudo[96887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:01 devstack sudo[96887]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-02535fe4-b008-4df2-a0d2-c63d7cc681d0 tempest-SnapshotsActionsTest-2062761561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.78d77366-9478-4c20-8bfa-3ee7cfadd69f" returned: 0 in 1.099s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-02535fe4-b008-4df2-a0d2-c63d7cc681d0 tempest-SnapshotsActionsTest-2062761561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.78d77366-9478-4c20-8bfa-3ee7cfadd69f {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:01 devstack sudo[96892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.78d77366-9478-4c20-8bfa-3ee7cfadd69f Sep 28 14:59:01 devstack sudo[96892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:01 devstack sudo[96892]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-02535fe4-b008-4df2-a0d2-c63d7cc681d0 tempest-SnapshotsActionsTest-2062761561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.78d77366-9478-4c20-8bfa-3ee7cfadd69f" returned: 0 in 0.547s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-02535fe4-b008-4df2-a0d2-c63d7cc681d0 tempest-SnapshotsActionsTest-2062761561 None] Lock "cinder-quobyte-78d77366-9478-4c20-8bfa-3ee7cfadd69f" released by "_delete_snapshot" :: held 3.697s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:59:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-02535fe4-b008-4df2-a0d2-c63d7cc681d0 tempest-SnapshotsActionsTest-2062761561 None] Lock "cinder-quobyte-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0" released by "delete_snapshot" :: held 3.774s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:59:02 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-02535fe4-b008-4df2-a0d2-c63d7cc681d0 tempest-SnapshotsActionsTest-2062761561 None] Created reservations ['ad819966-0331-4fa7-9434-d22009070da9', '2fcb4c69-5392-47d5-bfe1-400e32a6716e', '75c20e72-0b3d-45b8-91b3-33b9bdd0f916', 'b3551206-f482-4dd3-9ad9-26ea65fffa61'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 14:59:02 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-02535fe4-b008-4df2-a0d2-c63d7cc681d0 tempest-SnapshotsActionsTest-2062761561 None] Delete snapshot completed successfully. Sep 28 14:59:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-02535fe4-b008-4df2-a0d2-c63d7cc681d0 tempest-SnapshotsActionsTest-2062761561 None] Lock "cinder-78d77366-9478-4c20-8bfa-3ee7cfadd69f-delete_snapshot" released by "delete_snapshot" :: held 4.461s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:59:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5437d090-5471-41fb-948c-9a4a2e5a88a3 tempest-SnapshotsActionsTest-2008821915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:59:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5437d090-5471-41fb-948c-9a4a2e5a88a3 tempest-SnapshotsActionsTest-2008821915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:59:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-5437d090-5471-41fb-948c-9a4a2e5a88a3 tempest-SnapshotsActionsTest-2008821915 None] Creating offline snapshot 77c1c9cd-3d30-4e76-979c-db7546048fb9 of volume 4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0 {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 14:59:03 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbad2ab6-59d6-44c1-b157-7000f1880858]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:59:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5437d090-5471-41fb-948c-9a4a2e5a88a3 tempest-SnapshotsActionsTest-2008821915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:03 devstack sudo[96923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c Sep 28 14:59:03 devstack sudo[96923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:04 devstack sudo[96923]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5437d090-5471-41fb-948c-9a4a2e5a88a3 tempest-SnapshotsActionsTest-2008821915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c" returned: 0 in 0.572s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:04 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-5437d090-5471-41fb-948c-9a4a2e5a88a3 tempest-SnapshotsActionsTest-2008821915 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 14:59:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5437d090-5471-41fb-948c-9a4a2e5a88a3 tempest-SnapshotsActionsTest-2008821915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.77c1c9cd-3d30-4e76-979c-db7546048fb9 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:04 devstack sudo[96936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.77c1c9cd-3d30-4e76-979c-db7546048fb9 1G Sep 28 14:59:04 devstack sudo[96936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:05 devstack sudo[96936]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5437d090-5471-41fb-948c-9a4a2e5a88a3 tempest-SnapshotsActionsTest-2008821915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.77c1c9cd-3d30-4e76-979c-db7546048fb9 1G" returned: 0 in 0.696s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5437d090-5471-41fb-948c-9a4a2e5a88a3 tempest-SnapshotsActionsTest-2008821915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.77c1c9cd-3d30-4e76-979c-db7546048fb9 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:05 devstack sudo[96950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.77c1c9cd-3d30-4e76-979c-db7546048fb9 Sep 28 14:59:05 devstack sudo[96950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:05 devstack sudo[96950]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5437d090-5471-41fb-948c-9a4a2e5a88a3 tempest-SnapshotsActionsTest-2008821915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.77c1c9cd-3d30-4e76-979c-db7546048fb9" returned: 0 in 0.382s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:05 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-5437d090-5471-41fb-948c-9a4a2e5a88a3 tempest-SnapshotsActionsTest-2008821915 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.77c1c9cd-3d30-4e76-979c-db7546048fb9 is being set with open permissions: ugo+rw Sep 28 14:59:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5437d090-5471-41fb-948c-9a4a2e5a88a3 tempest-SnapshotsActionsTest-2008821915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.77c1c9cd-3d30-4e76-979c-db7546048fb9 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:05 devstack sudo[96962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.77c1c9cd-3d30-4e76-979c-db7546048fb9 Sep 28 14:59:05 devstack sudo[96962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:05 devstack sudo[96962]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5437d090-5471-41fb-948c-9a4a2e5a88a3 tempest-SnapshotsActionsTest-2008821915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.77c1c9cd-3d30-4e76-979c-db7546048fb9" returned: 0 in 0.444s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5437d090-5471-41fb-948c-9a4a2e5a88a3 tempest-SnapshotsActionsTest-2008821915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.331s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:59:06 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-5437d090-5471-41fb-948c-9a4a2e5a88a3 tempest-SnapshotsActionsTest-2008821915 None] Create snapshot completed successfully Sep 28 14:59:07 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-77a39588-90a0-4f8c-8c3b-29dfa02c4c04 tempest-SnapshotsActionsTest-2062761561 None] Acquiring lock "cinder-77c1c9cd-3d30-4e76-979c-db7546048fb9-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:59:07 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-77a39588-90a0-4f8c-8c3b-29dfa02c4c04 tempest-SnapshotsActionsTest-2062761561 None] Lock "cinder-77c1c9cd-3d30-4e76-979c-db7546048fb9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:59:07 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-77a39588-90a0-4f8c-8c3b-29dfa02c4c04 tempest-SnapshotsActionsTest-2062761561 None] Acquiring lock "cinder-quobyte-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:59:07 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-77a39588-90a0-4f8c-8c3b-29dfa02c4c04 tempest-SnapshotsActionsTest-2062761561 None] Lock "cinder-quobyte-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:59:07 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-77a39588-90a0-4f8c-8c3b-29dfa02c4c04 tempest-SnapshotsActionsTest-2062761561 None] Acquiring lock "cinder-quobyte-77c1c9cd-3d30-4e76-979c-db7546048fb9" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:59:07 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-77a39588-90a0-4f8c-8c3b-29dfa02c4c04 tempest-SnapshotsActionsTest-2062761561 None] Lock "cinder-quobyte-77c1c9cd-3d30-4e76-979c-db7546048fb9" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:59:07 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-77a39588-90a0-4f8c-8c3b-29dfa02c4c04 tempest-SnapshotsActionsTest-2062761561 None] Deleting offline snapshot 77c1c9cd-3d30-4e76-979c-db7546048fb9 of volume 4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 14:59:07 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-77a39588-90a0-4f8c-8c3b-29dfa02c4c04 tempest-SnapshotsActionsTest-2062761561 None] snapshot_file for this snap is: volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.77c1c9cd-3d30-4e76-979c-db7546048fb9 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 14:59:07 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[431f2bdc-a1fc-4d33-afb4-cf7522a76776]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:59:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-77a39588-90a0-4f8c-8c3b-29dfa02c4c04 tempest-SnapshotsActionsTest-2062761561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.77c1c9cd-3d30-4e76-979c-db7546048fb9 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:07 devstack sudo[96995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.77c1c9cd-3d30-4e76-979c-db7546048fb9 Sep 28 14:59:07 devstack sudo[96995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:07 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea8ca1c0-599e-4974-93be-657cd5859733 tempest-VolumesTransfersV355Test-1025677033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 14:59:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ea8ca1c0-599e-4974-93be-657cd5859733 tempest-VolumesTransfersV355Test-1025677033 None] Flow 'volume_create_manager' (a23907c8-0f0b-449b-912f-a074bf0f9897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:59:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ea8ca1c0-599e-4974-93be-657cd5859733 tempest-VolumesTransfersV355Test-1025677033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b0b1e83-fa7d-48be-95e6-f863860d5053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ea8ca1c0-599e-4974-93be-657cd5859733 tempest-VolumesTransfersV355Test-1025677033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b0b1e83-fa7d-48be-95e6-f863860d5053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:59:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-840542591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13b80f76-206e-4be2-9752-1d9a6150f9f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce18ec16ea5f4cb59b24840f28a5d292',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:59:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:59:07Z,use_quota=True,user_id='31a552f214634f5487835ff0a798133a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ea8ca1c0-599e-4974-93be-657cd5859733 tempest-VolumesTransfersV355Test-1025677033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ceba5f5-96ea-4110-b73f-745b811aa3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ea8ca1c0-599e-4974-93be-657cd5859733 tempest-VolumesTransfersV355Test-1025677033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ceba5f5-96ea-4110-b73f-745b811aa3d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ea8ca1c0-599e-4974-93be-657cd5859733 tempest-VolumesTransfersV355Test-1025677033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54ea535c-af07-44b4-bc1d-340370f7c483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ea8ca1c0-599e-4974-93be-657cd5859733 tempest-VolumesTransfersV355Test-1025677033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54ea535c-af07-44b4-bc1d-340370f7c483) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13b80f76-206e-4be2-9752-1d9a6150f9f6', 'volume_name': 'volume-13b80f76-206e-4be2-9752-1d9a6150f9f6', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ea8ca1c0-599e-4974-93be-657cd5859733 tempest-VolumesTransfersV355Test-1025677033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (879dd78a-28bb-4929-9145-92298334bd49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ea8ca1c0-599e-4974-93be-657cd5859733 tempest-VolumesTransfersV355Test-1025677033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (879dd78a-28bb-4929-9145-92298334bd49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ea8ca1c0-599e-4974-93be-657cd5859733 tempest-VolumesTransfersV355Test-1025677033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be938962-e38c-4002-a05f-6038a1edd13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:07 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-ea8ca1c0-599e-4974-93be-657cd5859733 tempest-VolumesTransfersV355Test-1025677033 None] Volume 13b80f76-206e-4be2-9752-1d9a6150f9f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13b80f76-206e-4be2-9752-1d9a6150f9f6', 'volume_size': 1} Sep 28 14:59:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ea8ca1c0-599e-4974-93be-657cd5859733 tempest-VolumesTransfersV355Test-1025677033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:59:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ea8ca1c0-599e-4974-93be-657cd5859733 tempest-VolumesTransfersV355Test-1025677033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:59:07 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ea8ca1c0-599e-4974-93be-657cd5859733 tempest-VolumesTransfersV355Test-1025677033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:59:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-840542591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13b80f76-206e-4be2-9752-1d9a6150f9f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce18ec16ea5f4cb59b24840f28a5d292',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:59:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:59:07Z,use_quota=True,user_id='31a552f214634f5487835ff0a798133a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 14:59:07 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-ea8ca1c0-599e-4974-93be-657cd5859733 tempest-VolumesTransfersV355Test-1025677033 None] Creating volume 13b80f76-206e-4be2-9752-1d9a6150f9f6 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 14:59:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ea8ca1c0-599e-4974-93be-657cd5859733 tempest-VolumesTransfersV355Test-1025677033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:59:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ea8ca1c0-599e-4974-93be-657cd5859733 tempest-VolumesTransfersV355Test-1025677033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:59:07 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ea8ca1c0-599e-4974-93be-657cd5859733 tempest-VolumesTransfersV355Test-1025677033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:59:07 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ea8ca1c0-599e-4974-93be-657cd5859733 tempest-VolumesTransfersV355Test-1025677033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:59:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ea8ca1c0-599e-4974-93be-657cd5859733 tempest-VolumesTransfersV355Test-1025677033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:59:07 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ea8ca1c0-599e-4974-93be-657cd5859733 tempest-VolumesTransfersV355Test-1025677033 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 14:59:07 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-ea8ca1c0-599e-4974-93be-657cd5859733 tempest-VolumesTransfersV355Test-1025677033 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 14:59:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ea8ca1c0-599e-4974-93be-657cd5859733 tempest-VolumesTransfersV355Test-1025677033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-13b80f76-206e-4be2-9752-1d9a6150f9f6 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:07 devstack sudo[96998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-13b80f76-206e-4be2-9752-1d9a6150f9f6 1073741824 Sep 28 14:59:07 devstack sudo[96998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:08 devstack sudo[96995]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-77a39588-90a0-4f8c-8c3b-29dfa02c4c04 tempest-SnapshotsActionsTest-2062761561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.77c1c9cd-3d30-4e76-979c-db7546048fb9" returned: 0 in 0.834s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:08 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-77a39588-90a0-4f8c-8c3b-29dfa02c4c04 tempest-SnapshotsActionsTest-2062761561 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 14:59:08 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c87f967-63f6-40bd-bbe6-fde454e37fca]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:59:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-77a39588-90a0-4f8c-8c3b-29dfa02c4c04 tempest-SnapshotsActionsTest-2062761561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:08 devstack sudo[97006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c Sep 28 14:59:08 devstack sudo[97006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:08 devstack sudo[96998]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ea8ca1c0-599e-4974-93be-657cd5859733 tempest-VolumesTransfersV355Test-1025677033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-13b80f76-206e-4be2-9752-1d9a6150f9f6 1073741824" returned: 0 in 0.948s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:08 devstack sudo[97006]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-77a39588-90a0-4f8c-8c3b-29dfa02c4c04 tempest-SnapshotsActionsTest-2062761561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c" returned: 0 in 0.549s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:08 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-77a39588-90a0-4f8c-8c3b-29dfa02c4c04 tempest-SnapshotsActionsTest-2062761561 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 14:59:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-77a39588-90a0-4f8c-8c3b-29dfa02c4c04 tempest-SnapshotsActionsTest-2062761561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.77c1c9cd-3d30-4e76-979c-db7546048fb9 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ea8ca1c0-599e-4974-93be-657cd5859733 tempest-VolumesTransfersV355Test-1025677033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-13b80f76-206e-4be2-9752-1d9a6150f9f6 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:08 devstack sudo[97014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-13b80f76-206e-4be2-9752-1d9a6150f9f6 Sep 28 14:59:08 devstack sudo[97014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:08 devstack sudo[97013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.77c1c9cd-3d30-4e76-979c-db7546048fb9 Sep 28 14:59:08 devstack sudo[97013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:09 devstack sudo[97014]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ea8ca1c0-599e-4974-93be-657cd5859733 tempest-VolumesTransfersV355Test-1025677033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-13b80f76-206e-4be2-9752-1d9a6150f9f6" returned: 0 in 0.364s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:09 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ea8ca1c0-599e-4974-93be-657cd5859733 tempest-VolumesTransfersV355Test-1025677033 None] <== create_volume: return (1452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 14:59:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ea8ca1c0-599e-4974-93be-657cd5859733 tempest-VolumesTransfersV355Test-1025677033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.455s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:59:09 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ea8ca1c0-599e-4974-93be-657cd5859733 tempest-VolumesTransfersV355Test-1025677033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be938962-e38c-4002-a05f-6038a1edd13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13b80f76-206e-4be2-9752-1d9a6150f9f6', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:09 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ea8ca1c0-599e-4974-93be-657cd5859733 tempest-VolumesTransfersV355Test-1025677033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb411761-3605-49bb-a892-2d57cff06c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:09 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-ea8ca1c0-599e-4974-93be-657cd5859733 tempest-VolumesTransfersV355Test-1025677033 None] Volume volume-13b80f76-206e-4be2-9752-1d9a6150f9f6 (13b80f76-206e-4be2-9752-1d9a6150f9f6): created successfully Sep 28 14:59:09 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ea8ca1c0-599e-4974-93be-657cd5859733 tempest-VolumesTransfersV355Test-1025677033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb411761-3605-49bb-a892-2d57cff06c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:09 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ea8ca1c0-599e-4974-93be-657cd5859733 tempest-VolumesTransfersV355Test-1025677033 None] Flow 'volume_create_manager' (a23907c8-0f0b-449b-912f-a074bf0f9897) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:59:09 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-ea8ca1c0-599e-4974-93be-657cd5859733 tempest-VolumesTransfersV355Test-1025677033 None] Created volume successfully. Sep 28 14:59:09 devstack sudo[97013]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-77a39588-90a0-4f8c-8c3b-29dfa02c4c04 tempest-SnapshotsActionsTest-2062761561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.77c1c9cd-3d30-4e76-979c-db7546048fb9" returned: 0 in 0.691s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-77a39588-90a0-4f8c-8c3b-29dfa02c4c04 tempest-SnapshotsActionsTest-2062761561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.77c1c9cd-3d30-4e76-979c-db7546048fb9 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:09 devstack sudo[97021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.77c1c9cd-3d30-4e76-979c-db7546048fb9 Sep 28 14:59:09 devstack sudo[97021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:10 devstack sudo[97021]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-77a39588-90a0-4f8c-8c3b-29dfa02c4c04 tempest-SnapshotsActionsTest-2062761561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.77c1c9cd-3d30-4e76-979c-db7546048fb9" returned: 0 in 0.695s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:10 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-77a39588-90a0-4f8c-8c3b-29dfa02c4c04 tempest-SnapshotsActionsTest-2062761561 None] Lock "cinder-quobyte-77c1c9cd-3d30-4e76-979c-db7546048fb9" released by "_delete_snapshot" :: held 3.001s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:59:10 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-77a39588-90a0-4f8c-8c3b-29dfa02c4c04 tempest-SnapshotsActionsTest-2062761561 None] Lock "cinder-quobyte-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0" released by "delete_snapshot" :: held 3.067s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:59:10 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-77a39588-90a0-4f8c-8c3b-29dfa02c4c04 tempest-SnapshotsActionsTest-2062761561 None] Created reservations ['eab65cf1-c6b1-420d-aca8-34833ebd0b1e', '1dd3a874-49b8-43c1-94c5-3ba84871af80', 'a6825b3a-a414-42f7-9cbd-2fa28256e425', 'b42c0473-8cd6-447b-8bfa-17052a72d837'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 14:59:10 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-77a39588-90a0-4f8c-8c3b-29dfa02c4c04 tempest-SnapshotsActionsTest-2062761561 None] Delete snapshot completed successfully. Sep 28 14:59:10 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-77a39588-90a0-4f8c-8c3b-29dfa02c4c04 tempest-SnapshotsActionsTest-2062761561 None] Lock "cinder-77c1c9cd-3d30-4e76-979c-db7546048fb9-delete_snapshot" released by "delete_snapshot" :: held 3.512s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:59:10 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-af7ecfb1-b9ca-4829-8f80-a4735f5293a7 tempest-ServerRescueNegativeTestJSON-1770820849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 14:59:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-af7ecfb1-b9ca-4829-8f80-a4735f5293a7 tempest-ServerRescueNegativeTestJSON-1770820849 None] Flow 'volume_create_manager' (43c8d9c0-8cbf-46e6-9262-c8017590dd26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:59:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-af7ecfb1-b9ca-4829-8f80-a4735f5293a7 tempest-ServerRescueNegativeTestJSON-1770820849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84b4f0fa-c1f7-4377-9be2-c929e121f364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:11 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-af7ecfb1-b9ca-4829-8f80-a4735f5293a7 tempest-ServerRescueNegativeTestJSON-1770820849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84b4f0fa-c1f7-4377-9be2-c929e121f364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:59:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-871599325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a37808fe-939b-47dc-9fec-c82149dd32b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88ff5cd767984cc5bf89b86ad5478a5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:59:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:59:11Z,use_quota=True,user_id='7f88d9b0d74944619fe7546ca213949a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:11 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-af7ecfb1-b9ca-4829-8f80-a4735f5293a7 tempest-ServerRescueNegativeTestJSON-1770820849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c63239eb-2750-4848-99a4-3faf9ba8b1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:11 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-af7ecfb1-b9ca-4829-8f80-a4735f5293a7 tempest-ServerRescueNegativeTestJSON-1770820849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c63239eb-2750-4848-99a4-3faf9ba8b1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:11 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-af7ecfb1-b9ca-4829-8f80-a4735f5293a7 tempest-ServerRescueNegativeTestJSON-1770820849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b537503-b80a-4162-8d71-78691dd62abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:11 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-af7ecfb1-b9ca-4829-8f80-a4735f5293a7 tempest-ServerRescueNegativeTestJSON-1770820849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b537503-b80a-4162-8d71-78691dd62abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a37808fe-939b-47dc-9fec-c82149dd32b1', 'volume_name': 'volume-a37808fe-939b-47dc-9fec-c82149dd32b1', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:11 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-af7ecfb1-b9ca-4829-8f80-a4735f5293a7 tempest-ServerRescueNegativeTestJSON-1770820849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31fe6633-f93c-4810-9fec-0eed977a7b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:11 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-af7ecfb1-b9ca-4829-8f80-a4735f5293a7 tempest-ServerRescueNegativeTestJSON-1770820849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31fe6633-f93c-4810-9fec-0eed977a7b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:11 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-af7ecfb1-b9ca-4829-8f80-a4735f5293a7 tempest-ServerRescueNegativeTestJSON-1770820849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad315747-ad91-4aa6-b576-964025a105c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:11 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-af7ecfb1-b9ca-4829-8f80-a4735f5293a7 tempest-ServerRescueNegativeTestJSON-1770820849 None] Volume a37808fe-939b-47dc-9fec-c82149dd32b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a37808fe-939b-47dc-9fec-c82149dd32b1', 'volume_size': 1} Sep 28 14:59:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-af7ecfb1-b9ca-4829-8f80-a4735f5293a7 tempest-ServerRescueNegativeTestJSON-1770820849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:59:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-af7ecfb1-b9ca-4829-8f80-a4735f5293a7 tempest-ServerRescueNegativeTestJSON-1770820849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:59:11 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-af7ecfb1-b9ca-4829-8f80-a4735f5293a7 tempest-ServerRescueNegativeTestJSON-1770820849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:59:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-871599325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a37808fe-939b-47dc-9fec-c82149dd32b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88ff5cd767984cc5bf89b86ad5478a5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:59:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:59:11Z,use_quota=True,user_id='7f88d9b0d74944619fe7546ca213949a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 14:59:11 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-af7ecfb1-b9ca-4829-8f80-a4735f5293a7 tempest-ServerRescueNegativeTestJSON-1770820849 None] Creating volume a37808fe-939b-47dc-9fec-c82149dd32b1 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 14:59:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-af7ecfb1-b9ca-4829-8f80-a4735f5293a7 tempest-ServerRescueNegativeTestJSON-1770820849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:59:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-af7ecfb1-b9ca-4829-8f80-a4735f5293a7 tempest-ServerRescueNegativeTestJSON-1770820849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:59:11 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-af7ecfb1-b9ca-4829-8f80-a4735f5293a7 tempest-ServerRescueNegativeTestJSON-1770820849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:59:11 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-af7ecfb1-b9ca-4829-8f80-a4735f5293a7 tempest-ServerRescueNegativeTestJSON-1770820849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:59:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-af7ecfb1-b9ca-4829-8f80-a4735f5293a7 tempest-ServerRescueNegativeTestJSON-1770820849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:59:11 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-af7ecfb1-b9ca-4829-8f80-a4735f5293a7 tempest-ServerRescueNegativeTestJSON-1770820849 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 14:59:11 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-af7ecfb1-b9ca-4829-8f80-a4735f5293a7 tempest-ServerRescueNegativeTestJSON-1770820849 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 14:59:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-af7ecfb1-b9ca-4829-8f80-a4735f5293a7 tempest-ServerRescueNegativeTestJSON-1770820849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a37808fe-939b-47dc-9fec-c82149dd32b1 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:11 devstack sudo[97026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a37808fe-939b-47dc-9fec-c82149dd32b1 1073741824 Sep 28 14:59:11 devstack sudo[97026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:11 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-28ab0c71-720a-465a-9fcf-5f65916fed12 tempest-VolumesTransfersV355Test-244970001 None] Transfer volume completed successfully. Sep 28 14:59:12 devstack sudo[97026]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-af7ecfb1-b9ca-4829-8f80-a4735f5293a7 tempest-ServerRescueNegativeTestJSON-1770820849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a37808fe-939b-47dc-9fec-c82149dd32b1 1073741824" returned: 0 in 1.111s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-af7ecfb1-b9ca-4829-8f80-a4735f5293a7 tempest-ServerRescueNegativeTestJSON-1770820849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a37808fe-939b-47dc-9fec-c82149dd32b1 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:12 devstack sudo[97061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a37808fe-939b-47dc-9fec-c82149dd32b1 Sep 28 14:59:12 devstack sudo[97061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:12 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ea6df334-14fa-4a50-96bb-95653c7bae60 tempest-SnapshotsActionsTest-2008821915 None] Acquiring lock "cinder-73a05ef3-452c-4103-b49d-367cbcfe409c-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:59:12 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ea6df334-14fa-4a50-96bb-95653c7bae60 tempest-SnapshotsActionsTest-2008821915 None] Lock "cinder-73a05ef3-452c-4103-b49d-367cbcfe409c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:59:12 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ea6df334-14fa-4a50-96bb-95653c7bae60 tempest-SnapshotsActionsTest-2008821915 None] Acquiring lock "cinder-quobyte-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:59:12 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ea6df334-14fa-4a50-96bb-95653c7bae60 tempest-SnapshotsActionsTest-2008821915 None] Lock "cinder-quobyte-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:59:12 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ea6df334-14fa-4a50-96bb-95653c7bae60 tempest-SnapshotsActionsTest-2008821915 None] Acquiring lock "cinder-quobyte-73a05ef3-452c-4103-b49d-367cbcfe409c" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:59:12 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ea6df334-14fa-4a50-96bb-95653c7bae60 tempest-SnapshotsActionsTest-2008821915 None] Lock "cinder-quobyte-73a05ef3-452c-4103-b49d-367cbcfe409c" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:59:12 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-ea6df334-14fa-4a50-96bb-95653c7bae60 tempest-SnapshotsActionsTest-2008821915 None] Deleting offline snapshot 73a05ef3-452c-4103-b49d-367cbcfe409c of volume 4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 14:59:12 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-ea6df334-14fa-4a50-96bb-95653c7bae60 tempest-SnapshotsActionsTest-2008821915 None] snapshot_file for this snap is: volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 14:59:12 devstack sudo[97061]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:12 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1f123b-7acd-45c3-a174-e7d3040cfb9c]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:59:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ea6df334-14fa-4a50-96bb-95653c7bae60 tempest-SnapshotsActionsTest-2008821915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-af7ecfb1-b9ca-4829-8f80-a4735f5293a7 tempest-ServerRescueNegativeTestJSON-1770820849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a37808fe-939b-47dc-9fec-c82149dd32b1" returned: 0 in 0.527s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:12 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-af7ecfb1-b9ca-4829-8f80-a4735f5293a7 tempest-ServerRescueNegativeTestJSON-1770820849 None] <== create_volume: return (1727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 14:59:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-af7ecfb1-b9ca-4829-8f80-a4735f5293a7 tempest-ServerRescueNegativeTestJSON-1770820849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.736s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:59:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-af7ecfb1-b9ca-4829-8f80-a4735f5293a7 tempest-ServerRescueNegativeTestJSON-1770820849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad315747-ad91-4aa6-b576-964025a105c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a37808fe-939b-47dc-9fec-c82149dd32b1', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-af7ecfb1-b9ca-4829-8f80-a4735f5293a7 tempest-ServerRescueNegativeTestJSON-1770820849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0efa1eed-f999-4c88-bb94-f2c6beee4a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:12 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2d0d7844-5dc5-4917-8788-50697212b4d1 tempest-VolumesTransfersV355Test-1328087141 None] Acquiring lock "cinder-13b80f76-206e-4be2-9752-1d9a6150f9f6-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:59:12 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2d0d7844-5dc5-4917-8788-50697212b4d1 tempest-VolumesTransfersV355Test-1328087141 None] Lock "cinder-13b80f76-206e-4be2-9752-1d9a6150f9f6-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:59:12 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-af7ecfb1-b9ca-4829-8f80-a4735f5293a7 tempest-ServerRescueNegativeTestJSON-1770820849 None] Volume volume-a37808fe-939b-47dc-9fec-c82149dd32b1 (a37808fe-939b-47dc-9fec-c82149dd32b1): created successfully Sep 28 14:59:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-af7ecfb1-b9ca-4829-8f80-a4735f5293a7 tempest-ServerRescueNegativeTestJSON-1770820849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0efa1eed-f999-4c88-bb94-f2c6beee4a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-af7ecfb1-b9ca-4829-8f80-a4735f5293a7 tempest-ServerRescueNegativeTestJSON-1770820849 None] Flow 'volume_create_manager' (43c8d9c0-8cbf-46e6-9262-c8017590dd26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:59:12 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-af7ecfb1-b9ca-4829-8f80-a4735f5293a7 tempest-ServerRescueNegativeTestJSON-1770820849 None] Created volume successfully. Sep 28 14:59:13 devstack sudo[97064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c Sep 28 14:59:13 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2d0d7844-5dc5-4917-8788-50697212b4d1 tempest-VolumesTransfersV355Test-1328087141 None] Acquiring lock "cinder-quobyte-13b80f76-206e-4be2-9752-1d9a6150f9f6" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:59:13 devstack sudo[97064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:13 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2d0d7844-5dc5-4917-8788-50697212b4d1 tempest-VolumesTransfersV355Test-1328087141 None] Lock "cinder-quobyte-13b80f76-206e-4be2-9752-1d9a6150f9f6" acquired by "delete_volume" :: waited 0.019s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:59:13 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[555d241a-74b3-453e-adfe-801f99c94899]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:59:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2d0d7844-5dc5-4917-8788-50697212b4d1 tempest-VolumesTransfersV355Test-1328087141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-13b80f76-206e-4be2-9752-1d9a6150f9f6 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:13 devstack sudo[97066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-13b80f76-206e-4be2-9752-1d9a6150f9f6 Sep 28 14:59:13 devstack sudo[97066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:13 devstack sudo[97064]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ea6df334-14fa-4a50-96bb-95653c7bae60 tempest-SnapshotsActionsTest-2008821915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c" returned: 0 in 0.564s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:13 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-ea6df334-14fa-4a50-96bb-95653c7bae60 tempest-SnapshotsActionsTest-2008821915 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 14:59:13 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c53ca52-501d-4de4-992c-f457491a1809]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:59:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ea6df334-14fa-4a50-96bb-95653c7bae60 tempest-SnapshotsActionsTest-2008821915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:13 devstack sudo[97071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0 Sep 28 14:59:13 devstack sudo[97071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:13 devstack sudo[97066]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2d0d7844-5dc5-4917-8788-50697212b4d1 tempest-VolumesTransfersV355Test-1328087141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-13b80f76-206e-4be2-9752-1d9a6150f9f6" returned: 0 in 0.446s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2d0d7844-5dc5-4917-8788-50697212b4d1 tempest-VolumesTransfersV355Test-1328087141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-13b80f76-206e-4be2-9752-1d9a6150f9f6 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:13 devstack sudo[97076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-13b80f76-206e-4be2-9752-1d9a6150f9f6 Sep 28 14:59:13 devstack sudo[97076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:13 devstack sudo[97071]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:13 devstack sudo[97076]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2d0d7844-5dc5-4917-8788-50697212b4d1 tempest-VolumesTransfersV355Test-1328087141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-13b80f76-206e-4be2-9752-1d9a6150f9f6" returned: 0 in 0.286s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ea6df334-14fa-4a50-96bb-95653c7bae60 tempest-SnapshotsActionsTest-2008821915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0" returned: 0 in 0.447s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ea6df334-14fa-4a50-96bb-95653c7bae60 tempest-SnapshotsActionsTest-2008821915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:13 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2d0d7844-5dc5-4917-8788-50697212b4d1 tempest-VolumesTransfersV355Test-1328087141 None] Lock "cinder-quobyte-13b80f76-206e-4be2-9752-1d9a6150f9f6" released by "delete_volume" :: held 0.822s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:59:13 devstack sudo[97082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c Sep 28 14:59:13 devstack sudo[97082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:13 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-2d0d7844-5dc5-4917-8788-50697212b4d1 tempest-VolumesTransfersV355Test-1328087141 None] Created reservations ['b4e3d179-87c5-480c-8b3c-0e8eb6a21176', '088395e2-6274-4a98-b4fe-a1c821ecd69d', '82b3371d-8438-4272-96d0-64aafb73e60f', '4b60daad-4876-48e2-8630-d950b4b73cee'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 14:59:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2d0d7844-5dc5-4917-8788-50697212b4d1 tempest-VolumesTransfersV355Test-1328087141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:59:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2d0d7844-5dc5-4917-8788-50697212b4d1 tempest-VolumesTransfersV355Test-1328087141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:59:14 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2d0d7844-5dc5-4917-8788-50697212b4d1 tempest-VolumesTransfersV355Test-1328087141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:59:14 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2d0d7844-5dc5-4917-8788-50697212b4d1 tempest-VolumesTransfersV355Test-1328087141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:59:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2d0d7844-5dc5-4917-8788-50697212b4d1 tempest-VolumesTransfersV355Test-1328087141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:59:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2d0d7844-5dc5-4917-8788-50697212b4d1 tempest-VolumesTransfersV355Test-1328087141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:14 devstack sudo[97084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 14:59:14 devstack sudo[97084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:14 devstack sudo[97084]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2d0d7844-5dc5-4917-8788-50697212b4d1 tempest-VolumesTransfersV355Test-1328087141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.444s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:14 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-2d0d7844-5dc5-4917-8788-50697212b4d1 tempest-VolumesTransfersV355Test-1328087141 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:59:14 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-2d0d7844-5dc5-4917-8788-50697212b4d1 tempest-VolumesTransfersV355Test-1328087141 None] Deleted volume successfully. Sep 28 14:59:14 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2d0d7844-5dc5-4917-8788-50697212b4d1 tempest-VolumesTransfersV355Test-1328087141 None] Lock "cinder-13b80f76-206e-4be2-9752-1d9a6150f9f6-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:59:14 devstack sudo[97082]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ea6df334-14fa-4a50-96bb-95653c7bae60 tempest-SnapshotsActionsTest-2008821915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c" returned: 0 in 0.743s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ea6df334-14fa-4a50-96bb-95653c7bae60 tempest-SnapshotsActionsTest-2008821915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:14 devstack sudo[97091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c Sep 28 14:59:14 devstack sudo[97091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:15 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-553d0353-12d5-420f-bcb9-8ceb1d7cd987 tempest-VolumesTransfersV355Test-1025677033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 14:59:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-553d0353-12d5-420f-bcb9-8ceb1d7cd987 tempest-VolumesTransfersV355Test-1025677033 None] Flow 'volume_create_manager' (0e4f6ebd-2e8c-41d5-a36d-c76440ab9465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:59:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-553d0353-12d5-420f-bcb9-8ceb1d7cd987 tempest-VolumesTransfersV355Test-1025677033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5dd9984-0684-4445-b1a8-bad1ce46ca17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:15 devstack sudo[97091]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ea6df334-14fa-4a50-96bb-95653c7bae60 tempest-SnapshotsActionsTest-2008821915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0.73a05ef3-452c-4103-b49d-367cbcfe409c" returned: 0 in 0.633s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-553d0353-12d5-420f-bcb9-8ceb1d7cd987 tempest-VolumesTransfersV355Test-1025677033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5dd9984-0684-4445-b1a8-bad1ce46ca17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:59:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-57726363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1bf6044-3a47-4fcf-92db-a5c4e4fcdafc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce18ec16ea5f4cb59b24840f28a5d292',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:59:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:59:15Z,use_quota=True,user_id='31a552f214634f5487835ff0a798133a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-553d0353-12d5-420f-bcb9-8ceb1d7cd987 tempest-VolumesTransfersV355Test-1025677033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c2ead60-33c7-46c5-b02b-491ddf57111a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-553d0353-12d5-420f-bcb9-8ceb1d7cd987 tempest-VolumesTransfersV355Test-1025677033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c2ead60-33c7-46c5-b02b-491ddf57111a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-553d0353-12d5-420f-bcb9-8ceb1d7cd987 tempest-VolumesTransfersV355Test-1025677033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (394ce961-c5c3-4c45-8ef8-230245478259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-553d0353-12d5-420f-bcb9-8ceb1d7cd987 tempest-VolumesTransfersV355Test-1025677033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (394ce961-c5c3-4c45-8ef8-230245478259) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1bf6044-3a47-4fcf-92db-a5c4e4fcdafc', 'volume_name': 'volume-f1bf6044-3a47-4fcf-92db-a5c4e4fcdafc', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-553d0353-12d5-420f-bcb9-8ceb1d7cd987 tempest-VolumesTransfersV355Test-1025677033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (749a0ffd-d765-4af0-9cce-3b5689dbbbb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-553d0353-12d5-420f-bcb9-8ceb1d7cd987 tempest-VolumesTransfersV355Test-1025677033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (749a0ffd-d765-4af0-9cce-3b5689dbbbb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-553d0353-12d5-420f-bcb9-8ceb1d7cd987 tempest-VolumesTransfersV355Test-1025677033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f521900b-0f22-415f-8354-936f017458c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:15 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-553d0353-12d5-420f-bcb9-8ceb1d7cd987 tempest-VolumesTransfersV355Test-1025677033 None] Volume f1bf6044-3a47-4fcf-92db-a5c4e4fcdafc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1bf6044-3a47-4fcf-92db-a5c4e4fcdafc', 'volume_size': 1} Sep 28 14:59:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-553d0353-12d5-420f-bcb9-8ceb1d7cd987 tempest-VolumesTransfersV355Test-1025677033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:59:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-553d0353-12d5-420f-bcb9-8ceb1d7cd987 tempest-VolumesTransfersV355Test-1025677033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:59:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-553d0353-12d5-420f-bcb9-8ceb1d7cd987 tempest-VolumesTransfersV355Test-1025677033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:59:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-57726363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1bf6044-3a47-4fcf-92db-a5c4e4fcdafc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce18ec16ea5f4cb59b24840f28a5d292',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:59:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:59:15Z,use_quota=True,user_id='31a552f214634f5487835ff0a798133a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 14:59:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-553d0353-12d5-420f-bcb9-8ceb1d7cd987 tempest-VolumesTransfersV355Test-1025677033 None] Creating volume f1bf6044-3a47-4fcf-92db-a5c4e4fcdafc {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 14:59:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-553d0353-12d5-420f-bcb9-8ceb1d7cd987 tempest-VolumesTransfersV355Test-1025677033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:59:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-553d0353-12d5-420f-bcb9-8ceb1d7cd987 tempest-VolumesTransfersV355Test-1025677033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:59:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-553d0353-12d5-420f-bcb9-8ceb1d7cd987 tempest-VolumesTransfersV355Test-1025677033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:59:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-553d0353-12d5-420f-bcb9-8ceb1d7cd987 tempest-VolumesTransfersV355Test-1025677033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:59:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-553d0353-12d5-420f-bcb9-8ceb1d7cd987 tempest-VolumesTransfersV355Test-1025677033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:59:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-553d0353-12d5-420f-bcb9-8ceb1d7cd987 tempest-VolumesTransfersV355Test-1025677033 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 14:59:15 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-553d0353-12d5-420f-bcb9-8ceb1d7cd987 tempest-VolumesTransfersV355Test-1025677033 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 14:59:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-553d0353-12d5-420f-bcb9-8ceb1d7cd987 tempest-VolumesTransfersV355Test-1025677033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f1bf6044-3a47-4fcf-92db-a5c4e4fcdafc 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:15 devstack sudo[97095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f1bf6044-3a47-4fcf-92db-a5c4e4fcdafc 1073741824 Sep 28 14:59:15 devstack sudo[97095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ea6df334-14fa-4a50-96bb-95653c7bae60 tempest-SnapshotsActionsTest-2008821915 None] Lock "cinder-quobyte-73a05ef3-452c-4103-b49d-367cbcfe409c" released by "_delete_snapshot" :: held 2.676s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:59:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ea6df334-14fa-4a50-96bb-95653c7bae60 tempest-SnapshotsActionsTest-2008821915 None] Lock "cinder-quobyte-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0" released by "delete_snapshot" :: held 2.722s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:59:15 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-ea6df334-14fa-4a50-96bb-95653c7bae60 tempest-SnapshotsActionsTest-2008821915 None] Created reservations ['47ae4ede-39f8-4da0-8a48-df31963b69d5', 'ca6d728a-61f1-4213-bcb2-977d6e664b9b', '369d579a-2c85-48a6-8d4c-8e46753aa7f3', 'bcaf1595-34c1-4880-bb81-bdb4fde09f62'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 14:59:15 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-ea6df334-14fa-4a50-96bb-95653c7bae60 tempest-SnapshotsActionsTest-2008821915 None] Delete snapshot completed successfully. Sep 28 14:59:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ea6df334-14fa-4a50-96bb-95653c7bae60 tempest-SnapshotsActionsTest-2008821915 None] Lock "cinder-73a05ef3-452c-4103-b49d-367cbcfe409c-delete_snapshot" released by "delete_snapshot" :: held 2.990s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:59:15 devstack sudo[97095]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-553d0353-12d5-420f-bcb9-8ceb1d7cd987 tempest-VolumesTransfersV355Test-1025677033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f1bf6044-3a47-4fcf-92db-a5c4e4fcdafc 1073741824" returned: 0 in 0.668s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-553d0353-12d5-420f-bcb9-8ceb1d7cd987 tempest-VolumesTransfersV355Test-1025677033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f1bf6044-3a47-4fcf-92db-a5c4e4fcdafc {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:16 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1c3397f4-80ab-4f21-8395-31040c78ea05 tempest-SnapshotsActionsTest-2008821915 None] Acquiring lock "cinder-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:59:16 devstack sudo[97114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f1bf6044-3a47-4fcf-92db-a5c4e4fcdafc Sep 28 14:59:16 devstack sudo[97114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:16 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1c3397f4-80ab-4f21-8395-31040c78ea05 tempest-SnapshotsActionsTest-2008821915 None] Lock "cinder-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:59:16 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1c3397f4-80ab-4f21-8395-31040c78ea05 tempest-SnapshotsActionsTest-2008821915 None] Acquiring lock "cinder-quobyte-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:59:16 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1c3397f4-80ab-4f21-8395-31040c78ea05 tempest-SnapshotsActionsTest-2008821915 None] Lock "cinder-quobyte-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0" acquired by "delete_volume" :: waited 0.063s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:59:16 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef87d808-5109-4e96-bbd9-bc117b8b6e0d]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:59:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1c3397f4-80ab-4f21-8395-31040c78ea05 tempest-SnapshotsActionsTest-2008821915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:16 devstack sudo[97114]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-553d0353-12d5-420f-bcb9-8ceb1d7cd987 tempest-VolumesTransfersV355Test-1025677033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f1bf6044-3a47-4fcf-92db-a5c4e4fcdafc" returned: 0 in 0.586s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:16 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-553d0353-12d5-420f-bcb9-8ceb1d7cd987 tempest-VolumesTransfersV355Test-1025677033 None] <== create_volume: return (1335ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 14:59:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-553d0353-12d5-420f-bcb9-8ceb1d7cd987 tempest-VolumesTransfersV355Test-1025677033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.338s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:59:16 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-553d0353-12d5-420f-bcb9-8ceb1d7cd987 tempest-VolumesTransfersV355Test-1025677033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f521900b-0f22-415f-8354-936f017458c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1bf6044-3a47-4fcf-92db-a5c4e4fcdafc', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:16 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-553d0353-12d5-420f-bcb9-8ceb1d7cd987 tempest-VolumesTransfersV355Test-1025677033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e40b324a-00b5-44b6-ae78-44c290feba51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:16 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-553d0353-12d5-420f-bcb9-8ceb1d7cd987 tempest-VolumesTransfersV355Test-1025677033 None] Volume volume-f1bf6044-3a47-4fcf-92db-a5c4e4fcdafc (f1bf6044-3a47-4fcf-92db-a5c4e4fcdafc): created successfully Sep 28 14:59:16 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-553d0353-12d5-420f-bcb9-8ceb1d7cd987 tempest-VolumesTransfersV355Test-1025677033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e40b324a-00b5-44b6-ae78-44c290feba51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:16 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-553d0353-12d5-420f-bcb9-8ceb1d7cd987 tempest-VolumesTransfersV355Test-1025677033 None] Flow 'volume_create_manager' (0e4f6ebd-2e8c-41d5-a36d-c76440ab9465) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:59:16 devstack sudo[97119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0 Sep 28 14:59:16 devstack sudo[97119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:16 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-553d0353-12d5-420f-bcb9-8ceb1d7cd987 tempest-VolumesTransfersV355Test-1025677033 None] Created volume successfully. Sep 28 14:59:16 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:59:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:59:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:59:16 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:59:16 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:59:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:59:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:17 devstack sudo[97119]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:17 devstack sudo[97133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 14:59:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1c3397f4-80ab-4f21-8395-31040c78ea05 tempest-SnapshotsActionsTest-2008821915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0" returned: 0 in 0.640s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1c3397f4-80ab-4f21-8395-31040c78ea05 tempest-SnapshotsActionsTest-2008821915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:17 devstack sudo[97133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:17 devstack sudo[97135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0 Sep 28 14:59:17 devstack sudo[97135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:17 devstack sudo[97133]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.460s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:17 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:59:17 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running periodic task VolumeManager._thread_info {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:59:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] thread count: 28 {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 14:59:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] thread info: [<_MainThread(MainThread, started 135146735652992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 14:59:17 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-fba7dbf8-e739-41b3-af47-d7338d804517 tempest-AttachVolumeNegativeTest-950462997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 14:59:17 devstack sudo[97135]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fba7dbf8-e739-41b3-af47-d7338d804517 tempest-AttachVolumeNegativeTest-950462997 None] Flow 'volume_create_manager' (e89f3f67-bb6e-4806-a005-75029f8e027a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:59:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fba7dbf8-e739-41b3-af47-d7338d804517 tempest-AttachVolumeNegativeTest-950462997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65bda557-2a01-401e-a742-88a32c47d145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1c3397f4-80ab-4f21-8395-31040c78ea05 tempest-SnapshotsActionsTest-2008821915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0" returned: 0 in 0.625s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fba7dbf8-e739-41b3-af47-d7338d804517 tempest-AttachVolumeNegativeTest-950462997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65bda557-2a01-401e-a742-88a32c47d145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:59:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1835748175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc204839-e0c8-466a-abaf-e82ecc532a3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='482d3ae3d4794286b2a5140f95848307',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:59:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:59:17Z,use_quota=True,user_id='36e88df4624545bdaee4b33104bd6cc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fba7dbf8-e739-41b3-af47-d7338d804517 tempest-AttachVolumeNegativeTest-950462997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0df68553-350f-411d-838a-d1ed43298a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fba7dbf8-e739-41b3-af47-d7338d804517 tempest-AttachVolumeNegativeTest-950462997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0df68553-350f-411d-838a-d1ed43298a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fba7dbf8-e739-41b3-af47-d7338d804517 tempest-AttachVolumeNegativeTest-950462997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c72f2bc5-a278-44b7-aab5-8e1449c5216c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fba7dbf8-e739-41b3-af47-d7338d804517 tempest-AttachVolumeNegativeTest-950462997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c72f2bc5-a278-44b7-aab5-8e1449c5216c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc204839-e0c8-466a-abaf-e82ecc532a3f', 'volume_name': 'volume-bc204839-e0c8-466a-abaf-e82ecc532a3f', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fba7dbf8-e739-41b3-af47-d7338d804517 tempest-AttachVolumeNegativeTest-950462997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (566b5db3-8a9f-4888-9f7c-39c97619fc35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fba7dbf8-e739-41b3-af47-d7338d804517 tempest-AttachVolumeNegativeTest-950462997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (566b5db3-8a9f-4888-9f7c-39c97619fc35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fba7dbf8-e739-41b3-af47-d7338d804517 tempest-AttachVolumeNegativeTest-950462997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3097657a-4921-448c-bf00-584263acd617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:17 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-fba7dbf8-e739-41b3-af47-d7338d804517 tempest-AttachVolumeNegativeTest-950462997 None] Volume bc204839-e0c8-466a-abaf-e82ecc532a3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc204839-e0c8-466a-abaf-e82ecc532a3f', 'volume_size': 1} Sep 28 14:59:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-fba7dbf8-e739-41b3-af47-d7338d804517 tempest-AttachVolumeNegativeTest-950462997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:59:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-fba7dbf8-e739-41b3-af47-d7338d804517 tempest-AttachVolumeNegativeTest-950462997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:59:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-fba7dbf8-e739-41b3-af47-d7338d804517 tempest-AttachVolumeNegativeTest-950462997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:59:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1835748175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc204839-e0c8-466a-abaf-e82ecc532a3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='482d3ae3d4794286b2a5140f95848307',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:59:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:59:17Z,use_quota=True,user_id='36e88df4624545bdaee4b33104bd6cc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 14:59:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-fba7dbf8-e739-41b3-af47-d7338d804517 tempest-AttachVolumeNegativeTest-950462997 None] Creating volume bc204839-e0c8-466a-abaf-e82ecc532a3f {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 14:59:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-fba7dbf8-e739-41b3-af47-d7338d804517 tempest-AttachVolumeNegativeTest-950462997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:59:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-fba7dbf8-e739-41b3-af47-d7338d804517 tempest-AttachVolumeNegativeTest-950462997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:59:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-fba7dbf8-e739-41b3-af47-d7338d804517 tempest-AttachVolumeNegativeTest-950462997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:59:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-fba7dbf8-e739-41b3-af47-d7338d804517 tempest-AttachVolumeNegativeTest-950462997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:59:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-fba7dbf8-e739-41b3-af47-d7338d804517 tempest-AttachVolumeNegativeTest-950462997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:59:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-fba7dbf8-e739-41b3-af47-d7338d804517 tempest-AttachVolumeNegativeTest-950462997 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 14:59:17 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-fba7dbf8-e739-41b3-af47-d7338d804517 tempest-AttachVolumeNegativeTest-950462997 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 14:59:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fba7dbf8-e739-41b3-af47-d7338d804517 tempest-AttachVolumeNegativeTest-950462997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bc204839-e0c8-466a-abaf-e82ecc532a3f 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:17 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1c3397f4-80ab-4f21-8395-31040c78ea05 tempest-SnapshotsActionsTest-2008821915 None] Lock "cinder-quobyte-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0" released by "delete_volume" :: held 1.549s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:59:17 devstack sudo[97149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bc204839-e0c8-466a-abaf-e82ecc532a3f 1073741824 Sep 28 14:59:17 devstack sudo[97149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:17 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-1c3397f4-80ab-4f21-8395-31040c78ea05 tempest-SnapshotsActionsTest-2008821915 None] Created reservations ['4fdacbfb-1404-479f-bf16-501a6d2f1351', '85835db6-0d51-46ee-887e-9e7c9ad11d09', '318e4ff6-750e-4fc8-8d49-da48efd735f2', '4227b982-8226-4c92-9181-faa5b80779c1'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 14:59:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1c3397f4-80ab-4f21-8395-31040c78ea05 tempest-SnapshotsActionsTest-2008821915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:59:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1c3397f4-80ab-4f21-8395-31040c78ea05 tempest-SnapshotsActionsTest-2008821915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:59:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1c3397f4-80ab-4f21-8395-31040c78ea05 tempest-SnapshotsActionsTest-2008821915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:59:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1c3397f4-80ab-4f21-8395-31040c78ea05 tempest-SnapshotsActionsTest-2008821915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:59:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1c3397f4-80ab-4f21-8395-31040c78ea05 tempest-SnapshotsActionsTest-2008821915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:59:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1c3397f4-80ab-4f21-8395-31040c78ea05 tempest-SnapshotsActionsTest-2008821915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:18 devstack sudo[97161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 14:59:18 devstack sudo[97161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:18 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b123a0c1-6108-4fea-975d-175cfef722e6 tempest-VolumesTransfersV355Test-1328087141 None] Acquiring lock "cinder-f1bf6044-3a47-4fcf-92db-a5c4e4fcdafc-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:59:18 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b123a0c1-6108-4fea-975d-175cfef722e6 tempest-VolumesTransfersV355Test-1328087141 None] Lock "cinder-f1bf6044-3a47-4fcf-92db-a5c4e4fcdafc-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:59:18 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b123a0c1-6108-4fea-975d-175cfef722e6 tempest-VolumesTransfersV355Test-1328087141 None] Acquiring lock "cinder-quobyte-f1bf6044-3a47-4fcf-92db-a5c4e4fcdafc" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:59:18 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b123a0c1-6108-4fea-975d-175cfef722e6 tempest-VolumesTransfersV355Test-1328087141 None] Lock "cinder-quobyte-f1bf6044-3a47-4fcf-92db-a5c4e4fcdafc" acquired by "delete_volume" :: waited 0.027s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:59:18 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a781cd-a255-47d6-b71e-f3d6d647bcc1]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:59:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b123a0c1-6108-4fea-975d-175cfef722e6 tempest-VolumesTransfersV355Test-1328087141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f1bf6044-3a47-4fcf-92db-a5c4e4fcdafc {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:18 devstack sudo[97178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f1bf6044-3a47-4fcf-92db-a5c4e4fcdafc Sep 28 14:59:18 devstack sudo[97178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:18 devstack sudo[97149]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fba7dbf8-e739-41b3-af47-d7338d804517 tempest-AttachVolumeNegativeTest-950462997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bc204839-e0c8-466a-abaf-e82ecc532a3f 1073741824" returned: 0 in 0.872s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:18 devstack sudo[97161]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1c3397f4-80ab-4f21-8395-31040c78ea05 tempest-SnapshotsActionsTest-2008821915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.600s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:18 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-1c3397f4-80ab-4f21-8395-31040c78ea05 tempest-SnapshotsActionsTest-2008821915 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:59:18 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-1c3397f4-80ab-4f21-8395-31040c78ea05 tempest-SnapshotsActionsTest-2008821915 None] Deleted volume successfully. Sep 28 14:59:18 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1c3397f4-80ab-4f21-8395-31040c78ea05 tempest-SnapshotsActionsTest-2008821915 None] Lock "cinder-4f79a4ac-0e3c-4e1b-98b4-f0ea7b3257a0-delete_volume" released by "delete_volume" :: held 2.675s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:59:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fba7dbf8-e739-41b3-af47-d7338d804517 tempest-AttachVolumeNegativeTest-950462997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bc204839-e0c8-466a-abaf-e82ecc532a3f {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:18 devstack sudo[97181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bc204839-e0c8-466a-abaf-e82ecc532a3f Sep 28 14:59:18 devstack sudo[97181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:19 devstack sudo[97178]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b123a0c1-6108-4fea-975d-175cfef722e6 tempest-VolumesTransfersV355Test-1328087141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f1bf6044-3a47-4fcf-92db-a5c4e4fcdafc" returned: 0 in 0.915s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b123a0c1-6108-4fea-975d-175cfef722e6 tempest-VolumesTransfersV355Test-1328087141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f1bf6044-3a47-4fcf-92db-a5c4e4fcdafc {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:19 devstack sudo[97187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f1bf6044-3a47-4fcf-92db-a5c4e4fcdafc Sep 28 14:59:19 devstack sudo[97187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:19 devstack sudo[97181]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fba7dbf8-e739-41b3-af47-d7338d804517 tempest-AttachVolumeNegativeTest-950462997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bc204839-e0c8-466a-abaf-e82ecc532a3f" returned: 0 in 0.647s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-fba7dbf8-e739-41b3-af47-d7338d804517 tempest-AttachVolumeNegativeTest-950462997 None] <== create_volume: return (1661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 14:59:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-fba7dbf8-e739-41b3-af47-d7338d804517 tempest-AttachVolumeNegativeTest-950462997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.667s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:59:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fba7dbf8-e739-41b3-af47-d7338d804517 tempest-AttachVolumeNegativeTest-950462997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3097657a-4921-448c-bf00-584263acd617) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc204839-e0c8-466a-abaf-e82ecc532a3f', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fba7dbf8-e739-41b3-af47-d7338d804517 tempest-AttachVolumeNegativeTest-950462997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b86b351b-79d1-46ae-a265-404a97b1b96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:19 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-fba7dbf8-e739-41b3-af47-d7338d804517 tempest-AttachVolumeNegativeTest-950462997 None] Volume volume-bc204839-e0c8-466a-abaf-e82ecc532a3f (bc204839-e0c8-466a-abaf-e82ecc532a3f): created successfully Sep 28 14:59:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fba7dbf8-e739-41b3-af47-d7338d804517 tempest-AttachVolumeNegativeTest-950462997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b86b351b-79d1-46ae-a265-404a97b1b96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fba7dbf8-e739-41b3-af47-d7338d804517 tempest-AttachVolumeNegativeTest-950462997 None] Flow 'volume_create_manager' (e89f3f67-bb6e-4806-a005-75029f8e027a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:59:19 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-fba7dbf8-e739-41b3-af47-d7338d804517 tempest-AttachVolumeNegativeTest-950462997 None] Created volume successfully. Sep 28 14:59:19 devstack sudo[97187]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b123a0c1-6108-4fea-975d-175cfef722e6 tempest-VolumesTransfersV355Test-1328087141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f1bf6044-3a47-4fcf-92db-a5c4e4fcdafc" returned: 0 in 0.353s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:19 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b123a0c1-6108-4fea-975d-175cfef722e6 tempest-VolumesTransfersV355Test-1328087141 None] Lock "cinder-quobyte-f1bf6044-3a47-4fcf-92db-a5c4e4fcdafc" released by "delete_volume" :: held 1.346s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:59:19 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-b123a0c1-6108-4fea-975d-175cfef722e6 tempest-VolumesTransfersV355Test-1328087141 None] Created reservations ['5d9e4003-6e3b-4960-801e-b08d0c2ecd07', '394f45f4-6442-40e0-bd7f-7746517110bd', 'c820cebf-56dd-46e9-bd1b-bffd4952a908', 'aaec70b0-091a-445c-b35d-9e618c4e40cf'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 14:59:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b123a0c1-6108-4fea-975d-175cfef722e6 tempest-VolumesTransfersV355Test-1328087141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:59:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b123a0c1-6108-4fea-975d-175cfef722e6 tempest-VolumesTransfersV355Test-1328087141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:59:20 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b123a0c1-6108-4fea-975d-175cfef722e6 tempest-VolumesTransfersV355Test-1328087141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:59:20 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b123a0c1-6108-4fea-975d-175cfef722e6 tempest-VolumesTransfersV355Test-1328087141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:59:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b123a0c1-6108-4fea-975d-175cfef722e6 tempest-VolumesTransfersV355Test-1328087141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:59:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b123a0c1-6108-4fea-975d-175cfef722e6 tempest-VolumesTransfersV355Test-1328087141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:20 devstack sudo[97191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 14:59:20 devstack sudo[97191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:20 devstack sudo[97191]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b123a0c1-6108-4fea-975d-175cfef722e6 tempest-VolumesTransfersV355Test-1328087141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.810s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:20 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-b123a0c1-6108-4fea-975d-175cfef722e6 tempest-VolumesTransfersV355Test-1328087141 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:59:20 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-b123a0c1-6108-4fea-975d-175cfef722e6 tempest-VolumesTransfersV355Test-1328087141 None] Deleted volume successfully. Sep 28 14:59:20 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b123a0c1-6108-4fea-975d-175cfef722e6 tempest-VolumesTransfersV355Test-1328087141 None] Lock "cinder-f1bf6044-3a47-4fcf-92db-a5c4e4fcdafc-delete_volume" released by "delete_volume" :: held 2.650s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:59:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-16fee0d2-d740-48e3-9f8b-1cb8e3fd7254 req-68b9f722-e734-49a0-9282-24765157f01f tempest-AttachVolumeNegativeTest-950462997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:59:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-16fee0d2-d740-48e3-9f8b-1cb8e3fd7254 req-68b9f722-e734-49a0-9282-24765157f01f tempest-AttachVolumeNegativeTest-950462997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:59:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-16fee0d2-d740-48e3-9f8b-1cb8e3fd7254 req-68b9f722-e734-49a0-9282-24765157f01f tempest-AttachVolumeNegativeTest-950462997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:59:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-16fee0d2-d740-48e3-9f8b-1cb8e3fd7254 req-68b9f722-e734-49a0-9282-24765157f01f tempest-AttachVolumeNegativeTest-950462997 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1', 'name': 'volume-bc204839-e0c8-466a-abaf-e82ecc532a3f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '59580b1c-fc3d-4262-9052-8d8f66107bea', 'enforce_multipath': True} {{(pid=87116) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 14:59:22 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-16fee0d2-d740-48e3-9f8b-1cb8e3fd7254 req-68b9f722-e734-49a0-9282-24765157f01f tempest-AttachVolumeNegativeTest-950462997 None] attachment_update completed successfully. Sep 28 14:59:28 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7892c3d2-ffa3-477b-a6ca-c5e49bb9fa98 tempest-ServerRescueNegativeTestJSON-1770820849 None] Acquiring lock "cinder-a37808fe-939b-47dc-9fec-c82149dd32b1-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:59:28 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7892c3d2-ffa3-477b-a6ca-c5e49bb9fa98 tempest-ServerRescueNegativeTestJSON-1770820849 None] Lock "cinder-a37808fe-939b-47dc-9fec-c82149dd32b1-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:59:28 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7892c3d2-ffa3-477b-a6ca-c5e49bb9fa98 tempest-ServerRescueNegativeTestJSON-1770820849 None] Acquiring lock "cinder-quobyte-a37808fe-939b-47dc-9fec-c82149dd32b1" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:59:28 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7892c3d2-ffa3-477b-a6ca-c5e49bb9fa98 tempest-ServerRescueNegativeTestJSON-1770820849 None] Lock "cinder-quobyte-a37808fe-939b-47dc-9fec-c82149dd32b1" acquired by "delete_volume" :: waited 0.022s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:59:28 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd1fb4b-e65c-4cd9-8490-7741d510a378]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:59:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7892c3d2-ffa3-477b-a6ca-c5e49bb9fa98 tempest-ServerRescueNegativeTestJSON-1770820849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a37808fe-939b-47dc-9fec-c82149dd32b1 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:28 devstack sudo[97724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a37808fe-939b-47dc-9fec-c82149dd32b1 Sep 28 14:59:28 devstack sudo[97724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:29 devstack sudo[97724]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7892c3d2-ffa3-477b-a6ca-c5e49bb9fa98 tempest-ServerRescueNegativeTestJSON-1770820849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a37808fe-939b-47dc-9fec-c82149dd32b1" returned: 0 in 0.838s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7892c3d2-ffa3-477b-a6ca-c5e49bb9fa98 tempest-ServerRescueNegativeTestJSON-1770820849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a37808fe-939b-47dc-9fec-c82149dd32b1 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:29 devstack sudo[97729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a37808fe-939b-47dc-9fec-c82149dd32b1 Sep 28 14:59:29 devstack sudo[97729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:30 devstack sudo[97729]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7892c3d2-ffa3-477b-a6ca-c5e49bb9fa98 tempest-ServerRescueNegativeTestJSON-1770820849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a37808fe-939b-47dc-9fec-c82149dd32b1" returned: 0 in 0.592s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7892c3d2-ffa3-477b-a6ca-c5e49bb9fa98 tempest-ServerRescueNegativeTestJSON-1770820849 None] Lock "cinder-quobyte-a37808fe-939b-47dc-9fec-c82149dd32b1" released by "delete_volume" :: held 1.571s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:59:30 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-7892c3d2-ffa3-477b-a6ca-c5e49bb9fa98 tempest-ServerRescueNegativeTestJSON-1770820849 None] Created reservations ['e8f24ab3-6e6a-4d2f-81cd-4f939638bbc7', '674c9a1c-d77d-451b-82c6-c172ee206ecd', 'ab294240-3e00-427a-8c69-1348947d71e1', '9276a232-808e-4434-a278-4cd7d4b3ba9f'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 14:59:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7892c3d2-ffa3-477b-a6ca-c5e49bb9fa98 tempest-ServerRescueNegativeTestJSON-1770820849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:59:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7892c3d2-ffa3-477b-a6ca-c5e49bb9fa98 tempest-ServerRescueNegativeTestJSON-1770820849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:59:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7892c3d2-ffa3-477b-a6ca-c5e49bb9fa98 tempest-ServerRescueNegativeTestJSON-1770820849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:59:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7892c3d2-ffa3-477b-a6ca-c5e49bb9fa98 tempest-ServerRescueNegativeTestJSON-1770820849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:59:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7892c3d2-ffa3-477b-a6ca-c5e49bb9fa98 tempest-ServerRescueNegativeTestJSON-1770820849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:59:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7892c3d2-ffa3-477b-a6ca-c5e49bb9fa98 tempest-ServerRescueNegativeTestJSON-1770820849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:30 devstack sudo[97733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 14:59:30 devstack sudo[97733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:31 devstack sudo[97733]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7892c3d2-ffa3-477b-a6ca-c5e49bb9fa98 tempest-ServerRescueNegativeTestJSON-1770820849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.761s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:31 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-7892c3d2-ffa3-477b-a6ca-c5e49bb9fa98 tempest-ServerRescueNegativeTestJSON-1770820849 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:59:31 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-7892c3d2-ffa3-477b-a6ca-c5e49bb9fa98 tempest-ServerRescueNegativeTestJSON-1770820849 None] Deleted volume successfully. Sep 28 14:59:31 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7892c3d2-ffa3-477b-a6ca-c5e49bb9fa98 tempest-ServerRescueNegativeTestJSON-1770820849 None] Lock "cinder-a37808fe-939b-47dc-9fec-c82149dd32b1-delete_volume" released by "delete_volume" :: held 2.809s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:59:40 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=79,cinder:UPDATE=79,cinder:DELETE=4,cinder:INSERT=19 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:59:40 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=58,cinder:INSERT=21,cinder:UPDATE=74,cinder:DELETE=8 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:59:50 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:UPDATE=1 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:59:51 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6ce8a79-d3c1-4197-a9c4-c18e8c19112c tempest-VolumeQuotasAdminTestJSON-1810648696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 14:59:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e6ce8a79-d3c1-4197-a9c4-c18e8c19112c tempest-VolumeQuotasAdminTestJSON-1810648696 None] Flow 'volume_create_manager' (de574f2b-4779-46f8-8164-954851b0064b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:59:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e6ce8a79-d3c1-4197-a9c4-c18e8c19112c tempest-VolumeQuotasAdminTestJSON-1810648696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f1abf22-d18b-452a-8535-c7afacbc5469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e6ce8a79-d3c1-4197-a9c4-c18e8c19112c tempest-VolumeQuotasAdminTestJSON-1810648696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f1abf22-d18b-452a-8535-c7afacbc5469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:59:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-242955893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55a19b77-52cf-4b0a-b943-d86a657fa6e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a615f32da51403eb4995ed71aba7f03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:59:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:59:52Z,use_quota=True,user_id='6d766884b3034ef08cfad8e4527c64e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e6ce8a79-d3c1-4197-a9c4-c18e8c19112c tempest-VolumeQuotasAdminTestJSON-1810648696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c2bb8ad-5a15-4028-b0e2-4f0a691d862e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e6ce8a79-d3c1-4197-a9c4-c18e8c19112c tempest-VolumeQuotasAdminTestJSON-1810648696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c2bb8ad-5a15-4028-b0e2-4f0a691d862e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e6ce8a79-d3c1-4197-a9c4-c18e8c19112c tempest-VolumeQuotasAdminTestJSON-1810648696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad260b09-68c9-4b1e-a734-9bbf977fd451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e6ce8a79-d3c1-4197-a9c4-c18e8c19112c tempest-VolumeQuotasAdminTestJSON-1810648696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad260b09-68c9-4b1e-a734-9bbf977fd451) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55a19b77-52cf-4b0a-b943-d86a657fa6e8', 'volume_name': 'volume-55a19b77-52cf-4b0a-b943-d86a657fa6e8', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e6ce8a79-d3c1-4197-a9c4-c18e8c19112c tempest-VolumeQuotasAdminTestJSON-1810648696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8fa32d9-74ee-42a9-83ad-3ffd769bf416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e6ce8a79-d3c1-4197-a9c4-c18e8c19112c tempest-VolumeQuotasAdminTestJSON-1810648696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8fa32d9-74ee-42a9-83ad-3ffd769bf416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e6ce8a79-d3c1-4197-a9c4-c18e8c19112c tempest-VolumeQuotasAdminTestJSON-1810648696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee0fa929-209e-4dfe-b001-170f2d8291c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:52 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-e6ce8a79-d3c1-4197-a9c4-c18e8c19112c tempest-VolumeQuotasAdminTestJSON-1810648696 None] Volume 55a19b77-52cf-4b0a-b943-d86a657fa6e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55a19b77-52cf-4b0a-b943-d86a657fa6e8', 'volume_size': 1} Sep 28 14:59:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e6ce8a79-d3c1-4197-a9c4-c18e8c19112c tempest-VolumeQuotasAdminTestJSON-1810648696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:59:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e6ce8a79-d3c1-4197-a9c4-c18e8c19112c tempest-VolumeQuotasAdminTestJSON-1810648696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:59:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e6ce8a79-d3c1-4197-a9c4-c18e8c19112c tempest-VolumeQuotasAdminTestJSON-1810648696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:59:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-242955893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55a19b77-52cf-4b0a-b943-d86a657fa6e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a615f32da51403eb4995ed71aba7f03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:59:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:59:52Z,use_quota=True,user_id='6d766884b3034ef08cfad8e4527c64e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 14:59:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-e6ce8a79-d3c1-4197-a9c4-c18e8c19112c tempest-VolumeQuotasAdminTestJSON-1810648696 None] Creating volume 55a19b77-52cf-4b0a-b943-d86a657fa6e8 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 14:59:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e6ce8a79-d3c1-4197-a9c4-c18e8c19112c tempest-VolumeQuotasAdminTestJSON-1810648696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:59:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e6ce8a79-d3c1-4197-a9c4-c18e8c19112c tempest-VolumeQuotasAdminTestJSON-1810648696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:59:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e6ce8a79-d3c1-4197-a9c4-c18e8c19112c tempest-VolumeQuotasAdminTestJSON-1810648696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:59:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e6ce8a79-d3c1-4197-a9c4-c18e8c19112c tempest-VolumeQuotasAdminTestJSON-1810648696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:59:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e6ce8a79-d3c1-4197-a9c4-c18e8c19112c tempest-VolumeQuotasAdminTestJSON-1810648696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:59:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e6ce8a79-d3c1-4197-a9c4-c18e8c19112c tempest-VolumeQuotasAdminTestJSON-1810648696 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 14:59:52 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-e6ce8a79-d3c1-4197-a9c4-c18e8c19112c tempest-VolumeQuotasAdminTestJSON-1810648696 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 14:59:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e6ce8a79-d3c1-4197-a9c4-c18e8c19112c tempest-VolumeQuotasAdminTestJSON-1810648696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-55a19b77-52cf-4b0a-b943-d86a657fa6e8 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:52 devstack sudo[97920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-55a19b77-52cf-4b0a-b943-d86a657fa6e8 1073741824 Sep 28 14:59:52 devstack sudo[97920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:52 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cbcdda3-0972-4f18-9a89-b9a3caeb2ac1 tempest-VolumesActionsTest-1427483947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 14:59:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7cbcdda3-0972-4f18-9a89-b9a3caeb2ac1 tempest-VolumesActionsTest-1427483947 None] Flow 'volume_create_manager' (544137f5-281d-44e9-a063-3d6ba966d691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:59:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7cbcdda3-0972-4f18-9a89-b9a3caeb2ac1 tempest-VolumesActionsTest-1427483947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a6c1c03-0d41-42aa-9060-ed89e68ddfcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7cbcdda3-0972-4f18-9a89-b9a3caeb2ac1 tempest-VolumesActionsTest-1427483947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a6c1c03-0d41-42aa-9060-ed89e68ddfcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:59:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-45333535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc09b466-fa90-4f3b-9dc9-b0edd019087e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24535f58790c49ad9bbb121e1bbc95ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:59:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:59:52Z,use_quota=True,user_id='07d459f0a72d4c27806ae21797d0fb2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7cbcdda3-0972-4f18-9a89-b9a3caeb2ac1 tempest-VolumesActionsTest-1427483947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ac03e00-9a9d-41a8-989e-d01008e84cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7cbcdda3-0972-4f18-9a89-b9a3caeb2ac1 tempest-VolumesActionsTest-1427483947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ac03e00-9a9d-41a8-989e-d01008e84cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7cbcdda3-0972-4f18-9a89-b9a3caeb2ac1 tempest-VolumesActionsTest-1427483947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfb98770-e672-4b80-bb16-2c5cbe414a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7cbcdda3-0972-4f18-9a89-b9a3caeb2ac1 tempest-VolumesActionsTest-1427483947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfb98770-e672-4b80-bb16-2c5cbe414a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc09b466-fa90-4f3b-9dc9-b0edd019087e', 'volume_name': 'volume-bc09b466-fa90-4f3b-9dc9-b0edd019087e', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7cbcdda3-0972-4f18-9a89-b9a3caeb2ac1 tempest-VolumesActionsTest-1427483947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b91106db-4ab8-4c5e-b09b-3b569704f6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7cbcdda3-0972-4f18-9a89-b9a3caeb2ac1 tempest-VolumesActionsTest-1427483947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b91106db-4ab8-4c5e-b09b-3b569704f6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7cbcdda3-0972-4f18-9a89-b9a3caeb2ac1 tempest-VolumesActionsTest-1427483947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0de61f1d-74c4-4de2-bdf0-2f92eac48dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:52 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-7cbcdda3-0972-4f18-9a89-b9a3caeb2ac1 tempest-VolumesActionsTest-1427483947 None] Volume bc09b466-fa90-4f3b-9dc9-b0edd019087e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc09b466-fa90-4f3b-9dc9-b0edd019087e', 'volume_size': 1} Sep 28 14:59:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7cbcdda3-0972-4f18-9a89-b9a3caeb2ac1 tempest-VolumesActionsTest-1427483947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:59:53 devstack sudo[97920]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e6ce8a79-d3c1-4197-a9c4-c18e8c19112c tempest-VolumeQuotasAdminTestJSON-1810648696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-55a19b77-52cf-4b0a-b943-d86a657fa6e8 1073741824" returned: 0 in 0.827s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e6ce8a79-d3c1-4197-a9c4-c18e8c19112c tempest-VolumeQuotasAdminTestJSON-1810648696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-55a19b77-52cf-4b0a-b943-d86a657fa6e8 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:53 devstack sudo[97926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-55a19b77-52cf-4b0a-b943-d86a657fa6e8 Sep 28 14:59:53 devstack sudo[97926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:53 devstack sudo[97926]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e6ce8a79-d3c1-4197-a9c4-c18e8c19112c tempest-VolumeQuotasAdminTestJSON-1810648696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-55a19b77-52cf-4b0a-b943-d86a657fa6e8" returned: 0 in 0.488s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:53 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e6ce8a79-d3c1-4197-a9c4-c18e8c19112c tempest-VolumeQuotasAdminTestJSON-1810648696 None] <== create_volume: return (1407ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 14:59:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e6ce8a79-d3c1-4197-a9c4-c18e8c19112c tempest-VolumeQuotasAdminTestJSON-1810648696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.410s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:59:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7cbcdda3-0972-4f18-9a89-b9a3caeb2ac1 tempest-VolumesActionsTest-1427483947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.895s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:59:53 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7cbcdda3-0972-4f18-9a89-b9a3caeb2ac1 tempest-VolumesActionsTest-1427483947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:59:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-45333535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc09b466-fa90-4f3b-9dc9-b0edd019087e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24535f58790c49ad9bbb121e1bbc95ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:59:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:59:52Z,use_quota=True,user_id='07d459f0a72d4c27806ae21797d0fb2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 14:59:53 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-7cbcdda3-0972-4f18-9a89-b9a3caeb2ac1 tempest-VolumesActionsTest-1427483947 None] Creating volume bc09b466-fa90-4f3b-9dc9-b0edd019087e {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 14:59:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7cbcdda3-0972-4f18-9a89-b9a3caeb2ac1 tempest-VolumesActionsTest-1427483947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:59:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7cbcdda3-0972-4f18-9a89-b9a3caeb2ac1 tempest-VolumesActionsTest-1427483947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:59:53 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7cbcdda3-0972-4f18-9a89-b9a3caeb2ac1 tempest-VolumesActionsTest-1427483947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:59:53 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7cbcdda3-0972-4f18-9a89-b9a3caeb2ac1 tempest-VolumesActionsTest-1427483947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:59:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7cbcdda3-0972-4f18-9a89-b9a3caeb2ac1 tempest-VolumesActionsTest-1427483947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:59:53 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7cbcdda3-0972-4f18-9a89-b9a3caeb2ac1 tempest-VolumesActionsTest-1427483947 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 14:59:53 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-7cbcdda3-0972-4f18-9a89-b9a3caeb2ac1 tempest-VolumesActionsTest-1427483947 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 14:59:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7cbcdda3-0972-4f18-9a89-b9a3caeb2ac1 tempest-VolumesActionsTest-1427483947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bc09b466-fa90-4f3b-9dc9-b0edd019087e 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:53 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e6ce8a79-d3c1-4197-a9c4-c18e8c19112c tempest-VolumeQuotasAdminTestJSON-1810648696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee0fa929-209e-4dfe-b001-170f2d8291c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55a19b77-52cf-4b0a-b943-d86a657fa6e8', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:53 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e6ce8a79-d3c1-4197-a9c4-c18e8c19112c tempest-VolumeQuotasAdminTestJSON-1810648696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6d4cd0b-2cc3-4d34-8828-0d687a06b9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:53 devstack sudo[97930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bc09b466-fa90-4f3b-9dc9-b0edd019087e 1073741824 Sep 28 14:59:53 devstack sudo[97930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:53 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-e6ce8a79-d3c1-4197-a9c4-c18e8c19112c tempest-VolumeQuotasAdminTestJSON-1810648696 None] Volume volume-55a19b77-52cf-4b0a-b943-d86a657fa6e8 (55a19b77-52cf-4b0a-b943-d86a657fa6e8): created successfully Sep 28 14:59:53 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e6ce8a79-d3c1-4197-a9c4-c18e8c19112c tempest-VolumeQuotasAdminTestJSON-1810648696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6d4cd0b-2cc3-4d34-8828-0d687a06b9cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:53 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e6ce8a79-d3c1-4197-a9c4-c18e8c19112c tempest-VolumeQuotasAdminTestJSON-1810648696 None] Flow 'volume_create_manager' (de574f2b-4779-46f8-8164-954851b0064b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:59:53 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-e6ce8a79-d3c1-4197-a9c4-c18e8c19112c tempest-VolumeQuotasAdminTestJSON-1810648696 None] Created volume successfully. Sep 28 14:59:54 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-28954a3e-6e44-43af-8c31-64258fdbf9ae tempest-VolumeQuotasAdminTestJSON-1810648696 None] Acquiring lock "cinder-55a19b77-52cf-4b0a-b943-d86a657fa6e8-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:59:54 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-28954a3e-6e44-43af-8c31-64258fdbf9ae tempest-VolumeQuotasAdminTestJSON-1810648696 None] Lock "cinder-55a19b77-52cf-4b0a-b943-d86a657fa6e8-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:59:54 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-28954a3e-6e44-43af-8c31-64258fdbf9ae tempest-VolumeQuotasAdminTestJSON-1810648696 None] Acquiring lock "cinder-quobyte-55a19b77-52cf-4b0a-b943-d86a657fa6e8" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 14:59:54 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-28954a3e-6e44-43af-8c31-64258fdbf9ae tempest-VolumeQuotasAdminTestJSON-1810648696 None] Lock "cinder-quobyte-55a19b77-52cf-4b0a-b943-d86a657fa6e8" acquired by "delete_volume" :: waited 0.020s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 14:59:54 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d0a97a-2e48-4656-9686-66b2811dd1e5]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 14:59:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-28954a3e-6e44-43af-8c31-64258fdbf9ae tempest-VolumeQuotasAdminTestJSON-1810648696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-55a19b77-52cf-4b0a-b943-d86a657fa6e8 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:54 devstack sudo[97930]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7cbcdda3-0972-4f18-9a89-b9a3caeb2ac1 tempest-VolumesActionsTest-1427483947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bc09b466-fa90-4f3b-9dc9-b0edd019087e 1073741824" returned: 0 in 1.029s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7cbcdda3-0972-4f18-9a89-b9a3caeb2ac1 tempest-VolumesActionsTest-1427483947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bc09b466-fa90-4f3b-9dc9-b0edd019087e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:54 devstack sudo[97940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bc09b466-fa90-4f3b-9dc9-b0edd019087e Sep 28 14:59:54 devstack sudo[97940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:54 devstack sudo[97939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-55a19b77-52cf-4b0a-b943-d86a657fa6e8 Sep 28 14:59:54 devstack sudo[97939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:55 devstack sudo[97940]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7cbcdda3-0972-4f18-9a89-b9a3caeb2ac1 tempest-VolumesActionsTest-1427483947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bc09b466-fa90-4f3b-9dc9-b0edd019087e" returned: 0 in 0.495s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:55 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7cbcdda3-0972-4f18-9a89-b9a3caeb2ac1 tempest-VolumesActionsTest-1427483947 None] <== create_volume: return (1610ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 14:59:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7cbcdda3-0972-4f18-9a89-b9a3caeb2ac1 tempest-VolumesActionsTest-1427483947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.614s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:59:55 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7cbcdda3-0972-4f18-9a89-b9a3caeb2ac1 tempest-VolumesActionsTest-1427483947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0de61f1d-74c4-4de2-bdf0-2f92eac48dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc09b466-fa90-4f3b-9dc9-b0edd019087e', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:55 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7cbcdda3-0972-4f18-9a89-b9a3caeb2ac1 tempest-VolumesActionsTest-1427483947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0e75be4-59ef-4d66-b2bb-ce4b2579acd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:55 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-7cbcdda3-0972-4f18-9a89-b9a3caeb2ac1 tempest-VolumesActionsTest-1427483947 None] Volume volume-bc09b466-fa90-4f3b-9dc9-b0edd019087e (bc09b466-fa90-4f3b-9dc9-b0edd019087e): created successfully Sep 28 14:59:55 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7cbcdda3-0972-4f18-9a89-b9a3caeb2ac1 tempest-VolumesActionsTest-1427483947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0e75be4-59ef-4d66-b2bb-ce4b2579acd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:55 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7cbcdda3-0972-4f18-9a89-b9a3caeb2ac1 tempest-VolumesActionsTest-1427483947 None] Flow 'volume_create_manager' (544137f5-281d-44e9-a063-3d6ba966d691) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:59:55 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-7cbcdda3-0972-4f18-9a89-b9a3caeb2ac1 tempest-VolumesActionsTest-1427483947 None] Created volume successfully. Sep 28 14:59:55 devstack sudo[97939]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-28954a3e-6e44-43af-8c31-64258fdbf9ae tempest-VolumeQuotasAdminTestJSON-1810648696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-55a19b77-52cf-4b0a-b943-d86a657fa6e8" returned: 0 in 0.765s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-28954a3e-6e44-43af-8c31-64258fdbf9ae tempest-VolumeQuotasAdminTestJSON-1810648696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-55a19b77-52cf-4b0a-b943-d86a657fa6e8 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:55 devstack sudo[97948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-55a19b77-52cf-4b0a-b943-d86a657fa6e8 Sep 28 14:59:55 devstack sudo[97948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:55 devstack sudo[97948]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-28954a3e-6e44-43af-8c31-64258fdbf9ae tempest-VolumeQuotasAdminTestJSON-1810648696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-55a19b77-52cf-4b0a-b943-d86a657fa6e8" returned: 0 in 0.299s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:55 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-28954a3e-6e44-43af-8c31-64258fdbf9ae tempest-VolumeQuotasAdminTestJSON-1810648696 None] Lock "cinder-quobyte-55a19b77-52cf-4b0a-b943-d86a657fa6e8" released by "delete_volume" :: held 1.164s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:59:55 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-28954a3e-6e44-43af-8c31-64258fdbf9ae tempest-VolumeQuotasAdminTestJSON-1810648696 None] Created reservations ['1a45b9a4-735c-4d1f-9ff6-639deb6c714b', 'f4ad8835-33ae-4179-93be-62352b47878c', '1b44e846-98c3-456e-ac04-ea1283938eff', '1f37b1a8-6fc3-492c-9b4b-8beac2b9fe4a'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 14:59:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-28954a3e-6e44-43af-8c31-64258fdbf9ae tempest-VolumeQuotasAdminTestJSON-1810648696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:59:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-28954a3e-6e44-43af-8c31-64258fdbf9ae tempest-VolumeQuotasAdminTestJSON-1810648696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:59:55 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-28954a3e-6e44-43af-8c31-64258fdbf9ae tempest-VolumeQuotasAdminTestJSON-1810648696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:59:55 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-28954a3e-6e44-43af-8c31-64258fdbf9ae tempest-VolumeQuotasAdminTestJSON-1810648696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:59:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-28954a3e-6e44-43af-8c31-64258fdbf9ae tempest-VolumeQuotasAdminTestJSON-1810648696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:59:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-28954a3e-6e44-43af-8c31-64258fdbf9ae tempest-VolumeQuotasAdminTestJSON-1810648696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:56 devstack sudo[97951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 14:59:56 devstack sudo[97951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:56 devstack sudo[97951]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-28954a3e-6e44-43af-8c31-64258fdbf9ae tempest-VolumeQuotasAdminTestJSON-1810648696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.334s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:56 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-28954a3e-6e44-43af-8c31-64258fdbf9ae tempest-VolumeQuotasAdminTestJSON-1810648696 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:59:56 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-28954a3e-6e44-43af-8c31-64258fdbf9ae tempest-VolumeQuotasAdminTestJSON-1810648696 None] Deleted volume successfully. Sep 28 14:59:56 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-28954a3e-6e44-43af-8c31-64258fdbf9ae tempest-VolumeQuotasAdminTestJSON-1810648696 None] Lock "cinder-55a19b77-52cf-4b0a-b943-d86a657fa6e8-delete_volume" released by "delete_volume" :: held 1.867s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 14:59:57 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf293d14-109f-4423-bc29-3188a1ad653f tempest-VolumeQuotasAdminTestJSON-1810648696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 14:59:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bf293d14-109f-4423-bc29-3188a1ad653f tempest-VolumeQuotasAdminTestJSON-1810648696 None] Flow 'volume_create_manager' (76f0d021-5427-4922-8975-d3fad7148c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:59:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bf293d14-109f-4423-bc29-3188a1ad653f tempest-VolumeQuotasAdminTestJSON-1810648696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c1ae7e2-82fe-40bd-8035-202ca02d2d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bf293d14-109f-4423-bc29-3188a1ad653f tempest-VolumeQuotasAdminTestJSON-1810648696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c1ae7e2-82fe-40bd-8035-202ca02d2d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:59:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1871334258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dda1d2ee-8027-4e2a-b05e-3d5938f7ef9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a615f32da51403eb4995ed71aba7f03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:59:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:59:58Z,use_quota=True,user_id='6d766884b3034ef08cfad8e4527c64e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bf293d14-109f-4423-bc29-3188a1ad653f tempest-VolumeQuotasAdminTestJSON-1810648696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1175082c-c592-4971-bae8-dd1f25072b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bf293d14-109f-4423-bc29-3188a1ad653f tempest-VolumeQuotasAdminTestJSON-1810648696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1175082c-c592-4971-bae8-dd1f25072b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bf293d14-109f-4423-bc29-3188a1ad653f tempest-VolumeQuotasAdminTestJSON-1810648696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35ce938c-a3b5-4824-ac48-e996ca04c394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bf293d14-109f-4423-bc29-3188a1ad653f tempest-VolumeQuotasAdminTestJSON-1810648696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35ce938c-a3b5-4824-ac48-e996ca04c394) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dda1d2ee-8027-4e2a-b05e-3d5938f7ef9d', 'volume_name': 'volume-dda1d2ee-8027-4e2a-b05e-3d5938f7ef9d', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bf293d14-109f-4423-bc29-3188a1ad653f tempest-VolumeQuotasAdminTestJSON-1810648696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8be65d4d-28e3-40ce-89e8-eca499d11373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bf293d14-109f-4423-bc29-3188a1ad653f tempest-VolumeQuotasAdminTestJSON-1810648696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8be65d4d-28e3-40ce-89e8-eca499d11373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bf293d14-109f-4423-bc29-3188a1ad653f tempest-VolumeQuotasAdminTestJSON-1810648696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b040e2c7-b6c6-4768-a9cb-0b3a0e942014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:58 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-bf293d14-109f-4423-bc29-3188a1ad653f tempest-VolumeQuotasAdminTestJSON-1810648696 None] Volume dda1d2ee-8027-4e2a-b05e-3d5938f7ef9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dda1d2ee-8027-4e2a-b05e-3d5938f7ef9d', 'volume_size': 1} Sep 28 14:59:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bf293d14-109f-4423-bc29-3188a1ad653f tempest-VolumeQuotasAdminTestJSON-1810648696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:59:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bf293d14-109f-4423-bc29-3188a1ad653f tempest-VolumeQuotasAdminTestJSON-1810648696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:59:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-bf293d14-109f-4423-bc29-3188a1ad653f tempest-VolumeQuotasAdminTestJSON-1810648696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:59:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1871334258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dda1d2ee-8027-4e2a-b05e-3d5938f7ef9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a615f32da51403eb4995ed71aba7f03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:59:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:59:58Z,use_quota=True,user_id='6d766884b3034ef08cfad8e4527c64e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 14:59:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-bf293d14-109f-4423-bc29-3188a1ad653f tempest-VolumeQuotasAdminTestJSON-1810648696 None] Creating volume dda1d2ee-8027-4e2a-b05e-3d5938f7ef9d {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 14:59:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bf293d14-109f-4423-bc29-3188a1ad653f tempest-VolumeQuotasAdminTestJSON-1810648696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:59:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bf293d14-109f-4423-bc29-3188a1ad653f tempest-VolumeQuotasAdminTestJSON-1810648696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:59:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-bf293d14-109f-4423-bc29-3188a1ad653f tempest-VolumeQuotasAdminTestJSON-1810648696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:59:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-bf293d14-109f-4423-bc29-3188a1ad653f tempest-VolumeQuotasAdminTestJSON-1810648696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:59:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bf293d14-109f-4423-bc29-3188a1ad653f tempest-VolumeQuotasAdminTestJSON-1810648696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:59:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-bf293d14-109f-4423-bc29-3188a1ad653f tempest-VolumeQuotasAdminTestJSON-1810648696 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 14:59:58 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-bf293d14-109f-4423-bc29-3188a1ad653f tempest-VolumeQuotasAdminTestJSON-1810648696 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 14:59:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bf293d14-109f-4423-bc29-3188a1ad653f tempest-VolumeQuotasAdminTestJSON-1810648696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-dda1d2ee-8027-4e2a-b05e-3d5938f7ef9d 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:58 devstack sudo[97957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-dda1d2ee-8027-4e2a-b05e-3d5938f7ef9d 1073741824 Sep 28 14:59:58 devstack sudo[97957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:59 devstack sudo[97957]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bf293d14-109f-4423-bc29-3188a1ad653f tempest-VolumeQuotasAdminTestJSON-1810648696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-dda1d2ee-8027-4e2a-b05e-3d5938f7ef9d 1073741824" returned: 0 in 0.876s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bf293d14-109f-4423-bc29-3188a1ad653f tempest-VolumeQuotasAdminTestJSON-1810648696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-dda1d2ee-8027-4e2a-b05e-3d5938f7ef9d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:59 devstack sudo[97973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-dda1d2ee-8027-4e2a-b05e-3d5938f7ef9d Sep 28 14:59:59 devstack sudo[97973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:59 devstack sudo[97973]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bf293d14-109f-4423-bc29-3188a1ad653f tempest-VolumeQuotasAdminTestJSON-1810648696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-dda1d2ee-8027-4e2a-b05e-3d5938f7ef9d" returned: 0 in 0.559s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-bf293d14-109f-4423-bc29-3188a1ad653f tempest-VolumeQuotasAdminTestJSON-1810648696 None] <== create_volume: return (1530ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 14:59:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bf293d14-109f-4423-bc29-3188a1ad653f tempest-VolumeQuotasAdminTestJSON-1810648696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.533s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:59:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bf293d14-109f-4423-bc29-3188a1ad653f tempest-VolumeQuotasAdminTestJSON-1810648696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b040e2c7-b6c6-4768-a9cb-0b3a0e942014) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dda1d2ee-8027-4e2a-b05e-3d5938f7ef9d', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bf293d14-109f-4423-bc29-3188a1ad653f tempest-VolumeQuotasAdminTestJSON-1810648696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a353f32-80cd-4b9b-9eae-cc48b7d0919f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:59 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-bf293d14-109f-4423-bc29-3188a1ad653f tempest-VolumeQuotasAdminTestJSON-1810648696 None] Volume volume-dda1d2ee-8027-4e2a-b05e-3d5938f7ef9d (dda1d2ee-8027-4e2a-b05e-3d5938f7ef9d): created successfully Sep 28 14:59:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bf293d14-109f-4423-bc29-3188a1ad653f tempest-VolumeQuotasAdminTestJSON-1810648696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a353f32-80cd-4b9b-9eae-cc48b7d0919f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bf293d14-109f-4423-bc29-3188a1ad653f tempest-VolumeQuotasAdminTestJSON-1810648696 None] Flow 'volume_create_manager' (76f0d021-5427-4922-8975-d3fad7148c6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:59:59 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-bf293d14-109f-4423-bc29-3188a1ad653f tempest-VolumeQuotasAdminTestJSON-1810648696 None] Created volume successfully. Sep 28 15:00:01 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-ad3fbd6a-5c1c-4732-bf9e-638a0f29b225 tempest-VolumeQuotasAdminTestJSON-788837666 None] Transfer volume completed successfully. Sep 28 15:00:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f8ebb5a7-078b-41c1-b777-a5498cef77c3 tempest-VolumeQuotasAdminTestJSON-1021041007 None] Acquiring lock "cinder-dda1d2ee-8027-4e2a-b05e-3d5938f7ef9d-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:00:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f8ebb5a7-078b-41c1-b777-a5498cef77c3 tempest-VolumeQuotasAdminTestJSON-1021041007 None] Lock "cinder-dda1d2ee-8027-4e2a-b05e-3d5938f7ef9d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:00:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f8ebb5a7-078b-41c1-b777-a5498cef77c3 tempest-VolumeQuotasAdminTestJSON-1021041007 None] Acquiring lock "cinder-quobyte-dda1d2ee-8027-4e2a-b05e-3d5938f7ef9d" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:00:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f8ebb5a7-078b-41c1-b777-a5498cef77c3 tempest-VolumeQuotasAdminTestJSON-1021041007 None] Lock "cinder-quobyte-dda1d2ee-8027-4e2a-b05e-3d5938f7ef9d" acquired by "delete_volume" :: waited 0.023s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:00:02 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf98c9d-8c40-4d09-afa5-f9e2b600226f]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:00:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f8ebb5a7-078b-41c1-b777-a5498cef77c3 tempest-VolumeQuotasAdminTestJSON-1021041007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-dda1d2ee-8027-4e2a-b05e-3d5938f7ef9d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:02 devstack sudo[98030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-dda1d2ee-8027-4e2a-b05e-3d5938f7ef9d Sep 28 15:00:02 devstack sudo[98030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:02 devstack sudo[98030]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f8ebb5a7-078b-41c1-b777-a5498cef77c3 tempest-VolumeQuotasAdminTestJSON-1021041007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-dda1d2ee-8027-4e2a-b05e-3d5938f7ef9d" returned: 0 in 0.485s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f8ebb5a7-078b-41c1-b777-a5498cef77c3 tempest-VolumeQuotasAdminTestJSON-1021041007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-dda1d2ee-8027-4e2a-b05e-3d5938f7ef9d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:02 devstack sudo[98035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-dda1d2ee-8027-4e2a-b05e-3d5938f7ef9d Sep 28 15:00:02 devstack sudo[98035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:03 devstack sudo[98035]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f8ebb5a7-078b-41c1-b777-a5498cef77c3 tempest-VolumeQuotasAdminTestJSON-1021041007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-dda1d2ee-8027-4e2a-b05e-3d5938f7ef9d" returned: 0 in 0.502s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:03 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f8ebb5a7-078b-41c1-b777-a5498cef77c3 tempest-VolumeQuotasAdminTestJSON-1021041007 None] Lock "cinder-quobyte-dda1d2ee-8027-4e2a-b05e-3d5938f7ef9d" released by "delete_volume" :: held 1.072s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:00:03 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-f8ebb5a7-078b-41c1-b777-a5498cef77c3 tempest-VolumeQuotasAdminTestJSON-1021041007 None] Created reservations ['bf15030b-1e7c-44e7-8c85-a54f9f0c9c57', '5c0f6ebf-8dd0-4310-a37f-84c05601c032', '51833b89-f360-4b4f-b805-0c54329fcc17', '87e40b49-184b-447b-8536-6aec117bc716'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:00:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f8ebb5a7-078b-41c1-b777-a5498cef77c3 tempest-VolumeQuotasAdminTestJSON-1021041007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:00:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f8ebb5a7-078b-41c1-b777-a5498cef77c3 tempest-VolumeQuotasAdminTestJSON-1021041007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:00:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f8ebb5a7-078b-41c1-b777-a5498cef77c3 tempest-VolumeQuotasAdminTestJSON-1021041007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:00:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f8ebb5a7-078b-41c1-b777-a5498cef77c3 tempest-VolumeQuotasAdminTestJSON-1021041007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:00:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f8ebb5a7-078b-41c1-b777-a5498cef77c3 tempest-VolumeQuotasAdminTestJSON-1021041007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:00:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f8ebb5a7-078b-41c1-b777-a5498cef77c3 tempest-VolumeQuotasAdminTestJSON-1021041007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:03 devstack sudo[98074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:00:03 devstack sudo[98074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:04 devstack sudo[98074]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f8ebb5a7-078b-41c1-b777-a5498cef77c3 tempest-VolumeQuotasAdminTestJSON-1021041007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.671s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:04 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-f8ebb5a7-078b-41c1-b777-a5498cef77c3 tempest-VolumeQuotasAdminTestJSON-1021041007 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:00:04 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-f8ebb5a7-078b-41c1-b777-a5498cef77c3 tempest-VolumeQuotasAdminTestJSON-1021041007 None] Deleted volume successfully. Sep 28 15:00:04 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f8ebb5a7-078b-41c1-b777-a5498cef77c3 tempest-VolumeQuotasAdminTestJSON-1021041007 None] Lock "cinder-dda1d2ee-8027-4e2a-b05e-3d5938f7ef9d-delete_volume" released by "delete_volume" :: held 2.185s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:00:06 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-0e0b82a1-3b8a-4ae5-acf7-3285d9640eaf tempest-GroupsTest-1601700660 None] Group tempest-Group1-1539955335: creating Sep 28 15:00:06 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-0e0b82a1-3b8a-4ae5-acf7-3285d9640eaf tempest-GroupsTest-1601700660 None] Group tempest-Group1-1539955335: created successfully Sep 28 15:00:06 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-0e0b82a1-3b8a-4ae5-acf7-3285d9640eaf tempest-GroupsTest-1601700660 None] Create group completed successfully. Sep 28 15:00:07 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-739d2938-50bd-4efa-90ad-d47fbd314aac tempest-VolumesActionsTest-1427483947 None] Acquiring lock "cinder-bc09b466-fa90-4f3b-9dc9-b0edd019087e" by "attach_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:00:07 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-739d2938-50bd-4efa-90ad-d47fbd314aac tempest-VolumesActionsTest-1427483947 None] Lock "cinder-bc09b466-fa90-4f3b-9dc9-b0edd019087e" acquired by "attach_volume" :: waited 0.039s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:00:07 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-739d2938-50bd-4efa-90ad-d47fbd314aac tempest-VolumesActionsTest-1427483947 None] Attaching volume bc09b466-fa90-4f3b-9dc9-b0edd019087e to instance a6ef9c7d-6378-4437-baec-f0d18e893739 at mountpoint /dev/vdb on host None. Sep 28 15:00:07 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-739d2938-50bd-4efa-90ad-d47fbd314aac tempest-VolumesActionsTest-1427483947 None] Attach volume completed successfully. Sep 28 15:00:07 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-739d2938-50bd-4efa-90ad-d47fbd314aac tempest-VolumesActionsTest-1427483947 None] Lock "cinder-bc09b466-fa90-4f3b-9dc9-b0edd019087e" released by "attach_volume" :: held 0.195s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:00:08 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-69091104-2a2e-4f69-9658-72565b170a83 tempest-VolumesActionsTest-1427483947 None] Acquiring lock "cinder-bc09b466-fa90-4f3b-9dc9-b0edd019087e-detach_volume" by "detach_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:00:08 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-69091104-2a2e-4f69-9658-72565b170a83 tempest-VolumesActionsTest-1427483947 None] Lock "cinder-bc09b466-fa90-4f3b-9dc9-b0edd019087e-detach_volume" acquired by "detach_volume" :: waited 0.081s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:00:08 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-69091104-2a2e-4f69-9658-72565b170a83 tempest-VolumesActionsTest-1427483947 None] Detaching volume bc09b466-fa90-4f3b-9dc9-b0edd019087e from instance a6ef9c7d-6378-4437-baec-f0d18e893739. Sep 28 15:00:08 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-69091104-2a2e-4f69-9658-72565b170a83 tempest-VolumesActionsTest-1427483947 None] Detach volume completed successfully. Sep 28 15:00:08 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-69091104-2a2e-4f69-9658-72565b170a83 tempest-VolumesActionsTest-1427483947 None] Lock "cinder-bc09b466-fa90-4f3b-9dc9-b0edd019087e-detach_volume" released by "detach_volume" :: held 0.180s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:00:08 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-4b89d215-e921-49bf-9a9e-f555cf4dc5af tempest-GroupsTest-1601700660 None] Group tempest-Group2-872973445: creating Sep 28 15:00:08 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-4b89d215-e921-49bf-9a9e-f555cf4dc5af tempest-GroupsTest-1601700660 None] Group tempest-Group2-872973445: created successfully Sep 28 15:00:08 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-4b89d215-e921-49bf-9a9e-f555cf4dc5af tempest-GroupsTest-1601700660 None] Create group completed successfully. Sep 28 15:00:10 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-482475be-e6fd-4f36-b6d2-1f5928019f54 tempest-GroupsTest-1601700660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:00:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-482475be-e6fd-4f36-b6d2-1f5928019f54 tempest-GroupsTest-1601700660 None] Flow 'volume_create_manager' (3298acbd-25f9-4f23-a284-5b4b74ca7c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:00:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-482475be-e6fd-4f36-b6d2-1f5928019f54 tempest-GroupsTest-1601700660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4210dd9-3f53-44e8-b660-66f54ae5807b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-482475be-e6fd-4f36-b6d2-1f5928019f54 tempest-GroupsTest-1601700660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4210dd9-3f53-44e8-b660-66f54ae5807b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-582557171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f5d56465-81ab-4bb3-a8ae-f3f9c60a683b,host='devstack@QuobyteHD#QuobyteHD',id=56accd95-2604-4773-a29a-74d6b8478b54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f7c03d8db4c407499be5d53fc2cb286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:00:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:00:11Z,use_quota=True,user_id='7da7945082bd4cb1a8cfcb2d37789e15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0bd683f8-98be-4075-98d4-67950c210488),volume_type_id=0bd683f8-98be-4075-98d4-67950c210488)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-482475be-e6fd-4f36-b6d2-1f5928019f54 tempest-GroupsTest-1601700660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ec95b4d-b522-4f53-879a-4ad58e037771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-482475be-e6fd-4f36-b6d2-1f5928019f54 tempest-GroupsTest-1601700660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ec95b4d-b522-4f53-879a-4ad58e037771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-482475be-e6fd-4f36-b6d2-1f5928019f54 tempest-GroupsTest-1601700660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e377abe-9963-4916-b106-09692907d9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-482475be-e6fd-4f36-b6d2-1f5928019f54 tempest-GroupsTest-1601700660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e377abe-9963-4916-b106-09692907d9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56accd95-2604-4773-a29a-74d6b8478b54', 'volume_name': 'volume-56accd95-2604-4773-a29a-74d6b8478b54', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-482475be-e6fd-4f36-b6d2-1f5928019f54 tempest-GroupsTest-1601700660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b13e7c3-e25d-4e16-9b36-ebfb5bc5dc9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-482475be-e6fd-4f36-b6d2-1f5928019f54 tempest-GroupsTest-1601700660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b13e7c3-e25d-4e16-9b36-ebfb5bc5dc9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-482475be-e6fd-4f36-b6d2-1f5928019f54 tempest-GroupsTest-1601700660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61a7c27d-02ad-47da-86a0-a5ddd7ef8091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:10 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-482475be-e6fd-4f36-b6d2-1f5928019f54 tempest-GroupsTest-1601700660 None] Volume 56accd95-2604-4773-a29a-74d6b8478b54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56accd95-2604-4773-a29a-74d6b8478b54', 'volume_size': 1} Sep 28 15:00:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-482475be-e6fd-4f36-b6d2-1f5928019f54 tempest-GroupsTest-1601700660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:00:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-482475be-e6fd-4f36-b6d2-1f5928019f54 tempest-GroupsTest-1601700660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:00:10 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-482475be-e6fd-4f36-b6d2-1f5928019f54 tempest-GroupsTest-1601700660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f5d56465-81ab-4bb3-a8ae-f3f9c60a683b,created_at=2026-09-28T13:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-582557171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f5d56465-81ab-4bb3-a8ae-f3f9c60a683b,host='devstack@QuobyteHD#QuobyteHD',id=56accd95-2604-4773-a29a-74d6b8478b54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f7c03d8db4c407499be5d53fc2cb286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:00:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:00:11Z,use_quota=True,user_id='7da7945082bd4cb1a8cfcb2d37789e15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0bd683f8-98be-4075-98d4-67950c210488),volume_type_id=0bd683f8-98be-4075-98d4-67950c210488)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:00:10 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-482475be-e6fd-4f36-b6d2-1f5928019f54 tempest-GroupsTest-1601700660 None] Creating volume 56accd95-2604-4773-a29a-74d6b8478b54 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:00:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-482475be-e6fd-4f36-b6d2-1f5928019f54 tempest-GroupsTest-1601700660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:00:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-482475be-e6fd-4f36-b6d2-1f5928019f54 tempest-GroupsTest-1601700660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:00:10 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-482475be-e6fd-4f36-b6d2-1f5928019f54 tempest-GroupsTest-1601700660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:00:10 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-482475be-e6fd-4f36-b6d2-1f5928019f54 tempest-GroupsTest-1601700660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:00:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-482475be-e6fd-4f36-b6d2-1f5928019f54 tempest-GroupsTest-1601700660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:00:10 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-482475be-e6fd-4f36-b6d2-1f5928019f54 tempest-GroupsTest-1601700660 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:00:10 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-482475be-e6fd-4f36-b6d2-1f5928019f54 tempest-GroupsTest-1601700660 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:00:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-482475be-e6fd-4f36-b6d2-1f5928019f54 tempest-GroupsTest-1601700660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-56accd95-2604-4773-a29a-74d6b8478b54 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:10 devstack sudo[98151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-56accd95-2604-4773-a29a-74d6b8478b54 1073741824 Sep 28 15:00:10 devstack sudo[98151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:11 devstack sudo[98151]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-482475be-e6fd-4f36-b6d2-1f5928019f54 tempest-GroupsTest-1601700660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-56accd95-2604-4773-a29a-74d6b8478b54 1073741824" returned: 0 in 0.733s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-482475be-e6fd-4f36-b6d2-1f5928019f54 tempest-GroupsTest-1601700660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-56accd95-2604-4773-a29a-74d6b8478b54 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:11 devstack sudo[98158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-56accd95-2604-4773-a29a-74d6b8478b54 Sep 28 15:00:11 devstack sudo[98158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:11 devstack sudo[98158]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-482475be-e6fd-4f36-b6d2-1f5928019f54 tempest-GroupsTest-1601700660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-56accd95-2604-4773-a29a-74d6b8478b54" returned: 0 in 0.366s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:11 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-482475be-e6fd-4f36-b6d2-1f5928019f54 tempest-GroupsTest-1601700660 None] <== create_volume: return (1178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:00:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-482475be-e6fd-4f36-b6d2-1f5928019f54 tempest-GroupsTest-1601700660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:00:11 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-482475be-e6fd-4f36-b6d2-1f5928019f54 tempest-GroupsTest-1601700660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61a7c27d-02ad-47da-86a0-a5ddd7ef8091) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56accd95-2604-4773-a29a-74d6b8478b54', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:11 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-482475be-e6fd-4f36-b6d2-1f5928019f54 tempest-GroupsTest-1601700660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9174b373-8473-4406-a8ca-89f4f666df99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:11 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-482475be-e6fd-4f36-b6d2-1f5928019f54 tempest-GroupsTest-1601700660 None] Volume volume-56accd95-2604-4773-a29a-74d6b8478b54 (56accd95-2604-4773-a29a-74d6b8478b54): created successfully Sep 28 15:00:11 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-482475be-e6fd-4f36-b6d2-1f5928019f54 tempest-GroupsTest-1601700660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9174b373-8473-4406-a8ca-89f4f666df99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-482475be-e6fd-4f36-b6d2-1f5928019f54 tempest-GroupsTest-1601700660 None] Flow 'volume_create_manager' (3298acbd-25f9-4f23-a284-5b4b74ca7c03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:00:12 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-482475be-e6fd-4f36-b6d2-1f5928019f54 tempest-GroupsTest-1601700660 None] Created volume successfully. Sep 28 15:00:13 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fe47bc86-ebb3-4a6d-8e89-9f4f45b45818 tempest-GroupsTest-1601700660 None] Acquiring lock "cinder-quobyte-56accd95-2604-4773-a29a-74d6b8478b54" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:00:13 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fe47bc86-ebb3-4a6d-8e89-9f4f45b45818 tempest-GroupsTest-1601700660 None] Lock "cinder-quobyte-56accd95-2604-4773-a29a-74d6b8478b54" acquired by "delete_volume" :: waited 0.029s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:00:13 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[b274c827-ff41-4543-a51e-439b39781a07]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:00:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fe47bc86-ebb3-4a6d-8e89-9f4f45b45818 tempest-GroupsTest-1601700660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-56accd95-2604-4773-a29a-74d6b8478b54 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:14 devstack sudo[98166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-56accd95-2604-4773-a29a-74d6b8478b54 Sep 28 15:00:14 devstack sudo[98166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:14 devstack sudo[98166]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fe47bc86-ebb3-4a6d-8e89-9f4f45b45818 tempest-GroupsTest-1601700660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-56accd95-2604-4773-a29a-74d6b8478b54" returned: 0 in 0.625s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fe47bc86-ebb3-4a6d-8e89-9f4f45b45818 tempest-GroupsTest-1601700660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-56accd95-2604-4773-a29a-74d6b8478b54 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:14 devstack sudo[98171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-56accd95-2604-4773-a29a-74d6b8478b54 Sep 28 15:00:14 devstack sudo[98171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:14 devstack sudo[98171]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fe47bc86-ebb3-4a6d-8e89-9f4f45b45818 tempest-GroupsTest-1601700660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-56accd95-2604-4773-a29a-74d6b8478b54" returned: 0 in 0.424s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:14 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fe47bc86-ebb3-4a6d-8e89-9f4f45b45818 tempest-GroupsTest-1601700660 None] Lock "cinder-quobyte-56accd95-2604-4773-a29a-74d6b8478b54" released by "delete_volume" :: held 1.129s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:00:15 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-fe47bc86-ebb3-4a6d-8e89-9f4f45b45818 tempest-GroupsTest-1601700660 None] Created reservations ['ff158f24-8b0c-4857-9d5c-cb1bd14cc3cf'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:00:15 devstack cinder-volume[87116]: WARNING cinder.quota [None req-fe47bc86-ebb3-4a6d-8e89-9f4f45b45818 tempest-GroupsTest-1601700660 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-328697475 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-328697475, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:00:15 devstack cinder-volume[87116]: WARNING cinder.quota [None req-fe47bc86-ebb3-4a6d-8e89-9f4f45b45818 tempest-GroupsTest-1601700660 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-328697475 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-328697475, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:00:15 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-fe47bc86-ebb3-4a6d-8e89-9f4f45b45818 tempest-GroupsTest-1601700660 None] Created reservations ['489fa41c-f6f3-43b7-896b-48256e16f27e', '74e1941c-ec25-436f-98a3-8c4a19e290f5', '4201c02c-a738-4b5c-aa73-3dbac81f727b', '8b8f3938-5b4b-4aa7-8570-3d4f1c1f9453'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:00:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-fe47bc86-ebb3-4a6d-8e89-9f4f45b45818 tempest-GroupsTest-1601700660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:00:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-fe47bc86-ebb3-4a6d-8e89-9f4f45b45818 tempest-GroupsTest-1601700660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:00:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-fe47bc86-ebb3-4a6d-8e89-9f4f45b45818 tempest-GroupsTest-1601700660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:00:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-fe47bc86-ebb3-4a6d-8e89-9f4f45b45818 tempest-GroupsTest-1601700660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:00:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-fe47bc86-ebb3-4a6d-8e89-9f4f45b45818 tempest-GroupsTest-1601700660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:00:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fe47bc86-ebb3-4a6d-8e89-9f4f45b45818 tempest-GroupsTest-1601700660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:15 devstack sudo[98182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:00:15 devstack sudo[98182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:15 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-8fb40595-0b5c-4b59-86aa-3fd23d9ea4bd tempest-GroupsTest-1601700660 None] Created reservations ['665c0403-b046-4e1e-be31-34fea0183cf6'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:00:16 devstack sudo[98182]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fe47bc86-ebb3-4a6d-8e89-9f4f45b45818 tempest-GroupsTest-1601700660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.738s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:16 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-fe47bc86-ebb3-4a6d-8e89-9f4f45b45818 tempest-GroupsTest-1601700660 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:00:16 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-fe47bc86-ebb3-4a6d-8e89-9f4f45b45818 tempest-GroupsTest-1601700660 None] Delete group completed successfully. Sep 28 15:00:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8fb40595-0b5c-4b59-86aa-3fd23d9ea4bd tempest-GroupsTest-1601700660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:00:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8fb40595-0b5c-4b59-86aa-3fd23d9ea4bd tempest-GroupsTest-1601700660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:00:16 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8fb40595-0b5c-4b59-86aa-3fd23d9ea4bd tempest-GroupsTest-1601700660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:00:16 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8fb40595-0b5c-4b59-86aa-3fd23d9ea4bd tempest-GroupsTest-1601700660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:00:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8fb40595-0b5c-4b59-86aa-3fd23d9ea4bd tempest-GroupsTest-1601700660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:00:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8fb40595-0b5c-4b59-86aa-3fd23d9ea4bd tempest-GroupsTest-1601700660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:16 devstack sudo[98204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:00:16 devstack sudo[98204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:16 devstack sudo[98204]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8fb40595-0b5c-4b59-86aa-3fd23d9ea4bd tempest-GroupsTest-1601700660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.560s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:16 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-8fb40595-0b5c-4b59-86aa-3fd23d9ea4bd tempest-GroupsTest-1601700660 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:00:16 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-8fb40595-0b5c-4b59-86aa-3fd23d9ea4bd tempest-GroupsTest-1601700660 None] Delete group completed successfully. Sep 28 15:00:16 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:00:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:00:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:00:16 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:00:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:00:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:00:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:17 devstack sudo[98221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:00:17 devstack sudo[98221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:17 devstack sudo[98221]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.491s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:17 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:00:17 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running periodic task VolumeManager._thread_info {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:00:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] thread count: 28 {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:00:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] thread info: [<_MainThread(MainThread, started 135146735652992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:00:18 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-1a411a7c-33e3-4a1e-8d2f-2b901132bf68 tempest-GroupsTest-1601700660 None] Group tempest-GroupsTest-Group-1225384427: creating Sep 28 15:00:18 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-1a411a7c-33e3-4a1e-8d2f-2b901132bf68 tempest-GroupsTest-1601700660 None] Group tempest-GroupsTest-Group-1225384427: created successfully Sep 28 15:00:18 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-1a411a7c-33e3-4a1e-8d2f-2b901132bf68 tempest-GroupsTest-1601700660 None] Create group completed successfully. Sep 28 15:00:19 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-fba75af7-36f3-4897-9c49-dacb8f44ec8f tempest-VolumesServicesTestJSON-1019267259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:00:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fba75af7-36f3-4897-9c49-dacb8f44ec8f tempest-VolumesServicesTestJSON-1019267259 None] Flow 'volume_create_manager' (b2536ca9-3499-4a7e-b163-df65393273e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:00:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fba75af7-36f3-4897-9c49-dacb8f44ec8f tempest-VolumesServicesTestJSON-1019267259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7338061f-8f4d-44ca-8ad0-6d0bc44559a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fba75af7-36f3-4897-9c49-dacb8f44ec8f tempest-VolumesServicesTestJSON-1019267259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7338061f-8f4d-44ca-8ad0-6d0bc44559a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:00:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-817281480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba21a416-3212-4582-b5b4-e7e50a7f5c77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51db266acb7a4ce69316f3d5707bd2c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:00:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:00:20Z,use_quota=True,user_id='9c2e38213802482c9ff10355a706144a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fba75af7-36f3-4897-9c49-dacb8f44ec8f tempest-VolumesServicesTestJSON-1019267259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (042ab017-53b8-4cde-a50b-af4981fe1521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fba75af7-36f3-4897-9c49-dacb8f44ec8f tempest-VolumesServicesTestJSON-1019267259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (042ab017-53b8-4cde-a50b-af4981fe1521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fba75af7-36f3-4897-9c49-dacb8f44ec8f tempest-VolumesServicesTestJSON-1019267259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80a357cd-bccb-47b7-99d4-f8f0e3a9c17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fba75af7-36f3-4897-9c49-dacb8f44ec8f tempest-VolumesServicesTestJSON-1019267259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80a357cd-bccb-47b7-99d4-f8f0e3a9c17d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba21a416-3212-4582-b5b4-e7e50a7f5c77', 'volume_name': 'volume-ba21a416-3212-4582-b5b4-e7e50a7f5c77', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fba75af7-36f3-4897-9c49-dacb8f44ec8f tempest-VolumesServicesTestJSON-1019267259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1626a183-2a80-4461-9613-5159edc8c4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fba75af7-36f3-4897-9c49-dacb8f44ec8f tempest-VolumesServicesTestJSON-1019267259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1626a183-2a80-4461-9613-5159edc8c4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fba75af7-36f3-4897-9c49-dacb8f44ec8f tempest-VolumesServicesTestJSON-1019267259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d55ecdfa-5ee9-42e6-82b9-c23c47cb3bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:19 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-fba75af7-36f3-4897-9c49-dacb8f44ec8f tempest-VolumesServicesTestJSON-1019267259 None] Volume ba21a416-3212-4582-b5b4-e7e50a7f5c77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba21a416-3212-4582-b5b4-e7e50a7f5c77', 'volume_size': 1} Sep 28 15:00:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-fba75af7-36f3-4897-9c49-dacb8f44ec8f tempest-VolumesServicesTestJSON-1019267259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:00:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-fba75af7-36f3-4897-9c49-dacb8f44ec8f tempest-VolumesServicesTestJSON-1019267259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:00:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-fba75af7-36f3-4897-9c49-dacb8f44ec8f tempest-VolumesServicesTestJSON-1019267259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:00:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-817281480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba21a416-3212-4582-b5b4-e7e50a7f5c77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51db266acb7a4ce69316f3d5707bd2c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:00:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:00:20Z,use_quota=True,user_id='9c2e38213802482c9ff10355a706144a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:00:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-fba75af7-36f3-4897-9c49-dacb8f44ec8f tempest-VolumesServicesTestJSON-1019267259 None] Creating volume ba21a416-3212-4582-b5b4-e7e50a7f5c77 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:00:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-fba75af7-36f3-4897-9c49-dacb8f44ec8f tempest-VolumesServicesTestJSON-1019267259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:00:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-fba75af7-36f3-4897-9c49-dacb8f44ec8f tempest-VolumesServicesTestJSON-1019267259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:00:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-fba75af7-36f3-4897-9c49-dacb8f44ec8f tempest-VolumesServicesTestJSON-1019267259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:00:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-fba75af7-36f3-4897-9c49-dacb8f44ec8f tempest-VolumesServicesTestJSON-1019267259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:00:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-fba75af7-36f3-4897-9c49-dacb8f44ec8f tempest-VolumesServicesTestJSON-1019267259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:00:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-fba75af7-36f3-4897-9c49-dacb8f44ec8f tempest-VolumesServicesTestJSON-1019267259 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:00:19 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-fba75af7-36f3-4897-9c49-dacb8f44ec8f tempest-VolumesServicesTestJSON-1019267259 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:00:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fba75af7-36f3-4897-9c49-dacb8f44ec8f tempest-VolumesServicesTestJSON-1019267259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ba21a416-3212-4582-b5b4-e7e50a7f5c77 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:19 devstack sudo[98230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ba21a416-3212-4582-b5b4-e7e50a7f5c77 1073741824 Sep 28 15:00:19 devstack sudo[98230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:20 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a888a8d-0d04-4c73-bbc3-acf86063f441 tempest-GroupsTest-1601700660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:00:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6a888a8d-0d04-4c73-bbc3-acf86063f441 tempest-GroupsTest-1601700660 None] Flow 'volume_create_manager' (d2443cfd-8252-4ca0-9b75-25adbb4987e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:00:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6a888a8d-0d04-4c73-bbc3-acf86063f441 tempest-GroupsTest-1601700660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15344deb-bc36-4ee2-893f-4d7aac93181e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:20 devstack sudo[98230]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6a888a8d-0d04-4c73-bbc3-acf86063f441 tempest-GroupsTest-1601700660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15344deb-bc36-4ee2-893f-4d7aac93181e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:00:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1455315474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e4dec0ff-166d-4376-9d3d-76f7e511052b,host='devstack@QuobyteHD#QuobyteHD',id=d0107e6c-bbdb-48b6-b2e8-9afe6fd3054c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f7c03d8db4c407499be5d53fc2cb286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:00:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:00:20Z,use_quota=True,user_id='7da7945082bd4cb1a8cfcb2d37789e15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be515f1f-db4d-4616-8a35-1a372fff30d4),volume_type_id=be515f1f-db4d-4616-8a35-1a372fff30d4)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6a888a8d-0d04-4c73-bbc3-acf86063f441 tempest-GroupsTest-1601700660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f1f711e-c0b4-44c8-bcb9-9a97e9185d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6a888a8d-0d04-4c73-bbc3-acf86063f441 tempest-GroupsTest-1601700660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f1f711e-c0b4-44c8-bcb9-9a97e9185d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6a888a8d-0d04-4c73-bbc3-acf86063f441 tempest-GroupsTest-1601700660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c969456-c901-439c-acbc-0243d5681456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6a888a8d-0d04-4c73-bbc3-acf86063f441 tempest-GroupsTest-1601700660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c969456-c901-439c-acbc-0243d5681456) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0107e6c-bbdb-48b6-b2e8-9afe6fd3054c', 'volume_name': 'volume-d0107e6c-bbdb-48b6-b2e8-9afe6fd3054c', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6a888a8d-0d04-4c73-bbc3-acf86063f441 tempest-GroupsTest-1601700660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7963d3c-eea5-4ff0-ad74-778972df7d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6a888a8d-0d04-4c73-bbc3-acf86063f441 tempest-GroupsTest-1601700660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7963d3c-eea5-4ff0-ad74-778972df7d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6a888a8d-0d04-4c73-bbc3-acf86063f441 tempest-GroupsTest-1601700660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbbcba7d-f6be-43f5-9e10-0612908e8866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:20 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-6a888a8d-0d04-4c73-bbc3-acf86063f441 tempest-GroupsTest-1601700660 None] Volume d0107e6c-bbdb-48b6-b2e8-9afe6fd3054c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0107e6c-bbdb-48b6-b2e8-9afe6fd3054c', 'volume_size': 1} Sep 28 15:00:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6a888a8d-0d04-4c73-bbc3-acf86063f441 tempest-GroupsTest-1601700660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:00:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fba75af7-36f3-4897-9c49-dacb8f44ec8f tempest-VolumesServicesTestJSON-1019267259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ba21a416-3212-4582-b5b4-e7e50a7f5c77 1073741824" returned: 0 in 0.858s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fba75af7-36f3-4897-9c49-dacb8f44ec8f tempest-VolumesServicesTestJSON-1019267259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ba21a416-3212-4582-b5b4-e7e50a7f5c77 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:20 devstack sudo[98238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ba21a416-3212-4582-b5b4-e7e50a7f5c77 Sep 28 15:00:20 devstack sudo[98238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:20 devstack sudo[98238]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fba75af7-36f3-4897-9c49-dacb8f44ec8f tempest-VolumesServicesTestJSON-1019267259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ba21a416-3212-4582-b5b4-e7e50a7f5c77" returned: 0 in 0.357s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:21 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-fba75af7-36f3-4897-9c49-dacb8f44ec8f tempest-VolumesServicesTestJSON-1019267259 None] <== create_volume: return (1284ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:00:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-fba75af7-36f3-4897-9c49-dacb8f44ec8f tempest-VolumesServicesTestJSON-1019267259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.288s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:00:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6a888a8d-0d04-4c73-bbc3-acf86063f441 tempest-GroupsTest-1601700660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.425s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:00:21 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-6a888a8d-0d04-4c73-bbc3-acf86063f441 tempest-GroupsTest-1601700660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e4dec0ff-166d-4376-9d3d-76f7e511052b,created_at=2026-09-28T13:00:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1455315474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e4dec0ff-166d-4376-9d3d-76f7e511052b,host='devstack@QuobyteHD#QuobyteHD',id=d0107e6c-bbdb-48b6-b2e8-9afe6fd3054c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f7c03d8db4c407499be5d53fc2cb286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:00:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:00:20Z,use_quota=True,user_id='7da7945082bd4cb1a8cfcb2d37789e15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be515f1f-db4d-4616-8a35-1a372fff30d4),volume_type_id=be515f1f-db4d-4616-8a35-1a372fff30d4)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:00:21 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-6a888a8d-0d04-4c73-bbc3-acf86063f441 tempest-GroupsTest-1601700660 None] Creating volume d0107e6c-bbdb-48b6-b2e8-9afe6fd3054c {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:00:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6a888a8d-0d04-4c73-bbc3-acf86063f441 tempest-GroupsTest-1601700660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:00:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6a888a8d-0d04-4c73-bbc3-acf86063f441 tempest-GroupsTest-1601700660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:00:21 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-6a888a8d-0d04-4c73-bbc3-acf86063f441 tempest-GroupsTest-1601700660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:00:21 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-6a888a8d-0d04-4c73-bbc3-acf86063f441 tempest-GroupsTest-1601700660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:00:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6a888a8d-0d04-4c73-bbc3-acf86063f441 tempest-GroupsTest-1601700660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:00:21 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-6a888a8d-0d04-4c73-bbc3-acf86063f441 tempest-GroupsTest-1601700660 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:00:21 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-6a888a8d-0d04-4c73-bbc3-acf86063f441 tempest-GroupsTest-1601700660 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:00:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6a888a8d-0d04-4c73-bbc3-acf86063f441 tempest-GroupsTest-1601700660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-d0107e6c-bbdb-48b6-b2e8-9afe6fd3054c 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:21 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fba75af7-36f3-4897-9c49-dacb8f44ec8f tempest-VolumesServicesTestJSON-1019267259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d55ecdfa-5ee9-42e6-82b9-c23c47cb3bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba21a416-3212-4582-b5b4-e7e50a7f5c77', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:21 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fba75af7-36f3-4897-9c49-dacb8f44ec8f tempest-VolumesServicesTestJSON-1019267259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (871623f1-0564-4cdf-bd2b-7bbfee188052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:21 devstack sudo[98241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-d0107e6c-bbdb-48b6-b2e8-9afe6fd3054c 1073741824 Sep 28 15:00:21 devstack sudo[98241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:21 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-fba75af7-36f3-4897-9c49-dacb8f44ec8f tempest-VolumesServicesTestJSON-1019267259 None] Volume volume-ba21a416-3212-4582-b5b4-e7e50a7f5c77 (ba21a416-3212-4582-b5b4-e7e50a7f5c77): created successfully Sep 28 15:00:21 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fba75af7-36f3-4897-9c49-dacb8f44ec8f tempest-VolumesServicesTestJSON-1019267259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (871623f1-0564-4cdf-bd2b-7bbfee188052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:21 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fba75af7-36f3-4897-9c49-dacb8f44ec8f tempest-VolumesServicesTestJSON-1019267259 None] Flow 'volume_create_manager' (b2536ca9-3499-4a7e-b163-df65393273e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:00:21 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-fba75af7-36f3-4897-9c49-dacb8f44ec8f tempest-VolumesServicesTestJSON-1019267259 None] Created volume successfully. Sep 28 15:00:21 devstack sudo[98241]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6a888a8d-0d04-4c73-bbc3-acf86063f441 tempest-GroupsTest-1601700660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-d0107e6c-bbdb-48b6-b2e8-9afe6fd3054c 1073741824" returned: 0 in 0.949s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6a888a8d-0d04-4c73-bbc3-acf86063f441 tempest-GroupsTest-1601700660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-d0107e6c-bbdb-48b6-b2e8-9afe6fd3054c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:22 devstack sudo[98296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-d0107e6c-bbdb-48b6-b2e8-9afe6fd3054c Sep 28 15:00:22 devstack sudo[98296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:22 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9170c2c6-ff3c-46c3-8c42-eb846bfc8d6f tempest-VolumesServicesTestJSON-1019267259 None] Acquiring lock "cinder-ba21a416-3212-4582-b5b4-e7e50a7f5c77-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:00:22 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-b19c4930-a066-4777-98bd-e6ac19effc9e req-f3d9f600-5531-4ad2-afdd-32842e55b0f0 tempest-AttachVolumeNegativeTest-950462997 None] Terminate volume connection completed successfully. Sep 28 15:00:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-b19c4930-a066-4777-98bd-e6ac19effc9e req-f3d9f600-5531-4ad2-afdd-32842e55b0f0 tempest-AttachVolumeNegativeTest-950462997 None] Deleting attachment 59580b1c-fc3d-4262-9052-8d8f66107bea. {{(pid=87116) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:00:22 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9170c2c6-ff3c-46c3-8c42-eb846bfc8d6f tempest-VolumesServicesTestJSON-1019267259 None] Lock "cinder-ba21a416-3212-4582-b5b4-e7e50a7f5c77-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:00:22 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9170c2c6-ff3c-46c3-8c42-eb846bfc8d6f tempest-VolumesServicesTestJSON-1019267259 None] Acquiring lock "cinder-quobyte-ba21a416-3212-4582-b5b4-e7e50a7f5c77" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:00:22 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9170c2c6-ff3c-46c3-8c42-eb846bfc8d6f tempest-VolumesServicesTestJSON-1019267259 None] Lock "cinder-quobyte-ba21a416-3212-4582-b5b4-e7e50a7f5c77" acquired by "delete_volume" :: waited 0.033s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:00:22 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[06124a8f-a615-4a5f-abe0-6ee29721f579]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:00:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9170c2c6-ff3c-46c3-8c42-eb846bfc8d6f tempest-VolumesServicesTestJSON-1019267259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ba21a416-3212-4582-b5b4-e7e50a7f5c77 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:22 devstack sudo[98308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ba21a416-3212-4582-b5b4-e7e50a7f5c77 Sep 28 15:00:22 devstack sudo[98308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:22 devstack sudo[98296]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6a888a8d-0d04-4c73-bbc3-acf86063f441 tempest-GroupsTest-1601700660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-d0107e6c-bbdb-48b6-b2e8-9afe6fd3054c" returned: 0 in 0.715s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:22 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-6a888a8d-0d04-4c73-bbc3-acf86063f441 tempest-GroupsTest-1601700660 None] <== create_volume: return (1793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:00:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6a888a8d-0d04-4c73-bbc3-acf86063f441 tempest-GroupsTest-1601700660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.797s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:00:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6a888a8d-0d04-4c73-bbc3-acf86063f441 tempest-GroupsTest-1601700660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbbcba7d-f6be-43f5-9e10-0612908e8866) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0107e6c-bbdb-48b6-b2e8-9afe6fd3054c', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6a888a8d-0d04-4c73-bbc3-acf86063f441 tempest-GroupsTest-1601700660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (607fd57d-d4b5-4e6f-a3fe-f8e4ebfcc802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:22 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-6a888a8d-0d04-4c73-bbc3-acf86063f441 tempest-GroupsTest-1601700660 None] Volume volume-d0107e6c-bbdb-48b6-b2e8-9afe6fd3054c (d0107e6c-bbdb-48b6-b2e8-9afe6fd3054c): created successfully Sep 28 15:00:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6a888a8d-0d04-4c73-bbc3-acf86063f441 tempest-GroupsTest-1601700660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (607fd57d-d4b5-4e6f-a3fe-f8e4ebfcc802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6a888a8d-0d04-4c73-bbc3-acf86063f441 tempest-GroupsTest-1601700660 None] Flow 'volume_create_manager' (d2443cfd-8252-4ca0-9b75-25adbb4987e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:00:22 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-6a888a8d-0d04-4c73-bbc3-acf86063f441 tempest-GroupsTest-1601700660 None] Created volume successfully. Sep 28 15:00:23 devstack sudo[98308]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9170c2c6-ff3c-46c3-8c42-eb846bfc8d6f tempest-VolumesServicesTestJSON-1019267259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ba21a416-3212-4582-b5b4-e7e50a7f5c77" returned: 0 in 0.565s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9170c2c6-ff3c-46c3-8c42-eb846bfc8d6f tempest-VolumesServicesTestJSON-1019267259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ba21a416-3212-4582-b5b4-e7e50a7f5c77 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:23 devstack sudo[98327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ba21a416-3212-4582-b5b4-e7e50a7f5c77 Sep 28 15:00:23 devstack sudo[98327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:23 devstack sudo[98327]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9170c2c6-ff3c-46c3-8c42-eb846bfc8d6f tempest-VolumesServicesTestJSON-1019267259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ba21a416-3212-4582-b5b4-e7e50a7f5c77" returned: 0 in 0.302s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:23 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9170c2c6-ff3c-46c3-8c42-eb846bfc8d6f tempest-VolumesServicesTestJSON-1019267259 None] Lock "cinder-quobyte-ba21a416-3212-4582-b5b4-e7e50a7f5c77" released by "delete_volume" :: held 1.001s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:00:23 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-9170c2c6-ff3c-46c3-8c42-eb846bfc8d6f tempest-VolumesServicesTestJSON-1019267259 None] Created reservations ['840c12df-3da2-4c7b-bfb1-cc7607a769b4', '0b4fbf44-e329-4c33-b66b-1180af1f1933', '3ebeb573-6018-4386-a76e-f2d6074a3486', 'b367fc0d-29a2-4c5a-8510-af963482943c'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:00:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9170c2c6-ff3c-46c3-8c42-eb846bfc8d6f tempest-VolumesServicesTestJSON-1019267259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:00:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9170c2c6-ff3c-46c3-8c42-eb846bfc8d6f tempest-VolumesServicesTestJSON-1019267259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:00:23 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9170c2c6-ff3c-46c3-8c42-eb846bfc8d6f tempest-VolumesServicesTestJSON-1019267259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:00:23 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9170c2c6-ff3c-46c3-8c42-eb846bfc8d6f tempest-VolumesServicesTestJSON-1019267259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:00:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9170c2c6-ff3c-46c3-8c42-eb846bfc8d6f tempest-VolumesServicesTestJSON-1019267259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:00:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9170c2c6-ff3c-46c3-8c42-eb846bfc8d6f tempest-VolumesServicesTestJSON-1019267259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:23 devstack sudo[98345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:00:23 devstack sudo[98345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:24 devstack sudo[98345]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9170c2c6-ff3c-46c3-8c42-eb846bfc8d6f tempest-VolumesServicesTestJSON-1019267259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.507s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:24 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-9170c2c6-ff3c-46c3-8c42-eb846bfc8d6f tempest-VolumesServicesTestJSON-1019267259 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:00:24 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-9170c2c6-ff3c-46c3-8c42-eb846bfc8d6f tempest-VolumesServicesTestJSON-1019267259 None] Deleted volume successfully. Sep 28 15:00:24 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9170c2c6-ff3c-46c3-8c42-eb846bfc8d6f tempest-VolumesServicesTestJSON-1019267259 None] Lock "cinder-ba21a416-3212-4582-b5b4-e7e50a7f5c77-delete_volume" released by "delete_volume" :: held 1.933s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:00:25 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-d81d092a-4db2-403c-9770-4d7ba915b472 tempest-GroupsTest-1601700660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:00:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d81d092a-4db2-403c-9770-4d7ba915b472 tempest-GroupsTest-1601700660 None] Flow 'volume_create_manager' (5da49613-dbab-4f0e-88a7-845d770831b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:00:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d81d092a-4db2-403c-9770-4d7ba915b472 tempest-GroupsTest-1601700660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b294893-e38a-4508-9ff6-9be5608541e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d81d092a-4db2-403c-9770-4d7ba915b472 tempest-GroupsTest-1601700660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b294893-e38a-4508-9ff6-9be5608541e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-327028985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e4dec0ff-166d-4376-9d3d-76f7e511052b,host='devstack@QuobyteHD#QuobyteHD',id=14842b27-882a-4665-82ee-c3992eeef6fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f7c03d8db4c407499be5d53fc2cb286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:00:26Z,use_quota=True,user_id='7da7945082bd4cb1a8cfcb2d37789e15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be515f1f-db4d-4616-8a35-1a372fff30d4),volume_type_id=be515f1f-db4d-4616-8a35-1a372fff30d4)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d81d092a-4db2-403c-9770-4d7ba915b472 tempest-GroupsTest-1601700660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (982d1810-d349-4ee3-b6ce-98287f2adaed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d81d092a-4db2-403c-9770-4d7ba915b472 tempest-GroupsTest-1601700660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (982d1810-d349-4ee3-b6ce-98287f2adaed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d81d092a-4db2-403c-9770-4d7ba915b472 tempest-GroupsTest-1601700660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f6dc0f2-22a9-46c7-946d-1507b48499e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d81d092a-4db2-403c-9770-4d7ba915b472 tempest-GroupsTest-1601700660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f6dc0f2-22a9-46c7-946d-1507b48499e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14842b27-882a-4665-82ee-c3992eeef6fa', 'volume_name': 'volume-14842b27-882a-4665-82ee-c3992eeef6fa', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d81d092a-4db2-403c-9770-4d7ba915b472 tempest-GroupsTest-1601700660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed5a48d2-b335-45b7-98bb-d7485a208f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d81d092a-4db2-403c-9770-4d7ba915b472 tempest-GroupsTest-1601700660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed5a48d2-b335-45b7-98bb-d7485a208f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d81d092a-4db2-403c-9770-4d7ba915b472 tempest-GroupsTest-1601700660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c89fec0-4559-42a9-9527-5236559b85b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:25 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-d81d092a-4db2-403c-9770-4d7ba915b472 tempest-GroupsTest-1601700660 None] Volume 14842b27-882a-4665-82ee-c3992eeef6fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14842b27-882a-4665-82ee-c3992eeef6fa', 'volume_size': 1} Sep 28 15:00:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d81d092a-4db2-403c-9770-4d7ba915b472 tempest-GroupsTest-1601700660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:00:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d81d092a-4db2-403c-9770-4d7ba915b472 tempest-GroupsTest-1601700660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:00:25 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d81d092a-4db2-403c-9770-4d7ba915b472 tempest-GroupsTest-1601700660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e4dec0ff-166d-4376-9d3d-76f7e511052b,created_at=2026-09-28T13:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-327028985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e4dec0ff-166d-4376-9d3d-76f7e511052b,host='devstack@QuobyteHD#QuobyteHD',id=14842b27-882a-4665-82ee-c3992eeef6fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f7c03d8db4c407499be5d53fc2cb286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:00:26Z,use_quota=True,user_id='7da7945082bd4cb1a8cfcb2d37789e15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be515f1f-db4d-4616-8a35-1a372fff30d4),volume_type_id=be515f1f-db4d-4616-8a35-1a372fff30d4)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:00:25 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-d81d092a-4db2-403c-9770-4d7ba915b472 tempest-GroupsTest-1601700660 None] Creating volume 14842b27-882a-4665-82ee-c3992eeef6fa {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:00:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d81d092a-4db2-403c-9770-4d7ba915b472 tempest-GroupsTest-1601700660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:00:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d81d092a-4db2-403c-9770-4d7ba915b472 tempest-GroupsTest-1601700660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:00:25 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d81d092a-4db2-403c-9770-4d7ba915b472 tempest-GroupsTest-1601700660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:00:25 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d81d092a-4db2-403c-9770-4d7ba915b472 tempest-GroupsTest-1601700660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:00:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d81d092a-4db2-403c-9770-4d7ba915b472 tempest-GroupsTest-1601700660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:00:25 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d81d092a-4db2-403c-9770-4d7ba915b472 tempest-GroupsTest-1601700660 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:00:25 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-d81d092a-4db2-403c-9770-4d7ba915b472 tempest-GroupsTest-1601700660 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:00:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d81d092a-4db2-403c-9770-4d7ba915b472 tempest-GroupsTest-1601700660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-14842b27-882a-4665-82ee-c3992eeef6fa 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:25 devstack sudo[98375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-14842b27-882a-4665-82ee-c3992eeef6fa 1073741824 Sep 28 15:00:25 devstack sudo[98375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5325bf03-84dc-4059-9ecc-a28c430d7781 tempest-VolumesActionsTest-1427483947 None] Acquiring lock "cinder-bc09b466-fa90-4f3b-9dc9-b0edd019087e" by "attach_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:00:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5325bf03-84dc-4059-9ecc-a28c430d7781 tempest-VolumesActionsTest-1427483947 None] Lock "cinder-bc09b466-fa90-4f3b-9dc9-b0edd019087e" acquired by "attach_volume" :: waited 0.042s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:00:26 devstack sudo[98375]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d81d092a-4db2-403c-9770-4d7ba915b472 tempest-GroupsTest-1601700660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-14842b27-882a-4665-82ee-c3992eeef6fa 1073741824" returned: 0 in 0.806s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d81d092a-4db2-403c-9770-4d7ba915b472 tempest-GroupsTest-1601700660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-14842b27-882a-4665-82ee-c3992eeef6fa {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:26 devstack sudo[98383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-14842b27-882a-4665-82ee-c3992eeef6fa Sep 28 15:00:26 devstack sudo[98383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:26 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-5325bf03-84dc-4059-9ecc-a28c430d7781 tempest-VolumesActionsTest-1427483947 None] Attaching volume bc09b466-fa90-4f3b-9dc9-b0edd019087e to instance b4e739a9-58f4-4f7d-8abb-a129a702e41e at mountpoint /dev/vdb on host None. Sep 28 15:00:27 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-5325bf03-84dc-4059-9ecc-a28c430d7781 tempest-VolumesActionsTest-1427483947 None] Attach volume completed successfully. Sep 28 15:00:27 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5325bf03-84dc-4059-9ecc-a28c430d7781 tempest-VolumesActionsTest-1427483947 None] Lock "cinder-bc09b466-fa90-4f3b-9dc9-b0edd019087e" released by "attach_volume" :: held 0.471s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:00:27 devstack sudo[98383]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d81d092a-4db2-403c-9770-4d7ba915b472 tempest-GroupsTest-1601700660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-14842b27-882a-4665-82ee-c3992eeef6fa" returned: 0 in 0.505s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d81d092a-4db2-403c-9770-4d7ba915b472 tempest-GroupsTest-1601700660 None] <== create_volume: return (1414ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:00:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d81d092a-4db2-403c-9770-4d7ba915b472 tempest-GroupsTest-1601700660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.417s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:00:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d81d092a-4db2-403c-9770-4d7ba915b472 tempest-GroupsTest-1601700660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c89fec0-4559-42a9-9527-5236559b85b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14842b27-882a-4665-82ee-c3992eeef6fa', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d81d092a-4db2-403c-9770-4d7ba915b472 tempest-GroupsTest-1601700660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ea16f4f-9a5c-473a-ac82-091bd9d95bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:27 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-d81d092a-4db2-403c-9770-4d7ba915b472 tempest-GroupsTest-1601700660 None] Volume volume-14842b27-882a-4665-82ee-c3992eeef6fa (14842b27-882a-4665-82ee-c3992eeef6fa): created successfully Sep 28 15:00:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d81d092a-4db2-403c-9770-4d7ba915b472 tempest-GroupsTest-1601700660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ea16f4f-9a5c-473a-ac82-091bd9d95bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d81d092a-4db2-403c-9770-4d7ba915b472 tempest-GroupsTest-1601700660 None] Flow 'volume_create_manager' (5da49613-dbab-4f0e-88a7-845d770831b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:00:27 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-d81d092a-4db2-403c-9770-4d7ba915b472 tempest-GroupsTest-1601700660 None] Created volume successfully. Sep 28 15:00:27 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-33490c23-e008-49b4-9c5c-5543d4ce8270 tempest-VolumesActionsTest-1427483947 None] Acquiring lock "cinder-bc09b466-fa90-4f3b-9dc9-b0edd019087e-detach_volume" by "detach_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:00:28 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-33490c23-e008-49b4-9c5c-5543d4ce8270 tempest-VolumesActionsTest-1427483947 None] Lock "cinder-bc09b466-fa90-4f3b-9dc9-b0edd019087e-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:00:28 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-33490c23-e008-49b4-9c5c-5543d4ce8270 tempest-VolumesActionsTest-1427483947 None] Detaching volume bc09b466-fa90-4f3b-9dc9-b0edd019087e from instance b4e739a9-58f4-4f7d-8abb-a129a702e41e. Sep 28 15:00:28 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-33490c23-e008-49b4-9c5c-5543d4ce8270 tempest-VolumesActionsTest-1427483947 None] Detach volume completed successfully. Sep 28 15:00:28 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-33490c23-e008-49b4-9c5c-5543d4ce8270 tempest-VolumesActionsTest-1427483947 None] Lock "cinder-bc09b466-fa90-4f3b-9dc9-b0edd019087e-detach_volume" released by "detach_volume" :: held 0.107s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:00:29 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-9980df70-b892-487f-9c5a-baa5b82f5cfc tempest-GroupsTest-1601700660 None] Update group completed successfully. Sep 28 15:00:30 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-6a9e9882-3930-4eb6-a886-895017bdfc20 tempest-GroupsTest-1601700660 None] Update group completed successfully. Sep 28 15:00:32 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e6ec7d10-c5f0-4a35-81ce-9279297e07bf tempest-GroupsTest-1601700660 None] Acquiring lock "cinder-quobyte-14842b27-882a-4665-82ee-c3992eeef6fa" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:00:32 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e6ec7d10-c5f0-4a35-81ce-9279297e07bf tempest-GroupsTest-1601700660 None] Lock "cinder-quobyte-14842b27-882a-4665-82ee-c3992eeef6fa" acquired by "delete_volume" :: waited 0.022s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:00:32 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5284932-1029-426a-93f6-e22d99ad8fe7]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:00:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e6ec7d10-c5f0-4a35-81ce-9279297e07bf tempest-GroupsTest-1601700660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-14842b27-882a-4665-82ee-c3992eeef6fa {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:32 devstack sudo[98459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-14842b27-882a-4665-82ee-c3992eeef6fa Sep 28 15:00:32 devstack sudo[98459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:33 devstack sudo[98459]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e6ec7d10-c5f0-4a35-81ce-9279297e07bf tempest-GroupsTest-1601700660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-14842b27-882a-4665-82ee-c3992eeef6fa" returned: 0 in 0.664s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e6ec7d10-c5f0-4a35-81ce-9279297e07bf tempest-GroupsTest-1601700660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-14842b27-882a-4665-82ee-c3992eeef6fa {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:33 devstack sudo[98464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-14842b27-882a-4665-82ee-c3992eeef6fa Sep 28 15:00:33 devstack sudo[98464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:33 devstack sudo[98464]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e6ec7d10-c5f0-4a35-81ce-9279297e07bf tempest-GroupsTest-1601700660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-14842b27-882a-4665-82ee-c3992eeef6fa" returned: 0 in 0.351s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e6ec7d10-c5f0-4a35-81ce-9279297e07bf tempest-GroupsTest-1601700660 None] Lock "cinder-quobyte-14842b27-882a-4665-82ee-c3992eeef6fa" released by "delete_volume" :: held 1.089s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:00:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e6ec7d10-c5f0-4a35-81ce-9279297e07bf tempest-GroupsTest-1601700660 None] Acquiring lock "cinder-quobyte-d0107e6c-bbdb-48b6-b2e8-9afe6fd3054c" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:00:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e6ec7d10-c5f0-4a35-81ce-9279297e07bf tempest-GroupsTest-1601700660 None] Lock "cinder-quobyte-d0107e6c-bbdb-48b6-b2e8-9afe6fd3054c" acquired by "delete_volume" :: waited 0.033s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:00:33 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb149af-86ca-4cec-a3fe-ee41edc3fd84]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:00:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e6ec7d10-c5f0-4a35-81ce-9279297e07bf tempest-GroupsTest-1601700660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-d0107e6c-bbdb-48b6-b2e8-9afe6fd3054c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:33 devstack sudo[98467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-d0107e6c-bbdb-48b6-b2e8-9afe6fd3054c Sep 28 15:00:33 devstack sudo[98467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:34 devstack sudo[98467]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e6ec7d10-c5f0-4a35-81ce-9279297e07bf tempest-GroupsTest-1601700660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-d0107e6c-bbdb-48b6-b2e8-9afe6fd3054c" returned: 0 in 0.493s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e6ec7d10-c5f0-4a35-81ce-9279297e07bf tempest-GroupsTest-1601700660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-d0107e6c-bbdb-48b6-b2e8-9afe6fd3054c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:34 devstack sudo[98472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-d0107e6c-bbdb-48b6-b2e8-9afe6fd3054c Sep 28 15:00:34 devstack sudo[98472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:34 devstack sudo[98472]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e6ec7d10-c5f0-4a35-81ce-9279297e07bf tempest-GroupsTest-1601700660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-d0107e6c-bbdb-48b6-b2e8-9afe6fd3054c" returned: 0 in 0.360s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:34 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e6ec7d10-c5f0-4a35-81ce-9279297e07bf tempest-GroupsTest-1601700660 None] Lock "cinder-quobyte-d0107e6c-bbdb-48b6-b2e8-9afe6fd3054c" released by "delete_volume" :: held 0.935s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:00:34 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-e6ec7d10-c5f0-4a35-81ce-9279297e07bf tempest-GroupsTest-1601700660 None] Created reservations ['49320828-3ac3-4be6-a042-0a55edbb8c4d'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:00:34 devstack cinder-volume[87116]: WARNING cinder.quota [None req-e6ec7d10-c5f0-4a35-81ce-9279297e07bf tempest-GroupsTest-1601700660 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1688493739 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1688493739, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:00:34 devstack cinder-volume[87116]: WARNING cinder.quota [None req-e6ec7d10-c5f0-4a35-81ce-9279297e07bf tempest-GroupsTest-1601700660 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1688493739 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1688493739, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:00:34 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-e6ec7d10-c5f0-4a35-81ce-9279297e07bf tempest-GroupsTest-1601700660 None] Created reservations ['396dc564-77f7-48e9-8d9a-03cb0b82ba07', '8a5dfa69-b7b9-4442-a06a-69606d6c1ec4', '38d34e1c-d270-45e5-8b1d-4f7413a176c4', 'cbe9b112-f24d-449f-8592-e90362da8bc9'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:00:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1bb63723-4e18-4a4a-b00a-8fb8e63785ca tempest-VolumesActionsTest-1427483947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:00:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1bb63723-4e18-4a4a-b00a-8fb8e63785ca tempest-VolumesActionsTest-1427483947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:00:35 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ed24c5-73ea-4df4-821d-c3617413ca38]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:00:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1bb63723-4e18-4a4a-b00a-8fb8e63785ca tempest-VolumesActionsTest-1427483947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bc09b466-fa90-4f3b-9dc9-b0edd019087e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:35 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-e6ec7d10-c5f0-4a35-81ce-9279297e07bf tempest-GroupsTest-1601700660 None] Created reservations ['fd90cc59-00cf-4b83-8a8a-3c0974606e0c', 'b930a3e0-50da-49a6-ab5f-300710bf3523', '3d036aee-b481-4949-be24-4975bd462de7', '93a30699-4b12-45a9-b83c-c1fb4356ee12'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:00:35 devstack sudo[98475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bc09b466-fa90-4f3b-9dc9-b0edd019087e Sep 28 15:00:35 devstack sudo[98475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e6ec7d10-c5f0-4a35-81ce-9279297e07bf tempest-GroupsTest-1601700660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:00:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e6ec7d10-c5f0-4a35-81ce-9279297e07bf tempest-GroupsTest-1601700660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:00:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e6ec7d10-c5f0-4a35-81ce-9279297e07bf tempest-GroupsTest-1601700660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:00:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e6ec7d10-c5f0-4a35-81ce-9279297e07bf tempest-GroupsTest-1601700660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:00:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e6ec7d10-c5f0-4a35-81ce-9279297e07bf tempest-GroupsTest-1601700660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:00:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e6ec7d10-c5f0-4a35-81ce-9279297e07bf tempest-GroupsTest-1601700660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:35 devstack sudo[98477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:00:35 devstack sudo[98477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:35 devstack sudo[98475]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1bb63723-4e18-4a4a-b00a-8fb8e63785ca tempest-VolumesActionsTest-1427483947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bc09b466-fa90-4f3b-9dc9-b0edd019087e" returned: 0 in 0.606s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:35 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19b6c89-c42c-4173-b6db-d2fd1ccbacde]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:00:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1bb63723-4e18-4a4a-b00a-8fb8e63785ca tempest-VolumesActionsTest-1427483947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bc09b466-fa90-4f3b-9dc9-b0edd019087e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:35 devstack sudo[98477]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e6ec7d10-c5f0-4a35-81ce-9279297e07bf tempest-GroupsTest-1601700660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.382s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:35 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-e6ec7d10-c5f0-4a35-81ce-9279297e07bf tempest-GroupsTest-1601700660 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:00:35 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-e6ec7d10-c5f0-4a35-81ce-9279297e07bf tempest-GroupsTest-1601700660 None] Delete group completed successfully. Sep 28 15:00:35 devstack sudo[98483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bc09b466-fa90-4f3b-9dc9-b0edd019087e Sep 28 15:00:35 devstack sudo[98483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:36 devstack sudo[98483]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1bb63723-4e18-4a4a-b00a-8fb8e63785ca tempest-VolumesActionsTest-1427483947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bc09b466-fa90-4f3b-9dc9-b0edd019087e" returned: 0 in 0.607s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1bb63723-4e18-4a4a-b00a-8fb8e63785ca tempest-VolumesActionsTest-1427483947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bc09b466-fa90-4f3b-9dc9-b0edd019087e /opt/stack/data/cinder/conversion/bc09b466-fa90-4f3b-9dc9-b0edd019087e.temp_image.8edd4f2a-37af-4942-9281-a92778797e26k3vkux2o.img {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:36 devstack sudo[98491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bc09b466-fa90-4f3b-9dc9-b0edd019087e /opt/stack/data/cinder/conversion/bc09b466-fa90-4f3b-9dc9-b0edd019087e.temp_image.8edd4f2a-37af-4942-9281-a92778797e26k3vkux2o.img Sep 28 15:00:36 devstack sudo[98491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:45 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:00:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] Flow 'volume_create_manager' (25a9b15d-5849-488c-aa51-1e0fc9281c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:00:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98d9cbd5-7ad4-40a2-b440-78e13b812613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98d9cbd5-7ad4-40a2-b440-78e13b812613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:00:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-722779315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=741c293c-ab9e-4ed2-9d11-d58c6d5a4495,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a22b969bd1f4ef5b381e5734df50067',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:00:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:00:45Z,use_quota=True,user_id='f0f5f20866d34821995a5e7942b96d72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c569f79-a259-4cf0-965e-38aa62ff39f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c569f79-a259-4cf0-965e-38aa62ff39f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c732a1cc-e48d-4d28-b432-a1d9171a16c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:45 devstack cinder-volume[87116]: DEBUG cinder.image.glance [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] Creating Keystone auth plugin from conf {{(pid=87116) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 15:00:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c732a1cc-e48d-4d28-b432-a1d9171a16c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '741c293c-ab9e-4ed2-9d11-d58c6d5a4495', 'volume_name': 'volume-741c293c-ab9e-4ed2-9d11-d58c6d5a4495', 'volume_size': 1, 'image_id': '660a4fad-84c6-40b7-a594-44d16c0701ee', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/660a4fad-84c6-40b7-a594-44d16c0701ee', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca088c9271854d40ba6017d33affee18', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '660a4fad-84c6-40b7-a594-44d16c0701ee', 'created_at': datetime.datetime(2026, 9, 28, 12, 47, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 47, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/660a4fad-84c6-40b7-a594-44d16c0701ee/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce12887a-a5e9-4d31-99e2-f3f273bab0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce12887a-a5e9-4d31-99e2-f3f273bab0d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (201a7086-c53a-4e8a-a458-e6f2f78b10e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:46 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] Volume 741c293c-ab9e-4ed2-9d11-d58c6d5a4495: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-741c293c-ab9e-4ed2-9d11-d58c6d5a4495', 'volume_size': 1, 'image_id': '660a4fad-84c6-40b7-a594-44d16c0701ee', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/660a4fad-84c6-40b7-a594-44d16c0701ee', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca088c9271854d40ba6017d33affee18', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '660a4fad-84c6-40b7-a594-44d16c0701ee', 'created_at': datetime.datetime(2026, 9, 28, 12, 47, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 47, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/660a4fad-84c6-40b7-a594-44d16c0701ee/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 15:00:46 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] Trying to clone 741c293c-ab9e-4ed2-9d11-d58c6d5a4495 from image 660a4fad-84c6-40b7-a594-44d16c0701ee at location (None, [{'url': 'file:///opt/stack/data/glance/images/660a4fad-84c6-40b7-a594-44d16c0701ee', 'metadata': {}}]). {{(pid=87116) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 15:00:47 devstack sudo[98491]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1bb63723-4e18-4a4a-b00a-8fb8e63785ca tempest-VolumesActionsTest-1427483947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bc09b466-fa90-4f3b-9dc9-b0edd019087e /opt/stack/data/cinder/conversion/bc09b466-fa90-4f3b-9dc9-b0edd019087e.temp_image.8edd4f2a-37af-4942-9281-a92778797e26k3vkux2o.img" returned: 0 in 10.953s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:47 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d58873f-9765-4675-88f8-05287df9f7cb]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:00:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1bb63723-4e18-4a4a-b00a-8fb8e63785ca tempest-VolumesActionsTest-1427483947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bc09b466-fa90-4f3b-9dc9-b0edd019087e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:47 devstack sudo[98552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bc09b466-fa90-4f3b-9dc9-b0edd019087e Sep 28 15:00:47 devstack sudo[98552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:47 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_2zaid5s0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87116) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 15:00:47 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] Image download 20.69 MB at 20.69 MB/s Sep 28 15:00:47 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0177bc-6d89-426b-920c-c8634e1fb622]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:00:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_2zaid5s0devstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:48 devstack sudo[98575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_2zaid5s0devstack@QuobyteHD Sep 28 15:00:48 devstack sudo[98575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:48 devstack sudo[98552]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1bb63723-4e18-4a4a-b00a-8fb8e63785ca tempest-VolumesActionsTest-1427483947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bc09b466-fa90-4f3b-9dc9-b0edd019087e" returned: 0 in 1.307s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:48 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-1bb63723-4e18-4a4a-b00a-8fb8e63785ca tempest-VolumesActionsTest-1427483947 None] Image conversion details: src /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bc09b466-fa90-4f3b-9dc9-b0edd019087e, size 1024.00 MB, duration 10.96 sec, destination /opt/stack/data/cinder/conversion/bc09b466-fa90-4f3b-9dc9-b0edd019087e.temp_image.8edd4f2a-37af-4942-9281-a92778797e26k3vkux2o.img {{(pid=87116) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:00:48 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-1bb63723-4e18-4a4a-b00a-8fb8e63785ca tempest-VolumesActionsTest-1427483947 None] Converted 1024.00 MB image at 93.46 MB/s Sep 28 15:00:48 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-1bb63723-4e18-4a4a-b00a-8fb8e63785ca tempest-VolumesActionsTest-1427483947 None] 8edd4f2a-37af-4942-9281-a92778797e26 was raw, no need to convert to raw {{(pid=87116) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 28 15:00:48 devstack sudo[98575]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_2zaid5s0devstack@QuobyteHD" returned: 0 in 0.756s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:48 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] Temporary image 660a4fad-84c6-40b7-a594-44d16c0701ee is fetched for user f0f5f20866d34821995a5e7942b96d72. {{(pid=87116) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 15:00:48 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[119752de-24a9-4660-bb08-bc02e9861b20]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:00:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_2zaid5s0devstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:49 devstack sudo[98614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_2zaid5s0devstack@QuobyteHD Sep 28 15:00:49 devstack sudo[98614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:49 devstack sudo[98614]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_2zaid5s0devstack@QuobyteHD" returned: 0 in 0.577s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:00:58 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:UPDATE=93,cinder:SELECT=80,cinder:DELETE=7,cinder:INSERT=16 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:00:58 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=84,cinder:UPDATE=83,cinder:INSERT=23,cinder:DELETE=3 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:01:15 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a97d197-62f1-4e59-9e0c-a7eba69cdc53 tempest-AttachVolumeNegativeTest-950462997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:01:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2a97d197-62f1-4e59-9e0c-a7eba69cdc53 tempest-AttachVolumeNegativeTest-950462997 None] Flow 'volume_create_manager' (f5bb259c-7644-4a46-aa80-3f005ff549ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:01:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2a97d197-62f1-4e59-9e0c-a7eba69cdc53 tempest-AttachVolumeNegativeTest-950462997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e6cac1c-b562-412b-a853-710bdaa4bc6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2a97d197-62f1-4e59-9e0c-a7eba69cdc53 tempest-AttachVolumeNegativeTest-950462997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e6cac1c-b562-412b-a853-710bdaa4bc6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-607689502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3262b077-bb66-4ab4-b9cc-b289865fbdc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='482d3ae3d4794286b2a5140f95848307',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:01:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:01:15Z,use_quota=True,user_id='36e88df4624545bdaee4b33104bd6cc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2a97d197-62f1-4e59-9e0c-a7eba69cdc53 tempest-AttachVolumeNegativeTest-950462997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98fcfbd0-5e3c-49f3-959c-2e169a9e3b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2a97d197-62f1-4e59-9e0c-a7eba69cdc53 tempest-AttachVolumeNegativeTest-950462997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98fcfbd0-5e3c-49f3-959c-2e169a9e3b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2a97d197-62f1-4e59-9e0c-a7eba69cdc53 tempest-AttachVolumeNegativeTest-950462997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (124b1a5e-4d0b-4ffb-8758-5dd2f843ec2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2a97d197-62f1-4e59-9e0c-a7eba69cdc53 tempest-AttachVolumeNegativeTest-950462997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (124b1a5e-4d0b-4ffb-8758-5dd2f843ec2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3262b077-bb66-4ab4-b9cc-b289865fbdc1', 'volume_name': 'volume-3262b077-bb66-4ab4-b9cc-b289865fbdc1', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2a97d197-62f1-4e59-9e0c-a7eba69cdc53 tempest-AttachVolumeNegativeTest-950462997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15690826-0b72-408e-908b-07cb3f9c7284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2a97d197-62f1-4e59-9e0c-a7eba69cdc53 tempest-AttachVolumeNegativeTest-950462997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15690826-0b72-408e-908b-07cb3f9c7284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2a97d197-62f1-4e59-9e0c-a7eba69cdc53 tempest-AttachVolumeNegativeTest-950462997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3428ed66-252a-4344-8f62-5bb6c67b2b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:15 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-2a97d197-62f1-4e59-9e0c-a7eba69cdc53 tempest-AttachVolumeNegativeTest-950462997 None] Volume 3262b077-bb66-4ab4-b9cc-b289865fbdc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3262b077-bb66-4ab4-b9cc-b289865fbdc1', 'volume_size': 1} Sep 28 15:01:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2a97d197-62f1-4e59-9e0c-a7eba69cdc53 tempest-AttachVolumeNegativeTest-950462997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:16 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:01:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:16 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:01:16 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:01:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:17 devstack sudo[98663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:01:17 devstack sudo[98663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1bb63723-4e18-4a4a-b00a-8fb8e63785ca tempest-VolumesActionsTest-1427483947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 42.153s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1bb63723-4e18-4a4a-b00a-8fb8e63785ca tempest-VolumesActionsTest-1427483947 None] Uploaded volume to glance image-id: 8edd4f2a-37af-4942-9281-a92778797e26. {{(pid=87116) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 15:01:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 27.748s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:00:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-722779315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=741c293c-ab9e-4ed2-9d11-d58c6d5a4495,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a22b969bd1f4ef5b381e5734df50067',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:00:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:00:45Z,use_quota=True,user_id='f0f5f20866d34821995a5e7942b96d72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:01:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] Creating volume 741c293c-ab9e-4ed2-9d11-d58c6d5a4495 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:01:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:01:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:01:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:01:17 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:01:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-741c293c-ab9e-4ed2-9d11-d58c6d5a4495 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:17 devstack sudo[98665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-741c293c-ab9e-4ed2-9d11-d58c6d5a4495 1073741824 Sep 28 15:01:17 devstack sudo[98665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:17 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-1bb63723-4e18-4a4a-b00a-8fb8e63785ca tempest-VolumesActionsTest-1427483947 None] Copy volume to image completed successfully. Sep 28 15:01:17 devstack sudo[98663]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.292s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:17 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:01:17 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running periodic task VolumeManager._thread_info {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:01:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] thread count: 28 {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:01:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] thread info: [<_MainThread(MainThread, started 135146735652992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:01:17 devstack sudo[98665]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-741c293c-ab9e-4ed2-9d11-d58c6d5a4495 1073741824" returned: 0 in 0.557s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-741c293c-ab9e-4ed2-9d11-d58c6d5a4495 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:17 devstack sudo[98672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-741c293c-ab9e-4ed2-9d11-d58c6d5a4495 Sep 28 15:01:17 devstack sudo[98672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:18 devstack sudo[98672]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-741c293c-ab9e-4ed2-9d11-d58c6d5a4495" returned: 0 in 0.306s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:01:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2a97d197-62f1-4e59-9e0c-a7eba69cdc53 tempest-AttachVolumeNegativeTest-950462997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.475s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2a97d197-62f1-4e59-9e0c-a7eba69cdc53 tempest-AttachVolumeNegativeTest-950462997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-607689502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3262b077-bb66-4ab4-b9cc-b289865fbdc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='482d3ae3d4794286b2a5140f95848307',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:01:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:01:15Z,use_quota=True,user_id='36e88df4624545bdaee4b33104bd6cc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:01:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-2a97d197-62f1-4e59-9e0c-a7eba69cdc53 tempest-AttachVolumeNegativeTest-950462997 None] Creating volume 3262b077-bb66-4ab4-b9cc-b289865fbdc1 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:01:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2a97d197-62f1-4e59-9e0c-a7eba69cdc53 tempest-AttachVolumeNegativeTest-950462997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2a97d197-62f1-4e59-9e0c-a7eba69cdc53 tempest-AttachVolumeNegativeTest-950462997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2a97d197-62f1-4e59-9e0c-a7eba69cdc53 tempest-AttachVolumeNegativeTest-950462997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:01:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2a97d197-62f1-4e59-9e0c-a7eba69cdc53 tempest-AttachVolumeNegativeTest-950462997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:01:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2a97d197-62f1-4e59-9e0c-a7eba69cdc53 tempest-AttachVolumeNegativeTest-950462997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2a97d197-62f1-4e59-9e0c-a7eba69cdc53 tempest-AttachVolumeNegativeTest-950462997 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:01:18 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-2a97d197-62f1-4e59-9e0c-a7eba69cdc53 tempest-AttachVolumeNegativeTest-950462997 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:01:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2a97d197-62f1-4e59-9e0c-a7eba69cdc53 tempest-AttachVolumeNegativeTest-950462997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3262b077-bb66-4ab4-b9cc-b289865fbdc1 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:18 devstack sudo[98675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3262b077-bb66-4ab4-b9cc-b289865fbdc1 1073741824 Sep 28 15:01:18 devstack sudo[98675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:18 devstack cinder-volume[87116]: DEBUG cinder.volume.volume_utils [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] Attempting download of 660a4fad-84c6-40b7-a594-44d16c0701ee ((None, [{'url': 'file:///opt/stack/data/glance/images/660a4fad-84c6-40b7-a594-44d16c0701ee', 'metadata': {}}])) to volume 741c293c-ab9e-4ed2-9d11-d58c6d5a4495. {{(pid=87116) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1208}} Sep 28 15:01:18 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b770307-c853-4652-be43-8f14865ac07e]: (4, 'raw') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:01:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_660a4fad-84c6-40b7-a594-44d16c0701ee_xc45czss {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:18 devstack sudo[98677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_660a4fad-84c6-40b7-a594-44d16c0701ee_xc45czss Sep 28 15:01:18 devstack sudo[98677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:18 devstack sudo[98677]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_660a4fad-84c6-40b7-a594-44d16c0701ee_xc45czss" returned: 0 in 0.420s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_660a4fad-84c6-40b7-a594-44d16c0701ee_xc45czss {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2470d9f9-dd54-466f-9e2e-6ea24ca83717 tempest-VolumesActionsTest-1427483947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:18 devstack sudo[98675]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2a97d197-62f1-4e59-9e0c-a7eba69cdc53 tempest-AttachVolumeNegativeTest-950462997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3262b077-bb66-4ab4-b9cc-b289865fbdc1 1073741824" returned: 0 in 0.665s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:18 devstack sudo[98685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_660a4fad-84c6-40b7-a594-44d16c0701ee_xc45czss Sep 28 15:01:18 devstack sudo[98685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2a97d197-62f1-4e59-9e0c-a7eba69cdc53 tempest-AttachVolumeNegativeTest-950462997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3262b077-bb66-4ab4-b9cc-b289865fbdc1 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:18 devstack sudo[98687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3262b077-bb66-4ab4-b9cc-b289865fbdc1 Sep 28 15:01:18 devstack sudo[98687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:19 devstack sudo[98685]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_660a4fad-84c6-40b7-a594-44d16c0701ee_xc45czss" returned: 1 in 0.445s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_660a4fad-84c6-40b7-a594-44d16c0701ee_xc45czss' failed. Not Retrying. {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:01:19 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd6de7f-62d0-46bc-9ba3-430e7e2624f1]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:01:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_2zaid5s0devstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:19 devstack sudo[98687]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2a97d197-62f1-4e59-9e0c-a7eba69cdc53 tempest-AttachVolumeNegativeTest-950462997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3262b077-bb66-4ab4-b9cc-b289865fbdc1" returned: 0 in 0.291s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2a97d197-62f1-4e59-9e0c-a7eba69cdc53 tempest-AttachVolumeNegativeTest-950462997 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:01:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2a97d197-62f1-4e59-9e0c-a7eba69cdc53 tempest-AttachVolumeNegativeTest-950462997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2470d9f9-dd54-466f-9e2e-6ea24ca83717 tempest-VolumesActionsTest-1427483947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.384s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2a97d197-62f1-4e59-9e0c-a7eba69cdc53 tempest-AttachVolumeNegativeTest-950462997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3428ed66-252a-4344-8f62-5bb6c67b2b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3262b077-bb66-4ab4-b9cc-b289865fbdc1', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2a97d197-62f1-4e59-9e0c-a7eba69cdc53 tempest-AttachVolumeNegativeTest-950462997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f05cf0ab-f8b3-4bab-a8ff-b5cc089e3a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:19 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebcda14a-e70f-4966-907c-2f6216e482d6]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:01:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2470d9f9-dd54-466f-9e2e-6ea24ca83717 tempest-VolumesActionsTest-1427483947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bc09b466-fa90-4f3b-9dc9-b0edd019087e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:19 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-2a97d197-62f1-4e59-9e0c-a7eba69cdc53 tempest-AttachVolumeNegativeTest-950462997 None] Volume volume-3262b077-bb66-4ab4-b9cc-b289865fbdc1 (3262b077-bb66-4ab4-b9cc-b289865fbdc1): created successfully Sep 28 15:01:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2a97d197-62f1-4e59-9e0c-a7eba69cdc53 tempest-AttachVolumeNegativeTest-950462997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f05cf0ab-f8b3-4bab-a8ff-b5cc089e3a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2a97d197-62f1-4e59-9e0c-a7eba69cdc53 tempest-AttachVolumeNegativeTest-950462997 None] Flow 'volume_create_manager' (f5bb259c-7644-4a46-aa80-3f005ff549ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:01:19 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-2a97d197-62f1-4e59-9e0c-a7eba69cdc53 tempest-AttachVolumeNegativeTest-950462997 None] Created volume successfully. Sep 28 15:01:19 devstack sudo[98692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_2zaid5s0devstack@QuobyteHD Sep 28 15:01:19 devstack sudo[98692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:19 devstack sudo[98693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bc09b466-fa90-4f3b-9dc9-b0edd019087e Sep 28 15:01:19 devstack sudo[98693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:19 devstack sudo[98692]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_2zaid5s0devstack@QuobyteHD" returned: 0 in 0.399s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:19 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] 660a4fad-84c6-40b7-a594-44d16c0701ee was qcow2, converting to qcow2 {{(pid=87116) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 15:01:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_2zaid5s0devstack@QuobyteHD /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-741c293c-ab9e-4ed2-9d11-d58c6d5a4495 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:19 devstack sudo[98699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_2zaid5s0devstack@QuobyteHD /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-741c293c-ab9e-4ed2-9d11-d58c6d5a4495 Sep 28 15:01:19 devstack sudo[98699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:19 devstack sudo[98693]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2470d9f9-dd54-466f-9e2e-6ea24ca83717 tempest-VolumesActionsTest-1427483947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bc09b466-fa90-4f3b-9dc9-b0edd019087e" returned: 0 in 0.538s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:19 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c92bf7f-3124-4b57-82e3-49896686842f]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:01:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2470d9f9-dd54-466f-9e2e-6ea24ca83717 tempest-VolumesActionsTest-1427483947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bc09b466-fa90-4f3b-9dc9-b0edd019087e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:19 devstack sudo[98704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bc09b466-fa90-4f3b-9dc9-b0edd019087e Sep 28 15:01:19 devstack sudo[98704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:20 devstack sudo[98704]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2470d9f9-dd54-466f-9e2e-6ea24ca83717 tempest-VolumesActionsTest-1427483947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bc09b466-fa90-4f3b-9dc9-b0edd019087e" returned: 0 in 0.603s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2470d9f9-dd54-466f-9e2e-6ea24ca83717 tempest-VolumesActionsTest-1427483947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bc09b466-fa90-4f3b-9dc9-b0edd019087e /opt/stack/data/cinder/conversion/bc09b466-fa90-4f3b-9dc9-b0edd019087e.temp_image.e7e9cd48-c5d6-43d3-8add-a06f5ddc2376v5shyg1f.img {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:20 devstack sudo[98717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bc09b466-fa90-4f3b-9dc9-b0edd019087e /opt/stack/data/cinder/conversion/bc09b466-fa90-4f3b-9dc9-b0edd019087e.temp_image.e7e9cd48-c5d6-43d3-8add-a06f5ddc2376v5shyg1f.img Sep 28 15:01:20 devstack sudo[98717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-7604c685-809f-419f-b0c8-7ad0389a12e8 req-34d15748-d2aa-4406-9f6b-0288c801f968 tempest-AttachVolumeNegativeTest-950462997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:24 devstack sudo[98699]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_2zaid5s0devstack@QuobyteHD /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-741c293c-ab9e-4ed2-9d11-d58c6d5a4495" returned: 0 in 4.869s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:24 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_2zaid5s0devstack@QuobyteHD, size 112.00 MB, duration 4.87 sec, destination /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-741c293c-ab9e-4ed2-9d11-d58c6d5a4495 {{(pid=87116) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:01:24 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] Converted 112.00 MB image at 23.00 MB/s Sep 28 15:01:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-741c293c-ab9e-4ed2-9d11-d58c6d5a4495 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:24 devstack sudo[98742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-741c293c-ab9e-4ed2-9d11-d58c6d5a4495 1G Sep 28 15:01:24 devstack sudo[98742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:25 devstack sudo[98742]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-741c293c-ab9e-4ed2-9d11-d58c6d5a4495 1G" returned: 0 in 0.696s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:25 devstack cinder-volume[87116]: DEBUG cinder.volume.volume_utils [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] Downloaded image 660a4fad-84c6-40b7-a594-44d16c0701ee ((None, [{'url': 'file:///opt/stack/data/glance/images/660a4fad-84c6-40b7-a594-44d16c0701ee', 'metadata': {}}])) to volume 741c293c-ab9e-4ed2-9d11-d58c6d5a4495 successfully. {{(pid=87116) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1253}} Sep 28 15:01:25 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] Temporary image 660a4fad-84c6-40b7-a594-44d16c0701ee for user f0f5f20866d34821995a5e7942b96d72 is deleted. {{(pid=87116) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 15:01:25 devstack cinder-volume[87116]: DEBUG cinder.volume.volume_utils [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] Marking volume 741c293c-ab9e-4ed2-9d11-d58c6d5a4495 as bootable. {{(pid=87116) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1157}} Sep 28 15:01:25 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] Copying metadata from image 660a4fad-84c6-40b7-a594-44d16c0701ee to 741c293c-ab9e-4ed2-9d11-d58c6d5a4495. {{(pid=87116) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 15:01:25 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] Creating volume glance metadata for volume 741c293c-ab9e-4ed2-9d11-d58c6d5a4495 backed by image 660a4fad-84c6-40b7-a594-44d16c0701ee with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '660a4fad-84c6-40b7-a594-44d16c0701ee', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87116) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 15:01:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (201a7086-c53a-4e8a-a458-e6f2f78b10e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-741c293c-ab9e-4ed2-9d11-d58c6d5a4495', 'volume_size': 1, 'image_id': '660a4fad-84c6-40b7-a594-44d16c0701ee', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/660a4fad-84c6-40b7-a594-44d16c0701ee', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca088c9271854d40ba6017d33affee18', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '660a4fad-84c6-40b7-a594-44d16c0701ee', 'created_at': datetime.datetime(2026, 9, 28, 12, 47, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 47, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/660a4fad-84c6-40b7-a594-44d16c0701ee/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11c52378-f6eb-4b75-8f6b-aa3e0b2a887d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:25 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] Volume volume-741c293c-ab9e-4ed2-9d11-d58c6d5a4495 (741c293c-ab9e-4ed2-9d11-d58c6d5a4495): created successfully Sep 28 15:01:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11c52378-f6eb-4b75-8f6b-aa3e0b2a887d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] Flow 'volume_create_manager' (25a9b15d-5849-488c-aa51-1e0fc9281c6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:01:25 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-0955a55b-121c-4efc-bb92-a271e34b6be6 tempest-VolumesImageMetadata-1609594770 None] Created volume successfully. Sep 28 15:01:28 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1f0db117-2b38-483b-a12f-d95fccb69fbf tempest-VolumesImageMetadata-1609594770 None] Acquiring lock "cinder-741c293c-ab9e-4ed2-9d11-d58c6d5a4495-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:01:28 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1f0db117-2b38-483b-a12f-d95fccb69fbf tempest-VolumesImageMetadata-1609594770 None] Lock "cinder-741c293c-ab9e-4ed2-9d11-d58c6d5a4495-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:01:28 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1f0db117-2b38-483b-a12f-d95fccb69fbf tempest-VolumesImageMetadata-1609594770 None] Acquiring lock "cinder-quobyte-741c293c-ab9e-4ed2-9d11-d58c6d5a4495" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:01:28 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1f0db117-2b38-483b-a12f-d95fccb69fbf tempest-VolumesImageMetadata-1609594770 None] Lock "cinder-quobyte-741c293c-ab9e-4ed2-9d11-d58c6d5a4495" acquired by "delete_volume" :: waited 0.037s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:01:28 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[668d793e-a461-406a-91dc-75d5cfd512df]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:01:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1f0db117-2b38-483b-a12f-d95fccb69fbf tempest-VolumesImageMetadata-1609594770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-741c293c-ab9e-4ed2-9d11-d58c6d5a4495 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:28 devstack sudo[98717]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2470d9f9-dd54-466f-9e2e-6ea24ca83717 tempest-VolumesActionsTest-1427483947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bc09b466-fa90-4f3b-9dc9-b0edd019087e /opt/stack/data/cinder/conversion/bc09b466-fa90-4f3b-9dc9-b0edd019087e.temp_image.e7e9cd48-c5d6-43d3-8add-a06f5ddc2376v5shyg1f.img" returned: 0 in 8.410s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:28 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c70b90b-c047-484b-8a75-c7ca60d3c7f5]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:01:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2470d9f9-dd54-466f-9e2e-6ea24ca83717 tempest-VolumesActionsTest-1427483947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bc09b466-fa90-4f3b-9dc9-b0edd019087e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:28 devstack sudo[98748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-741c293c-ab9e-4ed2-9d11-d58c6d5a4495 Sep 28 15:01:28 devstack sudo[98748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:28 devstack sudo[98749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bc09b466-fa90-4f3b-9dc9-b0edd019087e Sep 28 15:01:28 devstack sudo[98749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:29 devstack sudo[98748]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1f0db117-2b38-483b-a12f-d95fccb69fbf tempest-VolumesImageMetadata-1609594770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-741c293c-ab9e-4ed2-9d11-d58c6d5a4495" returned: 0 in 0.511s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1f0db117-2b38-483b-a12f-d95fccb69fbf tempest-VolumesImageMetadata-1609594770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-741c293c-ab9e-4ed2-9d11-d58c6d5a4495 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:29 devstack sudo[98757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-741c293c-ab9e-4ed2-9d11-d58c6d5a4495 Sep 28 15:01:29 devstack sudo[98757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:29 devstack sudo[98749]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2470d9f9-dd54-466f-9e2e-6ea24ca83717 tempest-VolumesActionsTest-1427483947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bc09b466-fa90-4f3b-9dc9-b0edd019087e" returned: 0 in 0.670s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:29 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-2470d9f9-dd54-466f-9e2e-6ea24ca83717 tempest-VolumesActionsTest-1427483947 None] Image conversion details: src /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bc09b466-fa90-4f3b-9dc9-b0edd019087e, size 1024.00 MB, duration 8.41 sec, destination /opt/stack/data/cinder/conversion/bc09b466-fa90-4f3b-9dc9-b0edd019087e.temp_image.e7e9cd48-c5d6-43d3-8add-a06f5ddc2376v5shyg1f.img {{(pid=87116) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:01:29 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-2470d9f9-dd54-466f-9e2e-6ea24ca83717 tempest-VolumesActionsTest-1427483947 None] Converted 1024.00 MB image at 121.73 MB/s Sep 28 15:01:29 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-2470d9f9-dd54-466f-9e2e-6ea24ca83717 tempest-VolumesActionsTest-1427483947 None] e7e9cd48-c5d6-43d3-8add-a06f5ddc2376 was raw, converting to qcow2 {{(pid=87116) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 28 15:01:29 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c5ffa2-ead2-4344-a182-09226aa953ad]: (4, 'raw') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:01:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2470d9f9-dd54-466f-9e2e-6ea24ca83717 tempest-VolumesActionsTest-1427483947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/bc09b466-fa90-4f3b-9dc9-b0edd019087e.temp_image.e7e9cd48-c5d6-43d3-8add-a06f5ddc2376v5shyg1f.img {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:29 devstack sudo[98757]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1f0db117-2b38-483b-a12f-d95fccb69fbf tempest-VolumesImageMetadata-1609594770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-741c293c-ab9e-4ed2-9d11-d58c6d5a4495" returned: 0 in 0.330s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:29 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1f0db117-2b38-483b-a12f-d95fccb69fbf tempest-VolumesImageMetadata-1609594770 None] Lock "cinder-quobyte-741c293c-ab9e-4ed2-9d11-d58c6d5a4495" released by "delete_volume" :: held 0.949s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:01:29 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-1f0db117-2b38-483b-a12f-d95fccb69fbf tempest-VolumesImageMetadata-1609594770 None] Created reservations ['ec9a0025-1a87-4c07-95f2-63dd8f58928f', '5b0a2f61-ff76-4080-9d4f-d768eee82561', '4db5220a-e34f-404d-8c96-c3d25d23a3d6', '273a0778-9c11-4a80-8daf-fee988918b04'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:01:29 devstack sudo[98761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/bc09b466-fa90-4f3b-9dc9-b0edd019087e.temp_image.e7e9cd48-c5d6-43d3-8add-a06f5ddc2376v5shyg1f.img Sep 28 15:01:29 devstack sudo[98761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1f0db117-2b38-483b-a12f-d95fccb69fbf tempest-VolumesImageMetadata-1609594770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1f0db117-2b38-483b-a12f-d95fccb69fbf tempest-VolumesImageMetadata-1609594770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:29 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1f0db117-2b38-483b-a12f-d95fccb69fbf tempest-VolumesImageMetadata-1609594770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:01:29 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1f0db117-2b38-483b-a12f-d95fccb69fbf tempest-VolumesImageMetadata-1609594770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:01:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1f0db117-2b38-483b-a12f-d95fccb69fbf tempest-VolumesImageMetadata-1609594770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1f0db117-2b38-483b-a12f-d95fccb69fbf tempest-VolumesImageMetadata-1609594770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:29 devstack sudo[98797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:01:29 devstack sudo[98797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:29 devstack sudo[98761]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2470d9f9-dd54-466f-9e2e-6ea24ca83717 tempest-VolumesActionsTest-1427483947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/bc09b466-fa90-4f3b-9dc9-b0edd019087e.temp_image.e7e9cd48-c5d6-43d3-8add-a06f5ddc2376v5shyg1f.img" returned: 0 in 0.524s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2470d9f9-dd54-466f-9e2e-6ea24ca83717 tempest-VolumesActionsTest-1427483947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/bc09b466-fa90-4f3b-9dc9-b0edd019087e.temp_image.e7e9cd48-c5d6-43d3-8add-a06f5ddc2376v5shyg1f.img {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:30 devstack sudo[98797]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1f0db117-2b38-483b-a12f-d95fccb69fbf tempest-VolumesImageMetadata-1609594770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.413s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:30 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-1f0db117-2b38-483b-a12f-d95fccb69fbf tempest-VolumesImageMetadata-1609594770 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:01:30 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-1f0db117-2b38-483b-a12f-d95fccb69fbf tempest-VolumesImageMetadata-1609594770 None] Deleted volume successfully. Sep 28 15:01:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1f0db117-2b38-483b-a12f-d95fccb69fbf tempest-VolumesImageMetadata-1609594770 None] Lock "cinder-741c293c-ab9e-4ed2-9d11-d58c6d5a4495-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:01:30 devstack sudo[98801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/bc09b466-fa90-4f3b-9dc9-b0edd019087e.temp_image.e7e9cd48-c5d6-43d3-8add-a06f5ddc2376v5shyg1f.img Sep 28 15:01:30 devstack sudo[98801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:30 devstack sudo[98801]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2470d9f9-dd54-466f-9e2e-6ea24ca83717 tempest-VolumesActionsTest-1427483947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/bc09b466-fa90-4f3b-9dc9-b0edd019087e.temp_image.e7e9cd48-c5d6-43d3-8add-a06f5ddc2376v5shyg1f.img" returned: 1 in 0.489s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2470d9f9-dd54-466f-9e2e-6ea24ca83717 tempest-VolumesActionsTest-1427483947 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/bc09b466-fa90-4f3b-9dc9-b0edd019087e.temp_image.e7e9cd48-c5d6-43d3-8add-a06f5ddc2376v5shyg1f.img' failed. Not Retrying. {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:01:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2470d9f9-dd54-466f-9e2e-6ea24ca83717 tempest-VolumesActionsTest-1427483947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/bc09b466-fa90-4f3b-9dc9-b0edd019087e.temp_image.e7e9cd48-c5d6-43d3-8add-a06f5ddc2376v5shyg1f.img /opt/stack/data/cinder/conversion/vol_upload_n_cpjm_f {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:30 devstack sudo[98809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/bc09b466-fa90-4f3b-9dc9-b0edd019087e.temp_image.e7e9cd48-c5d6-43d3-8add-a06f5ddc2376v5shyg1f.img /opt/stack/data/cinder/conversion/vol_upload_n_cpjm_f Sep 28 15:01:30 devstack sudo[98809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:30 devstack sudo[98809]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2470d9f9-dd54-466f-9e2e-6ea24ca83717 tempest-VolumesActionsTest-1427483947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/bc09b466-fa90-4f3b-9dc9-b0edd019087e.temp_image.e7e9cd48-c5d6-43d3-8add-a06f5ddc2376v5shyg1f.img /opt/stack/data/cinder/conversion/vol_upload_n_cpjm_f" returned: 0 in 0.351s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:30 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-2470d9f9-dd54-466f-9e2e-6ea24ca83717 tempest-VolumesActionsTest-1427483947 None] Image conversion details: src /opt/stack/data/cinder/conversion/bc09b466-fa90-4f3b-9dc9-b0edd019087e.temp_image.e7e9cd48-c5d6-43d3-8add-a06f5ddc2376v5shyg1f.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_n_cpjm_f {{(pid=87116) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:01:30 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-2470d9f9-dd54-466f-9e2e-6ea24ca83717 tempest-VolumesActionsTest-1427483947 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 28 15:01:30 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb61c4c0-d2dd-4c10-bc91-1149be92c143]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:01:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2470d9f9-dd54-466f-9e2e-6ea24ca83717 tempest-VolumesActionsTest-1427483947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_n_cpjm_f {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:30 devstack sudo[98816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_n_cpjm_f Sep 28 15:01:30 devstack sudo[98816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:31 devstack sudo[98816]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2470d9f9-dd54-466f-9e2e-6ea24ca83717 tempest-VolumesActionsTest-1427483947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_n_cpjm_f" returned: 0 in 0.372s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2470d9f9-dd54-466f-9e2e-6ea24ca83717 tempest-VolumesActionsTest-1427483947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 14.446s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2470d9f9-dd54-466f-9e2e-6ea24ca83717 tempest-VolumesActionsTest-1427483947 None] Uploaded volume to glance image-id: e7e9cd48-c5d6-43d3-8add-a06f5ddc2376. {{(pid=87116) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 15:01:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-7604c685-809f-419f-b0c8-7ad0389a12e8 req-34d15748-d2aa-4406-9f6b-0288c801f968 tempest-AttachVolumeNegativeTest-950462997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 11.991s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-7604c685-809f-419f-b0c8-7ad0389a12e8 req-34d15748-d2aa-4406-9f6b-0288c801f968 tempest-AttachVolumeNegativeTest-950462997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:33 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-2470d9f9-dd54-466f-9e2e-6ea24ca83717 tempest-VolumesActionsTest-1427483947 None] Copy volume to image completed successfully. Sep 28 15:01:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-7604c685-809f-419f-b0c8-7ad0389a12e8 req-34d15748-d2aa-4406-9f6b-0288c801f968 tempest-AttachVolumeNegativeTest-950462997 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1', 'name': 'volume-3262b077-bb66-4ab4-b9cc-b289865fbdc1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1d47cac8-b73d-4494-a24a-a71ca77ef955', 'enforce_multipath': True} {{(pid=87116) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:01:33 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-7604c685-809f-419f-b0c8-7ad0389a12e8 req-34d15748-d2aa-4406-9f6b-0288c801f968 tempest-AttachVolumeNegativeTest-950462997 None] attachment_update completed successfully. Sep 28 15:01:34 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-af905bd0-f974-4580-ab1d-f5103aac5674 tempest-VolumesActionsTest-1427483947 None] Acquiring lock "cinder-bc09b466-fa90-4f3b-9dc9-b0edd019087e-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:01:34 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-af905bd0-f974-4580-ab1d-f5103aac5674 tempest-VolumesActionsTest-1427483947 None] Lock "cinder-bc09b466-fa90-4f3b-9dc9-b0edd019087e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:01:34 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-af905bd0-f974-4580-ab1d-f5103aac5674 tempest-VolumesActionsTest-1427483947 None] Acquiring lock "cinder-quobyte-bc09b466-fa90-4f3b-9dc9-b0edd019087e" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:01:34 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-af905bd0-f974-4580-ab1d-f5103aac5674 tempest-VolumesActionsTest-1427483947 None] Lock "cinder-quobyte-bc09b466-fa90-4f3b-9dc9-b0edd019087e" acquired by "delete_volume" :: waited 0.041s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:01:34 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af1ec02-c7bf-4370-8551-d8303ee6cdbc]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:01:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-af905bd0-f974-4580-ab1d-f5103aac5674 tempest-VolumesActionsTest-1427483947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bc09b466-fa90-4f3b-9dc9-b0edd019087e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:35 devstack sudo[99246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bc09b466-fa90-4f3b-9dc9-b0edd019087e Sep 28 15:01:35 devstack sudo[99246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:35 devstack sudo[99246]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-af905bd0-f974-4580-ab1d-f5103aac5674 tempest-VolumesActionsTest-1427483947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bc09b466-fa90-4f3b-9dc9-b0edd019087e" returned: 0 in 0.523s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-af905bd0-f974-4580-ab1d-f5103aac5674 tempest-VolumesActionsTest-1427483947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bc09b466-fa90-4f3b-9dc9-b0edd019087e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:35 devstack sudo[99251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bc09b466-fa90-4f3b-9dc9-b0edd019087e Sep 28 15:01:35 devstack sudo[99251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:35 devstack sudo[99251]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-af905bd0-f974-4580-ab1d-f5103aac5674 tempest-VolumesActionsTest-1427483947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bc09b466-fa90-4f3b-9dc9-b0edd019087e" returned: 0 in 0.418s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:35 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-af905bd0-f974-4580-ab1d-f5103aac5674 tempest-VolumesActionsTest-1427483947 None] Lock "cinder-quobyte-bc09b466-fa90-4f3b-9dc9-b0edd019087e" released by "delete_volume" :: held 1.012s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:01:36 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-af905bd0-f974-4580-ab1d-f5103aac5674 tempest-VolumesActionsTest-1427483947 None] Created reservations ['80124a19-21be-4386-b11e-197a16f0381d', 'e228b9e3-0bc3-4e2b-8dee-1b1879c23a04', '57cd556d-a5a6-4ac4-9b8b-b272dea90ec6', 'd5e67347-1b8d-418f-91dd-ea86c59a51b9'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:01:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-af905bd0-f974-4580-ab1d-f5103aac5674 tempest-VolumesActionsTest-1427483947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-af905bd0-f974-4580-ab1d-f5103aac5674 tempest-VolumesActionsTest-1427483947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:36 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-af905bd0-f974-4580-ab1d-f5103aac5674 tempest-VolumesActionsTest-1427483947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:01:36 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-af905bd0-f974-4580-ab1d-f5103aac5674 tempest-VolumesActionsTest-1427483947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:01:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-af905bd0-f974-4580-ab1d-f5103aac5674 tempest-VolumesActionsTest-1427483947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-af905bd0-f974-4580-ab1d-f5103aac5674 tempest-VolumesActionsTest-1427483947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:36 devstack sudo[99254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:01:36 devstack sudo[99254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:36 devstack sudo[99254]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-af905bd0-f974-4580-ab1d-f5103aac5674 tempest-VolumesActionsTest-1427483947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.403s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:36 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-af905bd0-f974-4580-ab1d-f5103aac5674 tempest-VolumesActionsTest-1427483947 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:01:36 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-af905bd0-f974-4580-ab1d-f5103aac5674 tempest-VolumesActionsTest-1427483947 None] Deleted volume successfully. Sep 28 15:01:36 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-af905bd0-f974-4580-ab1d-f5103aac5674 tempest-VolumesActionsTest-1427483947 None] Lock "cinder-bc09b466-fa90-4f3b-9dc9-b0edd019087e-delete_volume" released by "delete_volume" :: held 1.944s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:01:37 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-ae49235e-fe7b-4ca9-badf-075684768e0d req-d5737357-eb11-4257-920d-7cd5d93971a0 tempest-AttachVolumeNegativeTest-950462997 None] Terminate volume connection completed successfully. Sep 28 15:01:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-ae49235e-fe7b-4ca9-badf-075684768e0d req-d5737357-eb11-4257-920d-7cd5d93971a0 tempest-AttachVolumeNegativeTest-950462997 None] Deleting attachment 1d47cac8-b73d-4494-a24a-a71ca77ef955. {{(pid=87116) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:01:37 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-527ecd09-86e4-43e4-b788-68e311279c29 tempest-SnapshotMetadataTestJSON-2003214858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:01:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-527ecd09-86e4-43e4-b788-68e311279c29 tempest-SnapshotMetadataTestJSON-2003214858 None] Flow 'volume_create_manager' (90ac0da0-de86-4ad5-a35a-17782c5d5198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:01:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-527ecd09-86e4-43e4-b788-68e311279c29 tempest-SnapshotMetadataTestJSON-2003214858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40b59c9f-b230-45ff-872a-78186f0dff19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-527ecd09-86e4-43e4-b788-68e311279c29 tempest-SnapshotMetadataTestJSON-2003214858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40b59c9f-b230-45ff-872a-78186f0dff19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:01:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1949645115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3ca6f06-33f6-42f5-b8c0-685202b76085,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b6bc8929a434d92bf8cc00bcf081335',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:01:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:01:37Z,use_quota=True,user_id='633b65dc738141048b9b1ff4628e1352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-527ecd09-86e4-43e4-b788-68e311279c29 tempest-SnapshotMetadataTestJSON-2003214858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdd15d1b-ba69-4bf5-8ba7-788294073c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-527ecd09-86e4-43e4-b788-68e311279c29 tempest-SnapshotMetadataTestJSON-2003214858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdd15d1b-ba69-4bf5-8ba7-788294073c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-527ecd09-86e4-43e4-b788-68e311279c29 tempest-SnapshotMetadataTestJSON-2003214858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24b6e14e-4414-43f8-8710-824a1a768497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-527ecd09-86e4-43e4-b788-68e311279c29 tempest-SnapshotMetadataTestJSON-2003214858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24b6e14e-4414-43f8-8710-824a1a768497) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3ca6f06-33f6-42f5-b8c0-685202b76085', 'volume_name': 'volume-e3ca6f06-33f6-42f5-b8c0-685202b76085', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-527ecd09-86e4-43e4-b788-68e311279c29 tempest-SnapshotMetadataTestJSON-2003214858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad795cd5-ae37-4e21-9d3e-ad4c7a2b79f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-527ecd09-86e4-43e4-b788-68e311279c29 tempest-SnapshotMetadataTestJSON-2003214858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad795cd5-ae37-4e21-9d3e-ad4c7a2b79f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-527ecd09-86e4-43e4-b788-68e311279c29 tempest-SnapshotMetadataTestJSON-2003214858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4acba72f-f7fb-4d3d-b4ae-f35ff8278a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:37 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-527ecd09-86e4-43e4-b788-68e311279c29 tempest-SnapshotMetadataTestJSON-2003214858 None] Volume e3ca6f06-33f6-42f5-b8c0-685202b76085: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3ca6f06-33f6-42f5-b8c0-685202b76085', 'volume_size': 1} Sep 28 15:01:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-527ecd09-86e4-43e4-b788-68e311279c29 tempest-SnapshotMetadataTestJSON-2003214858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-527ecd09-86e4-43e4-b788-68e311279c29 tempest-SnapshotMetadataTestJSON-2003214858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:37 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-527ecd09-86e4-43e4-b788-68e311279c29 tempest-SnapshotMetadataTestJSON-2003214858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:01:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1949645115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3ca6f06-33f6-42f5-b8c0-685202b76085,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b6bc8929a434d92bf8cc00bcf081335',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:01:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:01:37Z,use_quota=True,user_id='633b65dc738141048b9b1ff4628e1352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:01:37 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-527ecd09-86e4-43e4-b788-68e311279c29 tempest-SnapshotMetadataTestJSON-2003214858 None] Creating volume e3ca6f06-33f6-42f5-b8c0-685202b76085 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:01:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-527ecd09-86e4-43e4-b788-68e311279c29 tempest-SnapshotMetadataTestJSON-2003214858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-527ecd09-86e4-43e4-b788-68e311279c29 tempest-SnapshotMetadataTestJSON-2003214858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:37 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-527ecd09-86e4-43e4-b788-68e311279c29 tempest-SnapshotMetadataTestJSON-2003214858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:01:37 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-527ecd09-86e4-43e4-b788-68e311279c29 tempest-SnapshotMetadataTestJSON-2003214858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:01:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-527ecd09-86e4-43e4-b788-68e311279c29 tempest-SnapshotMetadataTestJSON-2003214858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:37 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-527ecd09-86e4-43e4-b788-68e311279c29 tempest-SnapshotMetadataTestJSON-2003214858 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:01:37 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-527ecd09-86e4-43e4-b788-68e311279c29 tempest-SnapshotMetadataTestJSON-2003214858 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:01:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-527ecd09-86e4-43e4-b788-68e311279c29 tempest-SnapshotMetadataTestJSON-2003214858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e3ca6f06-33f6-42f5-b8c0-685202b76085 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:37 devstack sudo[99287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e3ca6f06-33f6-42f5-b8c0-685202b76085 1073741824 Sep 28 15:01:37 devstack sudo[99287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:38 devstack sudo[99287]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-527ecd09-86e4-43e4-b788-68e311279c29 tempest-SnapshotMetadataTestJSON-2003214858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e3ca6f06-33f6-42f5-b8c0-685202b76085 1073741824" returned: 0 in 0.833s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-527ecd09-86e4-43e4-b788-68e311279c29 tempest-SnapshotMetadataTestJSON-2003214858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e3ca6f06-33f6-42f5-b8c0-685202b76085 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:38 devstack sudo[99300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e3ca6f06-33f6-42f5-b8c0-685202b76085 Sep 28 15:01:38 devstack sudo[99300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:38 devstack sudo[99300]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-527ecd09-86e4-43e4-b788-68e311279c29 tempest-SnapshotMetadataTestJSON-2003214858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e3ca6f06-33f6-42f5-b8c0-685202b76085" returned: 0 in 0.392s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:38 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-527ecd09-86e4-43e4-b788-68e311279c29 tempest-SnapshotMetadataTestJSON-2003214858 None] <== create_volume: return (1311ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:01:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-527ecd09-86e4-43e4-b788-68e311279c29 tempest-SnapshotMetadataTestJSON-2003214858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.313s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-527ecd09-86e4-43e4-b788-68e311279c29 tempest-SnapshotMetadataTestJSON-2003214858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4acba72f-f7fb-4d3d-b4ae-f35ff8278a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3ca6f06-33f6-42f5-b8c0-685202b76085', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-527ecd09-86e4-43e4-b788-68e311279c29 tempest-SnapshotMetadataTestJSON-2003214858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33dbf5df-f42c-4f8e-8b18-36b36b1fe784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:39 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-527ecd09-86e4-43e4-b788-68e311279c29 tempest-SnapshotMetadataTestJSON-2003214858 None] Volume volume-e3ca6f06-33f6-42f5-b8c0-685202b76085 (e3ca6f06-33f6-42f5-b8c0-685202b76085): created successfully Sep 28 15:01:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-527ecd09-86e4-43e4-b788-68e311279c29 tempest-SnapshotMetadataTestJSON-2003214858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33dbf5df-f42c-4f8e-8b18-36b36b1fe784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-527ecd09-86e4-43e4-b788-68e311279c29 tempest-SnapshotMetadataTestJSON-2003214858 None] Flow 'volume_create_manager' (90ac0da0-de86-4ad5-a35a-17782c5d5198) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:01:39 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-527ecd09-86e4-43e4-b788-68e311279c29 tempest-SnapshotMetadataTestJSON-2003214858 None] Created volume successfully. Sep 28 15:01:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6d21fc75-aa2e-4afa-931e-4c2410777a73 tempest-SnapshotMetadataTestJSON-2003214858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6d21fc75-aa2e-4afa-931e-4c2410777a73 tempest-SnapshotMetadataTestJSON-2003214858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:40 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-6d21fc75-aa2e-4afa-931e-4c2410777a73 tempest-SnapshotMetadataTestJSON-2003214858 None] Creating offline snapshot 97d63cd2-ba47-4258-b351-4854d679faa8 of volume e3ca6f06-33f6-42f5-b8c0-685202b76085 {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:01:40 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[53fad346-469c-47af-993c-bc310dc3591a]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:01:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6d21fc75-aa2e-4afa-931e-4c2410777a73 tempest-SnapshotMetadataTestJSON-2003214858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e3ca6f06-33f6-42f5-b8c0-685202b76085 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:40 devstack sudo[99320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e3ca6f06-33f6-42f5-b8c0-685202b76085 Sep 28 15:01:40 devstack sudo[99320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:40 devstack sudo[99320]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6d21fc75-aa2e-4afa-931e-4c2410777a73 tempest-SnapshotMetadataTestJSON-2003214858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e3ca6f06-33f6-42f5-b8c0-685202b76085" returned: 0 in 0.528s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6d21fc75-aa2e-4afa-931e-4c2410777a73 tempest-SnapshotMetadataTestJSON-2003214858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e3ca6f06-33f6-42f5-b8c0-685202b76085,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e3ca6f06-33f6-42f5-b8c0-685202b76085.97d63cd2-ba47-4258-b351-4854d679faa8 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:40 devstack sudo[99328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e3ca6f06-33f6-42f5-b8c0-685202b76085,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e3ca6f06-33f6-42f5-b8c0-685202b76085.97d63cd2-ba47-4258-b351-4854d679faa8 1G Sep 28 15:01:40 devstack sudo[99328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:41 devstack sudo[99328]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6d21fc75-aa2e-4afa-931e-4c2410777a73 tempest-SnapshotMetadataTestJSON-2003214858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e3ca6f06-33f6-42f5-b8c0-685202b76085,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e3ca6f06-33f6-42f5-b8c0-685202b76085.97d63cd2-ba47-4258-b351-4854d679faa8 1G" returned: 0 in 0.678s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6d21fc75-aa2e-4afa-931e-4c2410777a73 tempest-SnapshotMetadataTestJSON-2003214858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3ca6f06-33f6-42f5-b8c0-685202b76085 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e3ca6f06-33f6-42f5-b8c0-685202b76085.97d63cd2-ba47-4258-b351-4854d679faa8 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:41 devstack sudo[99334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3ca6f06-33f6-42f5-b8c0-685202b76085 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e3ca6f06-33f6-42f5-b8c0-685202b76085.97d63cd2-ba47-4258-b351-4854d679faa8 Sep 28 15:01:41 devstack sudo[99334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:42 devstack sudo[99334]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6d21fc75-aa2e-4afa-931e-4c2410777a73 tempest-SnapshotMetadataTestJSON-2003214858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3ca6f06-33f6-42f5-b8c0-685202b76085 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e3ca6f06-33f6-42f5-b8c0-685202b76085.97d63cd2-ba47-4258-b351-4854d679faa8" returned: 0 in 0.703s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:42 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-6d21fc75-aa2e-4afa-931e-4c2410777a73 tempest-SnapshotMetadataTestJSON-2003214858 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e3ca6f06-33f6-42f5-b8c0-685202b76085.97d63cd2-ba47-4258-b351-4854d679faa8 is being set with open permissions: ugo+rw Sep 28 15:01:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6d21fc75-aa2e-4afa-931e-4c2410777a73 tempest-SnapshotMetadataTestJSON-2003214858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e3ca6f06-33f6-42f5-b8c0-685202b76085.97d63cd2-ba47-4258-b351-4854d679faa8 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:42 devstack sudo[99340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e3ca6f06-33f6-42f5-b8c0-685202b76085.97d63cd2-ba47-4258-b351-4854d679faa8 Sep 28 15:01:42 devstack sudo[99340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:42 devstack sudo[99340]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6d21fc75-aa2e-4afa-931e-4c2410777a73 tempest-SnapshotMetadataTestJSON-2003214858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e3ca6f06-33f6-42f5-b8c0-685202b76085.97d63cd2-ba47-4258-b351-4854d679faa8" returned: 0 in 0.414s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6d21fc75-aa2e-4afa-931e-4c2410777a73 tempest-SnapshotMetadataTestJSON-2003214858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e3ca6f06-33f6-42f5-b8c0-685202b76085.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:42 devstack sudo[99343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e3ca6f06-33f6-42f5-b8c0-685202b76085.info Sep 28 15:01:42 devstack sudo[99343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:42 devstack sudo[99343]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6d21fc75-aa2e-4afa-931e-4c2410777a73 tempest-SnapshotMetadataTestJSON-2003214858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e3ca6f06-33f6-42f5-b8c0-685202b76085.info" returned: 0 in 0.369s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:42 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-6d21fc75-aa2e-4afa-931e-4c2410777a73 tempest-SnapshotMetadataTestJSON-2003214858 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e3ca6f06-33f6-42f5-b8c0-685202b76085.info is being set with open permissions: ugo+rw Sep 28 15:01:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6d21fc75-aa2e-4afa-931e-4c2410777a73 tempest-SnapshotMetadataTestJSON-2003214858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e3ca6f06-33f6-42f5-b8c0-685202b76085.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:42 devstack sudo[99346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e3ca6f06-33f6-42f5-b8c0-685202b76085.info Sep 28 15:01:42 devstack sudo[99346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:43 devstack sudo[99346]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6d21fc75-aa2e-4afa-931e-4c2410777a73 tempest-SnapshotMetadataTestJSON-2003214858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e3ca6f06-33f6-42f5-b8c0-685202b76085.info" returned: 0 in 0.400s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6d21fc75-aa2e-4afa-931e-4c2410777a73 tempest-SnapshotMetadataTestJSON-2003214858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.271s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:43 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-6d21fc75-aa2e-4afa-931e-4c2410777a73 tempest-SnapshotMetadataTestJSON-2003214858 None] Create snapshot completed successfully Sep 28 15:01:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2a800e2f-6650-45d7-b559-fd1b354bca6a tempest-SnapshotMetadataTestJSON-2003214858 None] Acquiring lock "cinder-97d63cd2-ba47-4258-b351-4854d679faa8-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:01:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2a800e2f-6650-45d7-b559-fd1b354bca6a tempest-SnapshotMetadataTestJSON-2003214858 None] Lock "cinder-97d63cd2-ba47-4258-b351-4854d679faa8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:01:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2a800e2f-6650-45d7-b559-fd1b354bca6a tempest-SnapshotMetadataTestJSON-2003214858 None] Acquiring lock "cinder-quobyte-e3ca6f06-33f6-42f5-b8c0-685202b76085" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:01:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2a800e2f-6650-45d7-b559-fd1b354bca6a tempest-SnapshotMetadataTestJSON-2003214858 None] Lock "cinder-quobyte-e3ca6f06-33f6-42f5-b8c0-685202b76085" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:01:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2a800e2f-6650-45d7-b559-fd1b354bca6a tempest-SnapshotMetadataTestJSON-2003214858 None] Acquiring lock "cinder-quobyte-97d63cd2-ba47-4258-b351-4854d679faa8" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:01:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2a800e2f-6650-45d7-b559-fd1b354bca6a tempest-SnapshotMetadataTestJSON-2003214858 None] Lock "cinder-quobyte-97d63cd2-ba47-4258-b351-4854d679faa8" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:01:46 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-2a800e2f-6650-45d7-b559-fd1b354bca6a tempest-SnapshotMetadataTestJSON-2003214858 None] Deleting offline snapshot 97d63cd2-ba47-4258-b351-4854d679faa8 of volume e3ca6f06-33f6-42f5-b8c0-685202b76085 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:01:46 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-2a800e2f-6650-45d7-b559-fd1b354bca6a tempest-SnapshotMetadataTestJSON-2003214858 None] snapshot_file for this snap is: volume-e3ca6f06-33f6-42f5-b8c0-685202b76085.97d63cd2-ba47-4258-b351-4854d679faa8 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:01:46 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0598350-4b65-4543-81f1-56b7401fe40f]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:01:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2a800e2f-6650-45d7-b559-fd1b354bca6a tempest-SnapshotMetadataTestJSON-2003214858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e3ca6f06-33f6-42f5-b8c0-685202b76085.97d63cd2-ba47-4258-b351-4854d679faa8 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:46 devstack sudo[99352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e3ca6f06-33f6-42f5-b8c0-685202b76085.97d63cd2-ba47-4258-b351-4854d679faa8 Sep 28 15:01:46 devstack sudo[99352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:46 devstack sudo[99352]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2a800e2f-6650-45d7-b559-fd1b354bca6a tempest-SnapshotMetadataTestJSON-2003214858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e3ca6f06-33f6-42f5-b8c0-685202b76085.97d63cd2-ba47-4258-b351-4854d679faa8" returned: 0 in 0.514s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:46 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-2a800e2f-6650-45d7-b559-fd1b354bca6a tempest-SnapshotMetadataTestJSON-2003214858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3ca6f06-33f6-42f5-b8c0-685202b76085(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:01:46 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[411bcc4f-f40a-4358-8443-359025c0485b]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:01:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2a800e2f-6650-45d7-b559-fd1b354bca6a tempest-SnapshotMetadataTestJSON-2003214858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e3ca6f06-33f6-42f5-b8c0-685202b76085 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:47 devstack sudo[99357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e3ca6f06-33f6-42f5-b8c0-685202b76085 Sep 28 15:01:47 devstack sudo[99357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:47 devstack sudo[99357]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2a800e2f-6650-45d7-b559-fd1b354bca6a tempest-SnapshotMetadataTestJSON-2003214858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e3ca6f06-33f6-42f5-b8c0-685202b76085" returned: 0 in 0.510s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2a800e2f-6650-45d7-b559-fd1b354bca6a tempest-SnapshotMetadataTestJSON-2003214858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e3ca6f06-33f6-42f5-b8c0-685202b76085.97d63cd2-ba47-4258-b351-4854d679faa8 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:47 devstack sudo[99362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e3ca6f06-33f6-42f5-b8c0-685202b76085.97d63cd2-ba47-4258-b351-4854d679faa8 Sep 28 15:01:47 devstack sudo[99362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:47 devstack sudo[99362]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2a800e2f-6650-45d7-b559-fd1b354bca6a tempest-SnapshotMetadataTestJSON-2003214858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e3ca6f06-33f6-42f5-b8c0-685202b76085.97d63cd2-ba47-4258-b351-4854d679faa8" returned: 0 in 0.534s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2a800e2f-6650-45d7-b559-fd1b354bca6a tempest-SnapshotMetadataTestJSON-2003214858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e3ca6f06-33f6-42f5-b8c0-685202b76085.97d63cd2-ba47-4258-b351-4854d679faa8 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:47 devstack sudo[99367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e3ca6f06-33f6-42f5-b8c0-685202b76085.97d63cd2-ba47-4258-b351-4854d679faa8 Sep 28 15:01:47 devstack sudo[99367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:48 devstack sudo[99367]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2a800e2f-6650-45d7-b559-fd1b354bca6a tempest-SnapshotMetadataTestJSON-2003214858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e3ca6f06-33f6-42f5-b8c0-685202b76085.97d63cd2-ba47-4258-b351-4854d679faa8" returned: 0 in 0.391s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:48 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2a800e2f-6650-45d7-b559-fd1b354bca6a tempest-SnapshotMetadataTestJSON-2003214858 None] Lock "cinder-quobyte-97d63cd2-ba47-4258-b351-4854d679faa8" released by "_delete_snapshot" :: held 2.146s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:01:48 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2a800e2f-6650-45d7-b559-fd1b354bca6a tempest-SnapshotMetadataTestJSON-2003214858 None] Lock "cinder-quobyte-e3ca6f06-33f6-42f5-b8c0-685202b76085" released by "delete_snapshot" :: held 2.182s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:01:48 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-2a800e2f-6650-45d7-b559-fd1b354bca6a tempest-SnapshotMetadataTestJSON-2003214858 None] Created reservations ['dd4769a4-95b8-4450-beee-32e81259331c', '3f230000-0dcc-4732-96ef-586eefe8f27b', '5abef274-cd4b-4c7d-a90a-d2ca13db03ee', '5bf5a6b3-1a26-40af-aaa9-e8cefd9476ac'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:01:48 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-2a800e2f-6650-45d7-b559-fd1b354bca6a tempest-SnapshotMetadataTestJSON-2003214858 None] Delete snapshot completed successfully. Sep 28 15:01:48 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2a800e2f-6650-45d7-b559-fd1b354bca6a tempest-SnapshotMetadataTestJSON-2003214858 None] Lock "cinder-97d63cd2-ba47-4258-b351-4854d679faa8-delete_snapshot" released by "delete_snapshot" :: held 2.368s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:01:49 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-621b69f2-5120-4a2d-8877-90c90d46b151 tempest-SnapshotMetadataTestJSON-2003214858 None] Acquiring lock "cinder-e3ca6f06-33f6-42f5-b8c0-685202b76085-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:01:49 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-621b69f2-5120-4a2d-8877-90c90d46b151 tempest-SnapshotMetadataTestJSON-2003214858 None] Lock "cinder-e3ca6f06-33f6-42f5-b8c0-685202b76085-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:01:49 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-621b69f2-5120-4a2d-8877-90c90d46b151 tempest-SnapshotMetadataTestJSON-2003214858 None] Acquiring lock "cinder-quobyte-e3ca6f06-33f6-42f5-b8c0-685202b76085" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:01:49 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-621b69f2-5120-4a2d-8877-90c90d46b151 tempest-SnapshotMetadataTestJSON-2003214858 None] Lock "cinder-quobyte-e3ca6f06-33f6-42f5-b8c0-685202b76085" acquired by "delete_volume" :: waited 0.024s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:01:49 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a269cd-e84d-44c9-9d84-8f6c6707434a]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:01:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-621b69f2-5120-4a2d-8877-90c90d46b151 tempest-SnapshotMetadataTestJSON-2003214858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e3ca6f06-33f6-42f5-b8c0-685202b76085 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:49 devstack sudo[99373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e3ca6f06-33f6-42f5-b8c0-685202b76085 Sep 28 15:01:49 devstack sudo[99373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:50 devstack sudo[99373]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-621b69f2-5120-4a2d-8877-90c90d46b151 tempest-SnapshotMetadataTestJSON-2003214858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e3ca6f06-33f6-42f5-b8c0-685202b76085" returned: 0 in 0.641s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-621b69f2-5120-4a2d-8877-90c90d46b151 tempest-SnapshotMetadataTestJSON-2003214858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e3ca6f06-33f6-42f5-b8c0-685202b76085 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:50 devstack sudo[99378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e3ca6f06-33f6-42f5-b8c0-685202b76085 Sep 28 15:01:50 devstack sudo[99378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:50 devstack sudo[99378]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-621b69f2-5120-4a2d-8877-90c90d46b151 tempest-SnapshotMetadataTestJSON-2003214858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e3ca6f06-33f6-42f5-b8c0-685202b76085" returned: 0 in 0.467s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:50 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b6c6657-58ac-48a9-8100-6e2cc2cf6b37 tempest-VolumesGetTest-421307961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:01:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4b6c6657-58ac-48a9-8100-6e2cc2cf6b37 tempest-VolumesGetTest-421307961 None] Flow 'volume_create_manager' (0ec154a2-eb5d-4d80-8e7a-ea8c5f389876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:01:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4b6c6657-58ac-48a9-8100-6e2cc2cf6b37 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bc15f98-54ac-4531-b1ad-8d9ce8d43058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:50 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-621b69f2-5120-4a2d-8877-90c90d46b151 tempest-SnapshotMetadataTestJSON-2003214858 None] Lock "cinder-quobyte-e3ca6f06-33f6-42f5-b8c0-685202b76085" released by "delete_volume" :: held 1.271s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:01:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4b6c6657-58ac-48a9-8100-6e2cc2cf6b37 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bc15f98-54ac-4531-b1ad-8d9ce8d43058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-513633700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8dccf06-18e7-4c91-96d6-0153d65af03c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='faba40f947cd4221a56196fd85c2337f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:01:51Z,use_quota=True,user_id='91ba074109b045f1a62611658fb66015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4b6c6657-58ac-48a9-8100-6e2cc2cf6b37 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e821b086-670b-4791-a498-713461766cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4b6c6657-58ac-48a9-8100-6e2cc2cf6b37 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e821b086-670b-4791-a498-713461766cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4b6c6657-58ac-48a9-8100-6e2cc2cf6b37 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b86ac56c-ecfd-4508-b4b7-0ab91cca9003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4b6c6657-58ac-48a9-8100-6e2cc2cf6b37 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b86ac56c-ecfd-4508-b4b7-0ab91cca9003) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8dccf06-18e7-4c91-96d6-0153d65af03c', 'volume_name': 'volume-f8dccf06-18e7-4c91-96d6-0153d65af03c', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4b6c6657-58ac-48a9-8100-6e2cc2cf6b37 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df37763f-93ee-4ffc-876c-908d3a348e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4b6c6657-58ac-48a9-8100-6e2cc2cf6b37 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df37763f-93ee-4ffc-876c-908d3a348e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4b6c6657-58ac-48a9-8100-6e2cc2cf6b37 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (642c0c52-6569-4aa9-a80c-0231904da077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:51 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-4b6c6657-58ac-48a9-8100-6e2cc2cf6b37 tempest-VolumesGetTest-421307961 None] Volume f8dccf06-18e7-4c91-96d6-0153d65af03c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8dccf06-18e7-4c91-96d6-0153d65af03c', 'volume_size': 1} Sep 28 15:01:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4b6c6657-58ac-48a9-8100-6e2cc2cf6b37 tempest-VolumesGetTest-421307961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4b6c6657-58ac-48a9-8100-6e2cc2cf6b37 tempest-VolumesGetTest-421307961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:51 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4b6c6657-58ac-48a9-8100-6e2cc2cf6b37 tempest-VolumesGetTest-421307961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-513633700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8dccf06-18e7-4c91-96d6-0153d65af03c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='faba40f947cd4221a56196fd85c2337f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:01:51Z,use_quota=True,user_id='91ba074109b045f1a62611658fb66015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:01:51 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-4b6c6657-58ac-48a9-8100-6e2cc2cf6b37 tempest-VolumesGetTest-421307961 None] Creating volume f8dccf06-18e7-4c91-96d6-0153d65af03c {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:01:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4b6c6657-58ac-48a9-8100-6e2cc2cf6b37 tempest-VolumesGetTest-421307961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4b6c6657-58ac-48a9-8100-6e2cc2cf6b37 tempest-VolumesGetTest-421307961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:51 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4b6c6657-58ac-48a9-8100-6e2cc2cf6b37 tempest-VolumesGetTest-421307961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:01:51 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4b6c6657-58ac-48a9-8100-6e2cc2cf6b37 tempest-VolumesGetTest-421307961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:01:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4b6c6657-58ac-48a9-8100-6e2cc2cf6b37 tempest-VolumesGetTest-421307961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:51 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4b6c6657-58ac-48a9-8100-6e2cc2cf6b37 tempest-VolumesGetTest-421307961 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:01:51 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-4b6c6657-58ac-48a9-8100-6e2cc2cf6b37 tempest-VolumesGetTest-421307961 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:01:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4b6c6657-58ac-48a9-8100-6e2cc2cf6b37 tempest-VolumesGetTest-421307961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8dccf06-18e7-4c91-96d6-0153d65af03c 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:51 devstack sudo[99382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8dccf06-18e7-4c91-96d6-0153d65af03c 1073741824 Sep 28 15:01:51 devstack sudo[99382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:51 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-621b69f2-5120-4a2d-8877-90c90d46b151 tempest-SnapshotMetadataTestJSON-2003214858 None] Created reservations ['d682de5c-f782-4335-ae2e-78a960f53d4b', '77023fa7-1060-4c9b-98f0-f370dbbf6c24', 'd01d319d-b67d-4b86-8453-4b73cff9580a', '177c6e96-36f4-41d1-ac7a-46b4746cc751'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:01:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-621b69f2-5120-4a2d-8877-90c90d46b151 tempest-SnapshotMetadataTestJSON-2003214858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-621b69f2-5120-4a2d-8877-90c90d46b151 tempest-SnapshotMetadataTestJSON-2003214858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:51 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-621b69f2-5120-4a2d-8877-90c90d46b151 tempest-SnapshotMetadataTestJSON-2003214858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:01:51 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-621b69f2-5120-4a2d-8877-90c90d46b151 tempest-SnapshotMetadataTestJSON-2003214858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:01:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-621b69f2-5120-4a2d-8877-90c90d46b151 tempest-SnapshotMetadataTestJSON-2003214858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-621b69f2-5120-4a2d-8877-90c90d46b151 tempest-SnapshotMetadataTestJSON-2003214858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:51 devstack sudo[99384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:01:51 devstack sudo[99384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:51 devstack sudo[99384]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-621b69f2-5120-4a2d-8877-90c90d46b151 tempest-SnapshotMetadataTestJSON-2003214858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.460s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:51 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-621b69f2-5120-4a2d-8877-90c90d46b151 tempest-SnapshotMetadataTestJSON-2003214858 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:01:51 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-621b69f2-5120-4a2d-8877-90c90d46b151 tempest-SnapshotMetadataTestJSON-2003214858 None] Deleted volume successfully. Sep 28 15:01:51 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-621b69f2-5120-4a2d-8877-90c90d46b151 tempest-SnapshotMetadataTestJSON-2003214858 None] Lock "cinder-e3ca6f06-33f6-42f5-b8c0-685202b76085-delete_volume" released by "delete_volume" :: held 2.266s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:01:51 devstack sudo[99382]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4b6c6657-58ac-48a9-8100-6e2cc2cf6b37 tempest-VolumesGetTest-421307961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8dccf06-18e7-4c91-96d6-0153d65af03c 1073741824" returned: 0 in 0.892s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4b6c6657-58ac-48a9-8100-6e2cc2cf6b37 tempest-VolumesGetTest-421307961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8dccf06-18e7-4c91-96d6-0153d65af03c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:52 devstack sudo[99391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8dccf06-18e7-4c91-96d6-0153d65af03c Sep 28 15:01:52 devstack sudo[99391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:52 devstack sudo[99391]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4b6c6657-58ac-48a9-8100-6e2cc2cf6b37 tempest-VolumesGetTest-421307961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8dccf06-18e7-4c91-96d6-0153d65af03c" returned: 0 in 0.456s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4b6c6657-58ac-48a9-8100-6e2cc2cf6b37 tempest-VolumesGetTest-421307961 None] <== create_volume: return (1460ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:01:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4b6c6657-58ac-48a9-8100-6e2cc2cf6b37 tempest-VolumesGetTest-421307961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.464s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4b6c6657-58ac-48a9-8100-6e2cc2cf6b37 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (642c0c52-6569-4aa9-a80c-0231904da077) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8dccf06-18e7-4c91-96d6-0153d65af03c', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4b6c6657-58ac-48a9-8100-6e2cc2cf6b37 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6934becd-0baf-4a66-bd60-419a6c93d19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:52 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-4b6c6657-58ac-48a9-8100-6e2cc2cf6b37 tempest-VolumesGetTest-421307961 None] Volume volume-f8dccf06-18e7-4c91-96d6-0153d65af03c (f8dccf06-18e7-4c91-96d6-0153d65af03c): created successfully Sep 28 15:01:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4b6c6657-58ac-48a9-8100-6e2cc2cf6b37 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6934becd-0baf-4a66-bd60-419a6c93d19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4b6c6657-58ac-48a9-8100-6e2cc2cf6b37 tempest-VolumesGetTest-421307961 None] Flow 'volume_create_manager' (0ec154a2-eb5d-4d80-8e7a-ea8c5f389876) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:01:52 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-4b6c6657-58ac-48a9-8100-6e2cc2cf6b37 tempest-VolumesGetTest-421307961 None] Created volume successfully. Sep 28 15:01:54 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-007569dd-9393-4952-a90f-f660a00552d3 tempest-VolumesListAdminTestJSON-1591565788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:01:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-007569dd-9393-4952-a90f-f660a00552d3 tempest-VolumesListAdminTestJSON-1591565788 None] Flow 'volume_create_manager' (bc92339b-6dbf-4ad6-982c-545209429ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:01:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-007569dd-9393-4952-a90f-f660a00552d3 tempest-VolumesListAdminTestJSON-1591565788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46250808-ae84-4799-8a0e-366f2f606b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-007569dd-9393-4952-a90f-f660a00552d3 tempest-VolumesListAdminTestJSON-1591565788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46250808-ae84-4799-8a0e-366f2f606b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:01:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-291019817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02a6df8b-b419-4489-9b25-3dd3e74692a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de2f910acb3646c298ff66f81de37bc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:01:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:01:54Z,use_quota=True,user_id='fbf72ef5b1a446ad9dcd572f3a7336cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-007569dd-9393-4952-a90f-f660a00552d3 tempest-VolumesListAdminTestJSON-1591565788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6164a71-7b69-491b-bdce-914d7f59f8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-007569dd-9393-4952-a90f-f660a00552d3 tempest-VolumesListAdminTestJSON-1591565788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6164a71-7b69-491b-bdce-914d7f59f8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-007569dd-9393-4952-a90f-f660a00552d3 tempest-VolumesListAdminTestJSON-1591565788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87702884-566e-42da-96dc-2f8f78a15edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-007569dd-9393-4952-a90f-f660a00552d3 tempest-VolumesListAdminTestJSON-1591565788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87702884-566e-42da-96dc-2f8f78a15edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02a6df8b-b419-4489-9b25-3dd3e74692a6', 'volume_name': 'volume-02a6df8b-b419-4489-9b25-3dd3e74692a6', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-007569dd-9393-4952-a90f-f660a00552d3 tempest-VolumesListAdminTestJSON-1591565788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea88c386-1b40-4913-a019-db158e5ddbde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-007569dd-9393-4952-a90f-f660a00552d3 tempest-VolumesListAdminTestJSON-1591565788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea88c386-1b40-4913-a019-db158e5ddbde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-007569dd-9393-4952-a90f-f660a00552d3 tempest-VolumesListAdminTestJSON-1591565788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8caaf914-9c63-49f0-bbe6-7c9f056c08c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:54 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-007569dd-9393-4952-a90f-f660a00552d3 tempest-VolumesListAdminTestJSON-1591565788 None] Volume 02a6df8b-b419-4489-9b25-3dd3e74692a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02a6df8b-b419-4489-9b25-3dd3e74692a6', 'volume_size': 1} Sep 28 15:01:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-007569dd-9393-4952-a90f-f660a00552d3 tempest-VolumesListAdminTestJSON-1591565788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-007569dd-9393-4952-a90f-f660a00552d3 tempest-VolumesListAdminTestJSON-1591565788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:54 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-007569dd-9393-4952-a90f-f660a00552d3 tempest-VolumesListAdminTestJSON-1591565788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:01:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-291019817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02a6df8b-b419-4489-9b25-3dd3e74692a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de2f910acb3646c298ff66f81de37bc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:01:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:01:54Z,use_quota=True,user_id='fbf72ef5b1a446ad9dcd572f3a7336cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:01:54 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-007569dd-9393-4952-a90f-f660a00552d3 tempest-VolumesListAdminTestJSON-1591565788 None] Creating volume 02a6df8b-b419-4489-9b25-3dd3e74692a6 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:01:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-007569dd-9393-4952-a90f-f660a00552d3 tempest-VolumesListAdminTestJSON-1591565788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-007569dd-9393-4952-a90f-f660a00552d3 tempest-VolumesListAdminTestJSON-1591565788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:54 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-007569dd-9393-4952-a90f-f660a00552d3 tempest-VolumesListAdminTestJSON-1591565788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:01:54 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-007569dd-9393-4952-a90f-f660a00552d3 tempest-VolumesListAdminTestJSON-1591565788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:01:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-007569dd-9393-4952-a90f-f660a00552d3 tempest-VolumesListAdminTestJSON-1591565788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:54 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-007569dd-9393-4952-a90f-f660a00552d3 tempest-VolumesListAdminTestJSON-1591565788 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:01:54 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-007569dd-9393-4952-a90f-f660a00552d3 tempest-VolumesListAdminTestJSON-1591565788 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:01:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-007569dd-9393-4952-a90f-f660a00552d3 tempest-VolumesListAdminTestJSON-1591565788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-02a6df8b-b419-4489-9b25-3dd3e74692a6 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:54 devstack sudo[99412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-02a6df8b-b419-4489-9b25-3dd3e74692a6 1073741824 Sep 28 15:01:54 devstack sudo[99412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:54 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-74c3aa20-d44d-4ea3-a249-0d3371175671 tempest-VolumesGetTest-421307961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:01:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-74c3aa20-d44d-4ea3-a249-0d3371175671 tempest-VolumesGetTest-421307961 None] Flow 'volume_create_manager' (701f0c2e-3e5b-4fe4-95ab-a0bc7c757e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:01:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-74c3aa20-d44d-4ea3-a249-0d3371175671 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abeb7e5e-002f-461d-973f-33a63d6f8ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-74c3aa20-d44d-4ea3-a249-0d3371175671 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abeb7e5e-002f-461d-973f-33a63d6f8ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:01:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-153362536',display_name='tempest-VolumesGetTest-Volume-220379934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9e796fd-49bb-4b9d-9254-a6a2066a3fee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faba40f947cd4221a56196fd85c2337f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:01:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:01:55Z,use_quota=True,user_id='91ba074109b045f1a62611658fb66015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-74c3aa20-d44d-4ea3-a249-0d3371175671 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14eac751-465f-45b3-834b-e0a5ca050a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-74c3aa20-d44d-4ea3-a249-0d3371175671 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14eac751-465f-45b3-834b-e0a5ca050a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-74c3aa20-d44d-4ea3-a249-0d3371175671 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feeff580-2356-4661-aaf0-16402fd42223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-74c3aa20-d44d-4ea3-a249-0d3371175671 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feeff580-2356-4661-aaf0-16402fd42223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9e796fd-49bb-4b9d-9254-a6a2066a3fee', 'volume_name': 'volume-e9e796fd-49bb-4b9d-9254-a6a2066a3fee', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-74c3aa20-d44d-4ea3-a249-0d3371175671 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e9a8c73-1002-4731-8bb7-aab875172ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-74c3aa20-d44d-4ea3-a249-0d3371175671 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e9a8c73-1002-4731-8bb7-aab875172ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-74c3aa20-d44d-4ea3-a249-0d3371175671 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d61aad8-2405-4d35-9ebe-0b069db95a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:54 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-74c3aa20-d44d-4ea3-a249-0d3371175671 tempest-VolumesGetTest-421307961 None] Volume e9e796fd-49bb-4b9d-9254-a6a2066a3fee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9e796fd-49bb-4b9d-9254-a6a2066a3fee', 'volume_size': 1} Sep 28 15:01:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-74c3aa20-d44d-4ea3-a249-0d3371175671 tempest-VolumesGetTest-421307961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:55 devstack sudo[99412]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-007569dd-9393-4952-a90f-f660a00552d3 tempest-VolumesListAdminTestJSON-1591565788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-02a6df8b-b419-4489-9b25-3dd3e74692a6 1073741824" returned: 0 in 0.738s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-007569dd-9393-4952-a90f-f660a00552d3 tempest-VolumesListAdminTestJSON-1591565788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-02a6df8b-b419-4489-9b25-3dd3e74692a6 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:55 devstack sudo[99418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-02a6df8b-b419-4489-9b25-3dd3e74692a6 Sep 28 15:01:55 devstack sudo[99418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:55 devstack sudo[99418]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-007569dd-9393-4952-a90f-f660a00552d3 tempest-VolumesListAdminTestJSON-1591565788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-02a6df8b-b419-4489-9b25-3dd3e74692a6" returned: 0 in 0.315s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:55 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-007569dd-9393-4952-a90f-f660a00552d3 tempest-VolumesListAdminTestJSON-1591565788 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:01:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-007569dd-9393-4952-a90f-f660a00552d3 tempest-VolumesListAdminTestJSON-1591565788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-74c3aa20-d44d-4ea3-a249-0d3371175671 tempest-VolumesGetTest-421307961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.621s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:55 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-74c3aa20-d44d-4ea3-a249-0d3371175671 tempest-VolumesGetTest-421307961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:01:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-153362536',display_name='tempest-VolumesGetTest-Volume-220379934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9e796fd-49bb-4b9d-9254-a6a2066a3fee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faba40f947cd4221a56196fd85c2337f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:01:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:01:55Z,use_quota=True,user_id='91ba074109b045f1a62611658fb66015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:01:55 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-74c3aa20-d44d-4ea3-a249-0d3371175671 tempest-VolumesGetTest-421307961 None] Creating volume e9e796fd-49bb-4b9d-9254-a6a2066a3fee {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:01:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-74c3aa20-d44d-4ea3-a249-0d3371175671 tempest-VolumesGetTest-421307961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-74c3aa20-d44d-4ea3-a249-0d3371175671 tempest-VolumesGetTest-421307961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:55 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-74c3aa20-d44d-4ea3-a249-0d3371175671 tempest-VolumesGetTest-421307961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:01:55 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-74c3aa20-d44d-4ea3-a249-0d3371175671 tempest-VolumesGetTest-421307961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:01:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-74c3aa20-d44d-4ea3-a249-0d3371175671 tempest-VolumesGetTest-421307961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:55 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-74c3aa20-d44d-4ea3-a249-0d3371175671 tempest-VolumesGetTest-421307961 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:01:55 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-74c3aa20-d44d-4ea3-a249-0d3371175671 tempest-VolumesGetTest-421307961 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:01:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-74c3aa20-d44d-4ea3-a249-0d3371175671 tempest-VolumesGetTest-421307961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e9e796fd-49bb-4b9d-9254-a6a2066a3fee 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:55 devstack sudo[99422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e9e796fd-49bb-4b9d-9254-a6a2066a3fee 1073741824 Sep 28 15:01:55 devstack sudo[99422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:55 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-007569dd-9393-4952-a90f-f660a00552d3 tempest-VolumesListAdminTestJSON-1591565788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8caaf914-9c63-49f0-bbe6-7c9f056c08c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02a6df8b-b419-4489-9b25-3dd3e74692a6', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:55 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-007569dd-9393-4952-a90f-f660a00552d3 tempest-VolumesListAdminTestJSON-1591565788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (039fadbc-8d1a-4a7c-beac-d9b44e23876d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:55 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-007569dd-9393-4952-a90f-f660a00552d3 tempest-VolumesListAdminTestJSON-1591565788 None] Volume volume-02a6df8b-b419-4489-9b25-3dd3e74692a6 (02a6df8b-b419-4489-9b25-3dd3e74692a6): created successfully Sep 28 15:01:55 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-007569dd-9393-4952-a90f-f660a00552d3 tempest-VolumesListAdminTestJSON-1591565788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (039fadbc-8d1a-4a7c-beac-d9b44e23876d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:55 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-007569dd-9393-4952-a90f-f660a00552d3 tempest-VolumesListAdminTestJSON-1591565788 None] Flow 'volume_create_manager' (bc92339b-6dbf-4ad6-982c-545209429ca4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:01:55 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-007569dd-9393-4952-a90f-f660a00552d3 tempest-VolumesListAdminTestJSON-1591565788 None] Created volume successfully. Sep 28 15:01:56 devstack sudo[99422]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-74c3aa20-d44d-4ea3-a249-0d3371175671 tempest-VolumesGetTest-421307961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e9e796fd-49bb-4b9d-9254-a6a2066a3fee 1073741824" returned: 0 in 0.849s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-74c3aa20-d44d-4ea3-a249-0d3371175671 tempest-VolumesGetTest-421307961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e9e796fd-49bb-4b9d-9254-a6a2066a3fee {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:56 devstack sudo[99456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e9e796fd-49bb-4b9d-9254-a6a2066a3fee Sep 28 15:01:56 devstack sudo[99456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:57 devstack sudo[99456]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-74c3aa20-d44d-4ea3-a249-0d3371175671 tempest-VolumesGetTest-421307961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e9e796fd-49bb-4b9d-9254-a6a2066a3fee" returned: 0 in 0.522s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-74c3aa20-d44d-4ea3-a249-0d3371175671 tempest-VolumesGetTest-421307961 None] <== create_volume: return (1470ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:01:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-74c3aa20-d44d-4ea3-a249-0d3371175671 tempest-VolumesGetTest-421307961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.473s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-74c3aa20-d44d-4ea3-a249-0d3371175671 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d61aad8-2405-4d35-9ebe-0b069db95a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9e796fd-49bb-4b9d-9254-a6a2066a3fee', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-74c3aa20-d44d-4ea3-a249-0d3371175671 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff53c68b-962c-4bf8-b4a9-cbc4baa71296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:57 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-74c3aa20-d44d-4ea3-a249-0d3371175671 tempest-VolumesGetTest-421307961 None] Volume volume-e9e796fd-49bb-4b9d-9254-a6a2066a3fee (e9e796fd-49bb-4b9d-9254-a6a2066a3fee): created successfully Sep 28 15:01:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-74c3aa20-d44d-4ea3-a249-0d3371175671 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff53c68b-962c-4bf8-b4a9-cbc4baa71296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-74c3aa20-d44d-4ea3-a249-0d3371175671 tempest-VolumesGetTest-421307961 None] Flow 'volume_create_manager' (701f0c2e-3e5b-4fe4-95ab-a0bc7c757e94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:01:57 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-74c3aa20-d44d-4ea3-a249-0d3371175671 tempest-VolumesGetTest-421307961 None] Created volume successfully. Sep 28 15:01:57 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-cda1a113-88b4-4323-849c-d909249934f9 tempest-VolumesListAdminTestJSON-1591565788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:01:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-cda1a113-88b4-4323-849c-d909249934f9 tempest-VolumesListAdminTestJSON-1591565788 None] Flow 'volume_create_manager' (6975aa34-fd26-4176-990a-b15d6a4e8a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:01:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-cda1a113-88b4-4323-849c-d909249934f9 tempest-VolumesListAdminTestJSON-1591565788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f375ec7c-e572-41c9-9c76-6ad3c5538279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-cda1a113-88b4-4323-849c-d909249934f9 tempest-VolumesListAdminTestJSON-1591565788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f375ec7c-e572-41c9-9c76-6ad3c5538279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:01:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1138413995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c243a837-58c1-405b-bfba-b8312e356200,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de2f910acb3646c298ff66f81de37bc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:01:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:01:58Z,use_quota=True,user_id='fbf72ef5b1a446ad9dcd572f3a7336cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-cda1a113-88b4-4323-849c-d909249934f9 tempest-VolumesListAdminTestJSON-1591565788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9633cdcd-e343-46a0-bff6-20a9f842caa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-cda1a113-88b4-4323-849c-d909249934f9 tempest-VolumesListAdminTestJSON-1591565788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9633cdcd-e343-46a0-bff6-20a9f842caa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-cda1a113-88b4-4323-849c-d909249934f9 tempest-VolumesListAdminTestJSON-1591565788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0496bd73-7934-4dca-a436-a2306a69ec81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-cda1a113-88b4-4323-849c-d909249934f9 tempest-VolumesListAdminTestJSON-1591565788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0496bd73-7934-4dca-a436-a2306a69ec81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c243a837-58c1-405b-bfba-b8312e356200', 'volume_name': 'volume-c243a837-58c1-405b-bfba-b8312e356200', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-cda1a113-88b4-4323-849c-d909249934f9 tempest-VolumesListAdminTestJSON-1591565788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (766c3394-7a49-4f2c-b409-547995587b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-cda1a113-88b4-4323-849c-d909249934f9 tempest-VolumesListAdminTestJSON-1591565788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (766c3394-7a49-4f2c-b409-547995587b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-cda1a113-88b4-4323-849c-d909249934f9 tempest-VolumesListAdminTestJSON-1591565788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e941cee2-e760-4897-9b09-95700ce80105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:57 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-cda1a113-88b4-4323-849c-d909249934f9 tempest-VolumesListAdminTestJSON-1591565788 None] Volume c243a837-58c1-405b-bfba-b8312e356200: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c243a837-58c1-405b-bfba-b8312e356200', 'volume_size': 1} Sep 28 15:01:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-cda1a113-88b4-4323-849c-d909249934f9 tempest-VolumesListAdminTestJSON-1591565788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-cda1a113-88b4-4323-849c-d909249934f9 tempest-VolumesListAdminTestJSON-1591565788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-cda1a113-88b4-4323-849c-d909249934f9 tempest-VolumesListAdminTestJSON-1591565788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:01:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1138413995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c243a837-58c1-405b-bfba-b8312e356200,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de2f910acb3646c298ff66f81de37bc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:01:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:01:58Z,use_quota=True,user_id='fbf72ef5b1a446ad9dcd572f3a7336cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:01:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-cda1a113-88b4-4323-849c-d909249934f9 tempest-VolumesListAdminTestJSON-1591565788 None] Creating volume c243a837-58c1-405b-bfba-b8312e356200 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:01:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-cda1a113-88b4-4323-849c-d909249934f9 tempest-VolumesListAdminTestJSON-1591565788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-cda1a113-88b4-4323-849c-d909249934f9 tempest-VolumesListAdminTestJSON-1591565788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-cda1a113-88b4-4323-849c-d909249934f9 tempest-VolumesListAdminTestJSON-1591565788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:01:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-cda1a113-88b4-4323-849c-d909249934f9 tempest-VolumesListAdminTestJSON-1591565788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:01:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-cda1a113-88b4-4323-849c-d909249934f9 tempest-VolumesListAdminTestJSON-1591565788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-cda1a113-88b4-4323-849c-d909249934f9 tempest-VolumesListAdminTestJSON-1591565788 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:01:57 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-cda1a113-88b4-4323-849c-d909249934f9 tempest-VolumesListAdminTestJSON-1591565788 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:01:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cda1a113-88b4-4323-849c-d909249934f9 tempest-VolumesListAdminTestJSON-1591565788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c243a837-58c1-405b-bfba-b8312e356200 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:57 devstack sudo[99509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c243a837-58c1-405b-bfba-b8312e356200 1073741824 Sep 28 15:01:57 devstack sudo[99509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:58 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-be8e91d4-1bd6-4415-9fa8-ccab015a0586 tempest-VolumesGetTest-421307961 None] Acquiring lock "cinder-e9e796fd-49bb-4b9d-9254-a6a2066a3fee-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:01:58 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-be8e91d4-1bd6-4415-9fa8-ccab015a0586 tempest-VolumesGetTest-421307961 None] Lock "cinder-e9e796fd-49bb-4b9d-9254-a6a2066a3fee-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:01:58 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-be8e91d4-1bd6-4415-9fa8-ccab015a0586 tempest-VolumesGetTest-421307961 None] Acquiring lock "cinder-quobyte-e9e796fd-49bb-4b9d-9254-a6a2066a3fee" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:01:58 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-be8e91d4-1bd6-4415-9fa8-ccab015a0586 tempest-VolumesGetTest-421307961 None] Lock "cinder-quobyte-e9e796fd-49bb-4b9d-9254-a6a2066a3fee" acquired by "delete_volume" :: waited 0.039s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:01:58 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c8d5a8-81c2-4f9d-9ffd-b229ddbe375f]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:01:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-be8e91d4-1bd6-4415-9fa8-ccab015a0586 tempest-VolumesGetTest-421307961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e9e796fd-49bb-4b9d-9254-a6a2066a3fee {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:58 devstack sudo[99509]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cda1a113-88b4-4323-849c-d909249934f9 tempest-VolumesListAdminTestJSON-1591565788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c243a837-58c1-405b-bfba-b8312e356200 1073741824" returned: 0 in 0.740s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:58 devstack sudo[99517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e9e796fd-49bb-4b9d-9254-a6a2066a3fee Sep 28 15:01:58 devstack sudo[99517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cda1a113-88b4-4323-849c-d909249934f9 tempest-VolumesListAdminTestJSON-1591565788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c243a837-58c1-405b-bfba-b8312e356200 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:58 devstack sudo[99519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c243a837-58c1-405b-bfba-b8312e356200 Sep 28 15:01:58 devstack sudo[99519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:59 devstack sudo[99519]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cda1a113-88b4-4323-849c-d909249934f9 tempest-VolumesListAdminTestJSON-1591565788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c243a837-58c1-405b-bfba-b8312e356200" returned: 0 in 0.287s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-cda1a113-88b4-4323-849c-d909249934f9 tempest-VolumesListAdminTestJSON-1591565788 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:01:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-cda1a113-88b4-4323-849c-d909249934f9 tempest-VolumesListAdminTestJSON-1591565788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:59 devstack sudo[99517]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-cda1a113-88b4-4323-849c-d909249934f9 tempest-VolumesListAdminTestJSON-1591565788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e941cee2-e760-4897-9b09-95700ce80105) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c243a837-58c1-405b-bfba-b8312e356200', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-cda1a113-88b4-4323-849c-d909249934f9 tempest-VolumesListAdminTestJSON-1591565788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5977eaf3-f4ff-4bd7-bb42-8872c7a122c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-be8e91d4-1bd6-4415-9fa8-ccab015a0586 tempest-VolumesGetTest-421307961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e9e796fd-49bb-4b9d-9254-a6a2066a3fee" returned: 0 in 0.508s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-be8e91d4-1bd6-4415-9fa8-ccab015a0586 tempest-VolumesGetTest-421307961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e9e796fd-49bb-4b9d-9254-a6a2066a3fee {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:59 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-cda1a113-88b4-4323-849c-d909249934f9 tempest-VolumesListAdminTestJSON-1591565788 None] Volume volume-c243a837-58c1-405b-bfba-b8312e356200 (c243a837-58c1-405b-bfba-b8312e356200): created successfully Sep 28 15:01:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-cda1a113-88b4-4323-849c-d909249934f9 tempest-VolumesListAdminTestJSON-1591565788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5977eaf3-f4ff-4bd7-bb42-8872c7a122c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:59 devstack sudo[99526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e9e796fd-49bb-4b9d-9254-a6a2066a3fee Sep 28 15:01:59 devstack sudo[99526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-cda1a113-88b4-4323-849c-d909249934f9 tempest-VolumesListAdminTestJSON-1591565788 None] Flow 'volume_create_manager' (6975aa34-fd26-4176-990a-b15d6a4e8a40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:01:59 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-cda1a113-88b4-4323-849c-d909249934f9 tempest-VolumesListAdminTestJSON-1591565788 None] Created volume successfully. Sep 28 15:01:59 devstack sudo[99526]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-be8e91d4-1bd6-4415-9fa8-ccab015a0586 tempest-VolumesGetTest-421307961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e9e796fd-49bb-4b9d-9254-a6a2066a3fee" returned: 0 in 0.360s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:59 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-be8e91d4-1bd6-4415-9fa8-ccab015a0586 tempest-VolumesGetTest-421307961 None] Lock "cinder-quobyte-e9e796fd-49bb-4b9d-9254-a6a2066a3fee" released by "delete_volume" :: held 0.961s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:01:59 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-be8e91d4-1bd6-4415-9fa8-ccab015a0586 tempest-VolumesGetTest-421307961 None] Created reservations ['6059e750-db9c-4915-a529-74be47a46ffd', '2af0c63c-6a14-467e-a9b1-1a5bca97b282', '474f69cd-cab6-4a71-97f8-c511934a8e92', '5861843e-91f7-440f-ae09-a80757333b02'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:01:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-be8e91d4-1bd6-4415-9fa8-ccab015a0586 tempest-VolumesGetTest-421307961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-be8e91d4-1bd6-4415-9fa8-ccab015a0586 tempest-VolumesGetTest-421307961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-be8e91d4-1bd6-4415-9fa8-ccab015a0586 tempest-VolumesGetTest-421307961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:01:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-be8e91d4-1bd6-4415-9fa8-ccab015a0586 tempest-VolumesGetTest-421307961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:01:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-be8e91d4-1bd6-4415-9fa8-ccab015a0586 tempest-VolumesGetTest-421307961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-be8e91d4-1bd6-4415-9fa8-ccab015a0586 tempest-VolumesGetTest-421307961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:59 devstack sudo[99531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:01:59 devstack sudo[99531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:00 devstack sudo[99531]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-be8e91d4-1bd6-4415-9fa8-ccab015a0586 tempest-VolumesGetTest-421307961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.510s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:00 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-be8e91d4-1bd6-4415-9fa8-ccab015a0586 tempest-VolumesGetTest-421307961 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:02:00 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-be8e91d4-1bd6-4415-9fa8-ccab015a0586 tempest-VolumesGetTest-421307961 None] Deleted volume successfully. Sep 28 15:02:00 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-be8e91d4-1bd6-4415-9fa8-ccab015a0586 tempest-VolumesGetTest-421307961 None] Lock "cinder-e9e796fd-49bb-4b9d-9254-a6a2066a3fee-delete_volume" released by "delete_volume" :: held 2.091s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:02:00 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bb78548-367c-440c-a767-0499339d59a9 tempest-VolumesListAdminTestJSON-1591565788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:02:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3bb78548-367c-440c-a767-0499339d59a9 tempest-VolumesListAdminTestJSON-1591565788 None] Flow 'volume_create_manager' (5dd261b8-1f24-4f65-88a0-278790f4dbcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:02:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3bb78548-367c-440c-a767-0499339d59a9 tempest-VolumesListAdminTestJSON-1591565788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57afbceb-7a51-44e4-8602-14dec57947ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3bb78548-367c-440c-a767-0499339d59a9 tempest-VolumesListAdminTestJSON-1591565788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57afbceb-7a51-44e4-8602-14dec57947ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:02:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1739176433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f6d55cd-fcc8-4817-80f5-b737b5a23d97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de2f910acb3646c298ff66f81de37bc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:02:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:02:01Z,use_quota=True,user_id='fbf72ef5b1a446ad9dcd572f3a7336cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3bb78548-367c-440c-a767-0499339d59a9 tempest-VolumesListAdminTestJSON-1591565788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55305191-4152-4e57-bc3a-00b5dceb6aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3bb78548-367c-440c-a767-0499339d59a9 tempest-VolumesListAdminTestJSON-1591565788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55305191-4152-4e57-bc3a-00b5dceb6aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3bb78548-367c-440c-a767-0499339d59a9 tempest-VolumesListAdminTestJSON-1591565788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fe35dd5-bac9-4cd3-b5b6-f3eec0a7ec61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3bb78548-367c-440c-a767-0499339d59a9 tempest-VolumesListAdminTestJSON-1591565788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fe35dd5-bac9-4cd3-b5b6-f3eec0a7ec61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f6d55cd-fcc8-4817-80f5-b737b5a23d97', 'volume_name': 'volume-5f6d55cd-fcc8-4817-80f5-b737b5a23d97', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3bb78548-367c-440c-a767-0499339d59a9 tempest-VolumesListAdminTestJSON-1591565788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3db4be76-4b8c-44b1-9e4b-e699183e4af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3bb78548-367c-440c-a767-0499339d59a9 tempest-VolumesListAdminTestJSON-1591565788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3db4be76-4b8c-44b1-9e4b-e699183e4af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3bb78548-367c-440c-a767-0499339d59a9 tempest-VolumesListAdminTestJSON-1591565788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbd9691e-5639-4429-8ec5-92fd6f1bdcbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:01 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-3bb78548-367c-440c-a767-0499339d59a9 tempest-VolumesListAdminTestJSON-1591565788 None] Volume 5f6d55cd-fcc8-4817-80f5-b737b5a23d97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f6d55cd-fcc8-4817-80f5-b737b5a23d97', 'volume_size': 1} Sep 28 15:02:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3bb78548-367c-440c-a767-0499339d59a9 tempest-VolumesListAdminTestJSON-1591565788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3bb78548-367c-440c-a767-0499339d59a9 tempest-VolumesListAdminTestJSON-1591565788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3bb78548-367c-440c-a767-0499339d59a9 tempest-VolumesListAdminTestJSON-1591565788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:02:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1739176433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f6d55cd-fcc8-4817-80f5-b737b5a23d97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de2f910acb3646c298ff66f81de37bc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:02:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:02:01Z,use_quota=True,user_id='fbf72ef5b1a446ad9dcd572f3a7336cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:02:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-3bb78548-367c-440c-a767-0499339d59a9 tempest-VolumesListAdminTestJSON-1591565788 None] Creating volume 5f6d55cd-fcc8-4817-80f5-b737b5a23d97 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:02:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3bb78548-367c-440c-a767-0499339d59a9 tempest-VolumesListAdminTestJSON-1591565788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3bb78548-367c-440c-a767-0499339d59a9 tempest-VolumesListAdminTestJSON-1591565788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3bb78548-367c-440c-a767-0499339d59a9 tempest-VolumesListAdminTestJSON-1591565788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:02:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3bb78548-367c-440c-a767-0499339d59a9 tempest-VolumesListAdminTestJSON-1591565788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:02:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3bb78548-367c-440c-a767-0499339d59a9 tempest-VolumesListAdminTestJSON-1591565788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3bb78548-367c-440c-a767-0499339d59a9 tempest-VolumesListAdminTestJSON-1591565788 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:02:01 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-3bb78548-367c-440c-a767-0499339d59a9 tempest-VolumesListAdminTestJSON-1591565788 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:02:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3bb78548-367c-440c-a767-0499339d59a9 tempest-VolumesListAdminTestJSON-1591565788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5f6d55cd-fcc8-4817-80f5-b737b5a23d97 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:01 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0e5576dd-72cb-4c8a-9367-29c34eed3ebb tempest-VolumesGetTest-421307961 None] Acquiring lock "cinder-f8dccf06-18e7-4c91-96d6-0153d65af03c-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:02:01 devstack sudo[99535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5f6d55cd-fcc8-4817-80f5-b737b5a23d97 1073741824 Sep 28 15:02:01 devstack sudo[99535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:01 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0e5576dd-72cb-4c8a-9367-29c34eed3ebb tempest-VolumesGetTest-421307961 None] Lock "cinder-f8dccf06-18e7-4c91-96d6-0153d65af03c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:02:01 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0e5576dd-72cb-4c8a-9367-29c34eed3ebb tempest-VolumesGetTest-421307961 None] Acquiring lock "cinder-quobyte-f8dccf06-18e7-4c91-96d6-0153d65af03c" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:02:01 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0e5576dd-72cb-4c8a-9367-29c34eed3ebb tempest-VolumesGetTest-421307961 None] Lock "cinder-quobyte-f8dccf06-18e7-4c91-96d6-0153d65af03c" acquired by "delete_volume" :: waited 0.026s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:02:01 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a17a2f-3263-49ed-995d-b3fa55ae9bb6]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0e5576dd-72cb-4c8a-9367-29c34eed3ebb tempest-VolumesGetTest-421307961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8dccf06-18e7-4c91-96d6-0153d65af03c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:01 devstack sudo[99537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8dccf06-18e7-4c91-96d6-0153d65af03c Sep 28 15:02:01 devstack sudo[99537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:02 devstack sudo[99535]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3bb78548-367c-440c-a767-0499339d59a9 tempest-VolumesListAdminTestJSON-1591565788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5f6d55cd-fcc8-4817-80f5-b737b5a23d97 1073741824" returned: 0 in 0.980s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:02 devstack sudo[99537]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0e5576dd-72cb-4c8a-9367-29c34eed3ebb tempest-VolumesGetTest-421307961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8dccf06-18e7-4c91-96d6-0153d65af03c" returned: 0 in 0.777s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0e5576dd-72cb-4c8a-9367-29c34eed3ebb tempest-VolumesGetTest-421307961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8dccf06-18e7-4c91-96d6-0153d65af03c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:02 devstack sudo[99545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8dccf06-18e7-4c91-96d6-0153d65af03c Sep 28 15:02:02 devstack sudo[99545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3bb78548-367c-440c-a767-0499339d59a9 tempest-VolumesListAdminTestJSON-1591565788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5f6d55cd-fcc8-4817-80f5-b737b5a23d97 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:02 devstack sudo[99547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5f6d55cd-fcc8-4817-80f5-b737b5a23d97 Sep 28 15:02:02 devstack sudo[99547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:02 devstack sudo[99545]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0e5576dd-72cb-4c8a-9367-29c34eed3ebb tempest-VolumesGetTest-421307961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8dccf06-18e7-4c91-96d6-0153d65af03c" returned: 0 in 0.490s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0e5576dd-72cb-4c8a-9367-29c34eed3ebb tempest-VolumesGetTest-421307961 None] Lock "cinder-quobyte-f8dccf06-18e7-4c91-96d6-0153d65af03c" released by "delete_volume" :: held 1.360s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:02:02 devstack sudo[99547]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3bb78548-367c-440c-a767-0499339d59a9 tempest-VolumesListAdminTestJSON-1591565788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5f6d55cd-fcc8-4817-80f5-b737b5a23d97" returned: 0 in 0.535s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3bb78548-367c-440c-a767-0499339d59a9 tempest-VolumesListAdminTestJSON-1591565788 None] <== create_volume: return (1645ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:02:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3bb78548-367c-440c-a767-0499339d59a9 tempest-VolumesListAdminTestJSON-1591565788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.648s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3bb78548-367c-440c-a767-0499339d59a9 tempest-VolumesListAdminTestJSON-1591565788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbd9691e-5639-4429-8ec5-92fd6f1bdcbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f6d55cd-fcc8-4817-80f5-b737b5a23d97', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3bb78548-367c-440c-a767-0499339d59a9 tempest-VolumesListAdminTestJSON-1591565788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95ef7894-57fe-4f63-a6e3-b361c7530cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:02 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-0e5576dd-72cb-4c8a-9367-29c34eed3ebb tempest-VolumesGetTest-421307961 None] Created reservations ['d4f2e7b7-15bb-441b-af79-ccdd1fb2416c', 'fa2f876f-70c5-4d91-8f28-ccd769336088', 'b713d52e-e1f1-49c4-b8f8-a1b3818bb039', 'ec641312-2f77-4230-927f-42b53d67c9dc'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:02:02 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-3bb78548-367c-440c-a767-0499339d59a9 tempest-VolumesListAdminTestJSON-1591565788 None] Volume volume-5f6d55cd-fcc8-4817-80f5-b737b5a23d97 (5f6d55cd-fcc8-4817-80f5-b737b5a23d97): created successfully Sep 28 15:02:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3bb78548-367c-440c-a767-0499339d59a9 tempest-VolumesListAdminTestJSON-1591565788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95ef7894-57fe-4f63-a6e3-b361c7530cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3bb78548-367c-440c-a767-0499339d59a9 tempest-VolumesListAdminTestJSON-1591565788 None] Flow 'volume_create_manager' (5dd261b8-1f24-4f65-88a0-278790f4dbcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:02:02 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-3bb78548-367c-440c-a767-0499339d59a9 tempest-VolumesListAdminTestJSON-1591565788 None] Created volume successfully. Sep 28 15:02:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0e5576dd-72cb-4c8a-9367-29c34eed3ebb tempest-VolumesGetTest-421307961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0e5576dd-72cb-4c8a-9367-29c34eed3ebb tempest-VolumesGetTest-421307961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0e5576dd-72cb-4c8a-9367-29c34eed3ebb tempest-VolumesGetTest-421307961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:02:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0e5576dd-72cb-4c8a-9367-29c34eed3ebb tempest-VolumesGetTest-421307961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:02:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0e5576dd-72cb-4c8a-9367-29c34eed3ebb tempest-VolumesGetTest-421307961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0e5576dd-72cb-4c8a-9367-29c34eed3ebb tempest-VolumesGetTest-421307961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:03 devstack sudo[99551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:02:03 devstack sudo[99551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:03 devstack sudo[99551]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0e5576dd-72cb-4c8a-9367-29c34eed3ebb tempest-VolumesGetTest-421307961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.561s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:03 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-0e5576dd-72cb-4c8a-9367-29c34eed3ebb tempest-VolumesGetTest-421307961 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:02:03 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-0e5576dd-72cb-4c8a-9367-29c34eed3ebb tempest-VolumesGetTest-421307961 None] Deleted volume successfully. Sep 28 15:02:03 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0e5576dd-72cb-4c8a-9367-29c34eed3ebb tempest-VolumesGetTest-421307961 None] Lock "cinder-f8dccf06-18e7-4c91-96d6-0153d65af03c-delete_volume" released by "delete_volume" :: held 2.523s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:02:04 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ca6ae67-9469-4366-9f44-16f4f502a1a1 tempest-VolumesGetTest-421307961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:02:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8ca6ae67-9469-4366-9f44-16f4f502a1a1 tempest-VolumesGetTest-421307961 None] Flow 'volume_create_manager' (8c789c6c-ad23-4b8a-ae72-3bf8de128ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:02:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8ca6ae67-9469-4366-9f44-16f4f502a1a1 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26da8e19-966c-4617-af0b-3cfede0c0f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8ca6ae67-9469-4366-9f44-16f4f502a1a1 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26da8e19-966c-4617-af0b-3cfede0c0f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-711211551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=368a8871-5bd5-411a-ad70-e95b7ebf296c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faba40f947cd4221a56196fd85c2337f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:02:04Z,use_quota=True,user_id='91ba074109b045f1a62611658fb66015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8ca6ae67-9469-4366-9f44-16f4f502a1a1 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f065b7f-bdda-4aac-a5d8-9355104d9293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8ca6ae67-9469-4366-9f44-16f4f502a1a1 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f065b7f-bdda-4aac-a5d8-9355104d9293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8ca6ae67-9469-4366-9f44-16f4f502a1a1 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d0a78e2-3cfd-448f-98b7-89001da6c390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8ca6ae67-9469-4366-9f44-16f4f502a1a1 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d0a78e2-3cfd-448f-98b7-89001da6c390) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '368a8871-5bd5-411a-ad70-e95b7ebf296c', 'volume_name': 'volume-368a8871-5bd5-411a-ad70-e95b7ebf296c', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8ca6ae67-9469-4366-9f44-16f4f502a1a1 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f715626e-81be-4ab5-9484-84d5b329b1ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8ca6ae67-9469-4366-9f44-16f4f502a1a1 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f715626e-81be-4ab5-9484-84d5b329b1ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8ca6ae67-9469-4366-9f44-16f4f502a1a1 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27d1f3f1-94a1-429e-beeb-b237c5fe20e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:04 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-8ca6ae67-9469-4366-9f44-16f4f502a1a1 tempest-VolumesGetTest-421307961 None] Volume 368a8871-5bd5-411a-ad70-e95b7ebf296c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-368a8871-5bd5-411a-ad70-e95b7ebf296c', 'volume_size': 1} Sep 28 15:02:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8ca6ae67-9469-4366-9f44-16f4f502a1a1 tempest-VolumesGetTest-421307961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8ca6ae67-9469-4366-9f44-16f4f502a1a1 tempest-VolumesGetTest-421307961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:04 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8ca6ae67-9469-4366-9f44-16f4f502a1a1 tempest-VolumesGetTest-421307961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-711211551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=368a8871-5bd5-411a-ad70-e95b7ebf296c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faba40f947cd4221a56196fd85c2337f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:02:04Z,use_quota=True,user_id='91ba074109b045f1a62611658fb66015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:02:04 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-8ca6ae67-9469-4366-9f44-16f4f502a1a1 tempest-VolumesGetTest-421307961 None] Creating volume 368a8871-5bd5-411a-ad70-e95b7ebf296c {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:02:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8ca6ae67-9469-4366-9f44-16f4f502a1a1 tempest-VolumesGetTest-421307961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8ca6ae67-9469-4366-9f44-16f4f502a1a1 tempest-VolumesGetTest-421307961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:04 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8ca6ae67-9469-4366-9f44-16f4f502a1a1 tempest-VolumesGetTest-421307961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:02:04 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8ca6ae67-9469-4366-9f44-16f4f502a1a1 tempest-VolumesGetTest-421307961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:02:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8ca6ae67-9469-4366-9f44-16f4f502a1a1 tempest-VolumesGetTest-421307961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:04 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8ca6ae67-9469-4366-9f44-16f4f502a1a1 tempest-VolumesGetTest-421307961 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:02:04 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-8ca6ae67-9469-4366-9f44-16f4f502a1a1 tempest-VolumesGetTest-421307961 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:02:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8ca6ae67-9469-4366-9f44-16f4f502a1a1 tempest-VolumesGetTest-421307961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-368a8871-5bd5-411a-ad70-e95b7ebf296c 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:04 devstack sudo[99557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-368a8871-5bd5-411a-ad70-e95b7ebf296c 1073741824 Sep 28 15:02:04 devstack sudo[99557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:04 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-9996cfb4-6199-4f57-8ca7-a74e034851e4 tempest-VolumesListAdminTestJSON-1295544767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:02:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9996cfb4-6199-4f57-8ca7-a74e034851e4 tempest-VolumesListAdminTestJSON-1295544767 None] Flow 'volume_create_manager' (7d524255-f85b-44fc-967e-691d852e019a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:02:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9996cfb4-6199-4f57-8ca7-a74e034851e4 tempest-VolumesListAdminTestJSON-1295544767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db91aaaa-0117-47e7-bb9f-c029b00eb0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9996cfb4-6199-4f57-8ca7-a74e034851e4 tempest-VolumesListAdminTestJSON-1295544767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db91aaaa-0117-47e7-bb9f-c029b00eb0c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95c47ddf-5ee5-477b-a4ba-1e71a9499075,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62e1213dbb3f4f3bb2734f269395a590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:02:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:02:05Z,use_quota=True,user_id='4f880f84e34f4641a37893d2c293c022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9996cfb4-6199-4f57-8ca7-a74e034851e4 tempest-VolumesListAdminTestJSON-1295544767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9dd7eec-902b-4483-aab9-c42375a28428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9996cfb4-6199-4f57-8ca7-a74e034851e4 tempest-VolumesListAdminTestJSON-1295544767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9dd7eec-902b-4483-aab9-c42375a28428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9996cfb4-6199-4f57-8ca7-a74e034851e4 tempest-VolumesListAdminTestJSON-1295544767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca7b4329-a486-4b1f-a77b-011043b5848a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9996cfb4-6199-4f57-8ca7-a74e034851e4 tempest-VolumesListAdminTestJSON-1295544767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca7b4329-a486-4b1f-a77b-011043b5848a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95c47ddf-5ee5-477b-a4ba-1e71a9499075', 'volume_name': 'volume-95c47ddf-5ee5-477b-a4ba-1e71a9499075', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9996cfb4-6199-4f57-8ca7-a74e034851e4 tempest-VolumesListAdminTestJSON-1295544767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57a246ef-410e-4264-8de5-06d44e7eb02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9996cfb4-6199-4f57-8ca7-a74e034851e4 tempest-VolumesListAdminTestJSON-1295544767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57a246ef-410e-4264-8de5-06d44e7eb02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9996cfb4-6199-4f57-8ca7-a74e034851e4 tempest-VolumesListAdminTestJSON-1295544767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c04e466d-1a29-451d-a916-101ab8e9b24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:05 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-9996cfb4-6199-4f57-8ca7-a74e034851e4 tempest-VolumesListAdminTestJSON-1295544767 None] Volume 95c47ddf-5ee5-477b-a4ba-1e71a9499075: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95c47ddf-5ee5-477b-a4ba-1e71a9499075', 'volume_size': 1} Sep 28 15:02:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9996cfb4-6199-4f57-8ca7-a74e034851e4 tempest-VolumesListAdminTestJSON-1295544767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:05 devstack sudo[99557]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8ca6ae67-9469-4366-9f44-16f4f502a1a1 tempest-VolumesGetTest-421307961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-368a8871-5bd5-411a-ad70-e95b7ebf296c 1073741824" returned: 0 in 0.623s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8ca6ae67-9469-4366-9f44-16f4f502a1a1 tempest-VolumesGetTest-421307961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-368a8871-5bd5-411a-ad70-e95b7ebf296c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:05 devstack sudo[99562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-368a8871-5bd5-411a-ad70-e95b7ebf296c Sep 28 15:02:05 devstack sudo[99562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:05 devstack sudo[99562]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8ca6ae67-9469-4366-9f44-16f4f502a1a1 tempest-VolumesGetTest-421307961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-368a8871-5bd5-411a-ad70-e95b7ebf296c" returned: 0 in 0.370s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:05 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8ca6ae67-9469-4366-9f44-16f4f502a1a1 tempest-VolumesGetTest-421307961 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:02:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8ca6ae67-9469-4366-9f44-16f4f502a1a1 tempest-VolumesGetTest-421307961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9996cfb4-6199-4f57-8ca7-a74e034851e4 tempest-VolumesListAdminTestJSON-1295544767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.669s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:05 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9996cfb4-6199-4f57-8ca7-a74e034851e4 tempest-VolumesListAdminTestJSON-1295544767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95c47ddf-5ee5-477b-a4ba-1e71a9499075,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62e1213dbb3f4f3bb2734f269395a590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:02:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:02:05Z,use_quota=True,user_id='4f880f84e34f4641a37893d2c293c022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:02:05 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-9996cfb4-6199-4f57-8ca7-a74e034851e4 tempest-VolumesListAdminTestJSON-1295544767 None] Creating volume 95c47ddf-5ee5-477b-a4ba-1e71a9499075 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:02:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9996cfb4-6199-4f57-8ca7-a74e034851e4 tempest-VolumesListAdminTestJSON-1295544767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9996cfb4-6199-4f57-8ca7-a74e034851e4 tempest-VolumesListAdminTestJSON-1295544767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:05 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9996cfb4-6199-4f57-8ca7-a74e034851e4 tempest-VolumesListAdminTestJSON-1295544767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:02:05 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9996cfb4-6199-4f57-8ca7-a74e034851e4 tempest-VolumesListAdminTestJSON-1295544767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:02:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9996cfb4-6199-4f57-8ca7-a74e034851e4 tempest-VolumesListAdminTestJSON-1295544767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:05 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9996cfb4-6199-4f57-8ca7-a74e034851e4 tempest-VolumesListAdminTestJSON-1295544767 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:02:05 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-9996cfb4-6199-4f57-8ca7-a74e034851e4 tempest-VolumesListAdminTestJSON-1295544767 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:02:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9996cfb4-6199-4f57-8ca7-a74e034851e4 tempest-VolumesListAdminTestJSON-1295544767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-95c47ddf-5ee5-477b-a4ba-1e71a9499075 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8ca6ae67-9469-4366-9f44-16f4f502a1a1 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27d1f3f1-94a1-429e-beeb-b237c5fe20e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-368a8871-5bd5-411a-ad70-e95b7ebf296c', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:05 devstack sudo[99565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-95c47ddf-5ee5-477b-a4ba-1e71a9499075 1073741824 Sep 28 15:02:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8ca6ae67-9469-4366-9f44-16f4f502a1a1 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d299021-1104-45cd-b015-045da6d0fa56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:05 devstack sudo[99565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:05 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-82986b11-0869-4ee6-a34e-e85cb3ac8362 tempest-VolumesMetadataTest-441174111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:02:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-82986b11-0869-4ee6-a34e-e85cb3ac8362 tempest-VolumesMetadataTest-441174111 None] Flow 'volume_create_manager' (387ee23e-4b59-479d-8eee-0d2cf159197e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:02:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-82986b11-0869-4ee6-a34e-e85cb3ac8362 tempest-VolumesMetadataTest-441174111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f26b37b-2d9e-45da-a4f2-b9714cc381d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:05 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-8ca6ae67-9469-4366-9f44-16f4f502a1a1 tempest-VolumesGetTest-421307961 None] Volume volume-368a8871-5bd5-411a-ad70-e95b7ebf296c (368a8871-5bd5-411a-ad70-e95b7ebf296c): created successfully Sep 28 15:02:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8ca6ae67-9469-4366-9f44-16f4f502a1a1 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d299021-1104-45cd-b015-045da6d0fa56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8ca6ae67-9469-4366-9f44-16f4f502a1a1 tempest-VolumesGetTest-421307961 None] Flow 'volume_create_manager' (8c789c6c-ad23-4b8a-ae72-3bf8de128ec1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:02:05 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-8ca6ae67-9469-4366-9f44-16f4f502a1a1 tempest-VolumesGetTest-421307961 None] Created volume successfully. Sep 28 15:02:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-82986b11-0869-4ee6-a34e-e85cb3ac8362 tempest-VolumesMetadataTest-441174111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f26b37b-2d9e-45da-a4f2-b9714cc381d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:02:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-511861505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ea9a174-0e48-450c-8104-0ab3a2a5458b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3427d1ade9064ed68181411136709364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:02:06Z,use_quota=True,user_id='f8416ae76d4d47478b388ef89b32eb47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-82986b11-0869-4ee6-a34e-e85cb3ac8362 tempest-VolumesMetadataTest-441174111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76cb43d1-9f60-4fde-addc-4a928ca13f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-82986b11-0869-4ee6-a34e-e85cb3ac8362 tempest-VolumesMetadataTest-441174111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76cb43d1-9f60-4fde-addc-4a928ca13f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:06 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-82986b11-0869-4ee6-a34e-e85cb3ac8362 tempest-VolumesMetadataTest-441174111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a20ad58-44e4-4cb2-8342-93942df7a75e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:06 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-82986b11-0869-4ee6-a34e-e85cb3ac8362 tempest-VolumesMetadataTest-441174111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a20ad58-44e4-4cb2-8342-93942df7a75e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ea9a174-0e48-450c-8104-0ab3a2a5458b', 'volume_name': 'volume-9ea9a174-0e48-450c-8104-0ab3a2a5458b', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:06 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-82986b11-0869-4ee6-a34e-e85cb3ac8362 tempest-VolumesMetadataTest-441174111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89fc54f7-c2ce-4dea-a249-57daa771f96a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:06 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-82986b11-0869-4ee6-a34e-e85cb3ac8362 tempest-VolumesMetadataTest-441174111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89fc54f7-c2ce-4dea-a249-57daa771f96a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:06 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-82986b11-0869-4ee6-a34e-e85cb3ac8362 tempest-VolumesMetadataTest-441174111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f85eab5d-50c2-4916-bf3d-3709ece04ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:06 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-82986b11-0869-4ee6-a34e-e85cb3ac8362 tempest-VolumesMetadataTest-441174111 None] Volume 9ea9a174-0e48-450c-8104-0ab3a2a5458b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ea9a174-0e48-450c-8104-0ab3a2a5458b', 'volume_size': 1} Sep 28 15:02:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-82986b11-0869-4ee6-a34e-e85cb3ac8362 tempest-VolumesMetadataTest-441174111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:06 devstack sudo[99565]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9996cfb4-6199-4f57-8ca7-a74e034851e4 tempest-VolumesListAdminTestJSON-1295544767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-95c47ddf-5ee5-477b-a4ba-1e71a9499075 1073741824" returned: 0 in 0.468s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9996cfb4-6199-4f57-8ca7-a74e034851e4 tempest-VolumesListAdminTestJSON-1295544767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-95c47ddf-5ee5-477b-a4ba-1e71a9499075 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:06 devstack sudo[99571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-95c47ddf-5ee5-477b-a4ba-1e71a9499075 Sep 28 15:02:06 devstack sudo[99571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:06 devstack sudo[99571]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9996cfb4-6199-4f57-8ca7-a74e034851e4 tempest-VolumesListAdminTestJSON-1295544767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-95c47ddf-5ee5-477b-a4ba-1e71a9499075" returned: 0 in 0.251s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9996cfb4-6199-4f57-8ca7-a74e034851e4 tempest-VolumesListAdminTestJSON-1295544767 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:02:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9996cfb4-6199-4f57-8ca7-a74e034851e4 tempest-VolumesListAdminTestJSON-1295544767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-82986b11-0869-4ee6-a34e-e85cb3ac8362 tempest-VolumesMetadataTest-441174111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.552s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-82986b11-0869-4ee6-a34e-e85cb3ac8362 tempest-VolumesMetadataTest-441174111 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:02:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-511861505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ea9a174-0e48-450c-8104-0ab3a2a5458b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3427d1ade9064ed68181411136709364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:02:06Z,use_quota=True,user_id='f8416ae76d4d47478b388ef89b32eb47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:02:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-82986b11-0869-4ee6-a34e-e85cb3ac8362 tempest-VolumesMetadataTest-441174111 None] Creating volume 9ea9a174-0e48-450c-8104-0ab3a2a5458b {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:02:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-82986b11-0869-4ee6-a34e-e85cb3ac8362 tempest-VolumesMetadataTest-441174111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-82986b11-0869-4ee6-a34e-e85cb3ac8362 tempest-VolumesMetadataTest-441174111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-82986b11-0869-4ee6-a34e-e85cb3ac8362 tempest-VolumesMetadataTest-441174111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:02:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-82986b11-0869-4ee6-a34e-e85cb3ac8362 tempest-VolumesMetadataTest-441174111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:02:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-82986b11-0869-4ee6-a34e-e85cb3ac8362 tempest-VolumesMetadataTest-441174111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-82986b11-0869-4ee6-a34e-e85cb3ac8362 tempest-VolumesMetadataTest-441174111 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:02:06 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-82986b11-0869-4ee6-a34e-e85cb3ac8362 tempest-VolumesMetadataTest-441174111 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:02:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-82986b11-0869-4ee6-a34e-e85cb3ac8362 tempest-VolumesMetadataTest-441174111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9ea9a174-0e48-450c-8104-0ab3a2a5458b 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:06 devstack sudo[99574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9ea9a174-0e48-450c-8104-0ab3a2a5458b 1073741824 Sep 28 15:02:06 devstack sudo[99574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:06 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9996cfb4-6199-4f57-8ca7-a74e034851e4 tempest-VolumesListAdminTestJSON-1295544767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c04e466d-1a29-451d-a916-101ab8e9b24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95c47ddf-5ee5-477b-a4ba-1e71a9499075', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:06 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9996cfb4-6199-4f57-8ca7-a74e034851e4 tempest-VolumesListAdminTestJSON-1295544767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5732870f-84ec-4627-93cf-2d715b4286ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:06 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-9996cfb4-6199-4f57-8ca7-a74e034851e4 tempest-VolumesListAdminTestJSON-1295544767 None] Volume volume-95c47ddf-5ee5-477b-a4ba-1e71a9499075 (95c47ddf-5ee5-477b-a4ba-1e71a9499075): created successfully Sep 28 15:02:06 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9996cfb4-6199-4f57-8ca7-a74e034851e4 tempest-VolumesListAdminTestJSON-1295544767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5732870f-84ec-4627-93cf-2d715b4286ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:06 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9996cfb4-6199-4f57-8ca7-a74e034851e4 tempest-VolumesListAdminTestJSON-1295544767 None] Flow 'volume_create_manager' (7d524255-f85b-44fc-967e-691d852e019a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:02:06 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-9996cfb4-6199-4f57-8ca7-a74e034851e4 tempest-VolumesListAdminTestJSON-1295544767 None] Created volume successfully. Sep 28 15:02:07 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3caf70e6-b48f-4132-af3e-8f4948e8de28 tempest-VolumesListAdminTestJSON-1295544767 None] Acquiring lock "cinder-95c47ddf-5ee5-477b-a4ba-1e71a9499075-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:02:07 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3caf70e6-b48f-4132-af3e-8f4948e8de28 tempest-VolumesListAdminTestJSON-1295544767 None] Lock "cinder-95c47ddf-5ee5-477b-a4ba-1e71a9499075-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:02:07 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3caf70e6-b48f-4132-af3e-8f4948e8de28 tempest-VolumesListAdminTestJSON-1295544767 None] Acquiring lock "cinder-quobyte-95c47ddf-5ee5-477b-a4ba-1e71a9499075" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:02:07 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3caf70e6-b48f-4132-af3e-8f4948e8de28 tempest-VolumesListAdminTestJSON-1295544767 None] Lock "cinder-quobyte-95c47ddf-5ee5-477b-a4ba-1e71a9499075" acquired by "delete_volume" :: waited 0.033s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:02:07 devstack sudo[99574]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-82986b11-0869-4ee6-a34e-e85cb3ac8362 tempest-VolumesMetadataTest-441174111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9ea9a174-0e48-450c-8104-0ab3a2a5458b 1073741824" returned: 0 in 0.757s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:07 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8be900-0000-4acf-a6b8-b01aadf4c4ee]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3caf70e6-b48f-4132-af3e-8f4948e8de28 tempest-VolumesListAdminTestJSON-1295544767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-95c47ddf-5ee5-477b-a4ba-1e71a9499075 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-82986b11-0869-4ee6-a34e-e85cb3ac8362 tempest-VolumesMetadataTest-441174111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9ea9a174-0e48-450c-8104-0ab3a2a5458b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:07 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0b5ba754-1166-4095-834d-eafba1b7a770 tempest-VolumesListAdminTestJSON-1591565788 None] Acquiring lock "cinder-5f6d55cd-fcc8-4817-80f5-b737b5a23d97-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:02:07 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:02:07 devstack sudo[99582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9ea9a174-0e48-450c-8104-0ab3a2a5458b Sep 28 15:02:07 devstack sudo[99582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] Flow 'volume_create_manager' (8d6940ae-b9c5-4841-a5a6-5a57eff637f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:02:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01f12be0-a72f-477e-9e6c-4d30a8d80820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:07 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0b5ba754-1166-4095-834d-eafba1b7a770 tempest-VolumesListAdminTestJSON-1591565788 None] Lock "cinder-5f6d55cd-fcc8-4817-80f5-b737b5a23d97-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:02:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01f12be0-a72f-477e-9e6c-4d30a8d80820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:02:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-266943387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=220bd177-6f8b-458e-87e1-816d258ffdaf,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='faba40f947cd4221a56196fd85c2337f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:02:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=368a8871-5bd5-411a-ad70-e95b7ebf296c,status='creating',terminated_at=None,updated_at=2026-09-28T13:02:07Z,use_quota=True,user_id='91ba074109b045f1a62611658fb66015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd099dac-64d6-422d-ba0a-71e0078c7360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd099dac-64d6-422d-ba0a-71e0078c7360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9262b78-9a52-4f8f-8589-37b0d6c3cb25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9262b78-9a52-4f8f-8589-37b0d6c3cb25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '220bd177-6f8b-458e-87e1-816d258ffdaf', 'volume_name': 'volume-220bd177-6f8b-458e-87e1-816d258ffdaf', 'volume_size': 1, 'source_volid': '368a8871-5bd5-411a-ad70-e95b7ebf296c', 'source_volstatus': 'available'}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56dba094-538e-4e88-9a1a-b4beb147bcca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56dba094-538e-4e88-9a1a-b4beb147bcca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2effb30e-bc77-48cc-8f2f-dabe49c6d91b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:07 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] Volume 220bd177-6f8b-458e-87e1-816d258ffdaf: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-220bd177-6f8b-458e-87e1-816d258ffdaf', 'volume_size': 1, 'source_volid': '368a8871-5bd5-411a-ad70-e95b7ebf296c', 'source_volstatus': 'available'} Sep 28 15:02:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:07 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0b5ba754-1166-4095-834d-eafba1b7a770 tempest-VolumesListAdminTestJSON-1591565788 None] Acquiring lock "cinder-quobyte-5f6d55cd-fcc8-4817-80f5-b737b5a23d97" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:02:07 devstack sudo[99581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-95c47ddf-5ee5-477b-a4ba-1e71a9499075 Sep 28 15:02:07 devstack sudo[99581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:07 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0b5ba754-1166-4095-834d-eafba1b7a770 tempest-VolumesListAdminTestJSON-1591565788 None] Lock "cinder-quobyte-5f6d55cd-fcc8-4817-80f5-b737b5a23d97" acquired by "delete_volume" :: waited 0.022s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:02:07 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff453b44-d5f4-43cf-a9ad-eab19e89cf53]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0b5ba754-1166-4095-834d-eafba1b7a770 tempest-VolumesListAdminTestJSON-1591565788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5f6d55cd-fcc8-4817-80f5-b737b5a23d97 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:07 devstack sudo[99582]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-82986b11-0869-4ee6-a34e-e85cb3ac8362 tempest-VolumesMetadataTest-441174111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9ea9a174-0e48-450c-8104-0ab3a2a5458b" returned: 0 in 0.365s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:07 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-82986b11-0869-4ee6-a34e-e85cb3ac8362 tempest-VolumesMetadataTest-441174111 None] <== create_volume: return (1214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:02:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-82986b11-0869-4ee6-a34e-e85cb3ac8362 tempest-VolumesMetadataTest-441174111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.217s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.188s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:07 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] Cloning volume 368a8871-5bd5-411a-ad70-e95b7ebf296c to volume 220bd177-6f8b-458e-87e1-816d258ffdaf Sep 28 15:02:07 devstack sudo[99585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5f6d55cd-fcc8-4817-80f5-b737b5a23d97 Sep 28 15:02:07 devstack sudo[99585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-82986b11-0869-4ee6-a34e-e85cb3ac8362 tempest-VolumesMetadataTest-441174111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f85eab5d-50c2-4916-bf3d-3709ece04ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ea9a174-0e48-450c-8104-0ab3a2a5458b', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-82986b11-0869-4ee6-a34e-e85cb3ac8362 tempest-VolumesMetadataTest-441174111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (820ff346-1f33-4750-b4f5-96f885854ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:07 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-82986b11-0869-4ee6-a34e-e85cb3ac8362 tempest-VolumesMetadataTest-441174111 None] Volume volume-9ea9a174-0e48-450c-8104-0ab3a2a5458b (9ea9a174-0e48-450c-8104-0ab3a2a5458b): created successfully Sep 28 15:02:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-82986b11-0869-4ee6-a34e-e85cb3ac8362 tempest-VolumesMetadataTest-441174111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (820ff346-1f33-4750-b4f5-96f885854ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-82986b11-0869-4ee6-a34e-e85cb3ac8362 tempest-VolumesMetadataTest-441174111 None] Flow 'volume_create_manager' (387ee23e-4b59-479d-8eee-0d2cf159197e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:02:07 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] Creating offline snapshot f07b85f7-01ad-4077-b9f9-850b0fbf41bb of volume 368a8871-5bd5-411a-ad70-e95b7ebf296c {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:02:07 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-82986b11-0869-4ee6-a34e-e85cb3ac8362 tempest-VolumesMetadataTest-441174111 None] Created volume successfully. Sep 28 15:02:07 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e6dd0e-0333-4fd7-951a-1a22063bb72e]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-368a8871-5bd5-411a-ad70-e95b7ebf296c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:08 devstack sudo[99581]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3caf70e6-b48f-4132-af3e-8f4948e8de28 tempest-VolumesListAdminTestJSON-1295544767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-95c47ddf-5ee5-477b-a4ba-1e71a9499075" returned: 0 in 0.760s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3caf70e6-b48f-4132-af3e-8f4948e8de28 tempest-VolumesListAdminTestJSON-1295544767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-95c47ddf-5ee5-477b-a4ba-1e71a9499075 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:08 devstack sudo[99588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-368a8871-5bd5-411a-ad70-e95b7ebf296c Sep 28 15:02:08 devstack sudo[99588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:08 devstack sudo[99594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-95c47ddf-5ee5-477b-a4ba-1e71a9499075 Sep 28 15:02:08 devstack sudo[99594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:08 devstack sudo[99585]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0b5ba754-1166-4095-834d-eafba1b7a770 tempest-VolumesListAdminTestJSON-1591565788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5f6d55cd-fcc8-4817-80f5-b737b5a23d97" returned: 0 in 0.605s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0b5ba754-1166-4095-834d-eafba1b7a770 tempest-VolumesListAdminTestJSON-1591565788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5f6d55cd-fcc8-4817-80f5-b737b5a23d97 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:08 devstack sudo[99599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5f6d55cd-fcc8-4817-80f5-b737b5a23d97 Sep 28 15:02:08 devstack sudo[99599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:08 devstack sudo[99588]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-368a8871-5bd5-411a-ad70-e95b7ebf296c" returned: 0 in 0.482s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-368a8871-5bd5-411a-ad70-e95b7ebf296c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-368a8871-5bd5-411a-ad70-e95b7ebf296c.f07b85f7-01ad-4077-b9f9-850b0fbf41bb 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:08 devstack sudo[99594]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3caf70e6-b48f-4132-af3e-8f4948e8de28 tempest-VolumesListAdminTestJSON-1295544767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-95c47ddf-5ee5-477b-a4ba-1e71a9499075" returned: 0 in 0.337s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:08 devstack sudo[99606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-368a8871-5bd5-411a-ad70-e95b7ebf296c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-368a8871-5bd5-411a-ad70-e95b7ebf296c.f07b85f7-01ad-4077-b9f9-850b0fbf41bb 1G Sep 28 15:02:08 devstack sudo[99606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:08 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3caf70e6-b48f-4132-af3e-8f4948e8de28 tempest-VolumesListAdminTestJSON-1295544767 None] Lock "cinder-quobyte-95c47ddf-5ee5-477b-a4ba-1e71a9499075" released by "delete_volume" :: held 1.171s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:02:08 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-3caf70e6-b48f-4132-af3e-8f4948e8de28 tempest-VolumesListAdminTestJSON-1295544767 None] Created reservations ['00eac9f1-e255-43ee-9eee-28a73f604a82', '5c5f8f16-5c3a-4b92-9455-7434a8e7a798', 'ec89c681-00ba-4b89-8122-681561c95530', 'a2093436-019e-4bc7-8154-b1f540c29f1d'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:02:08 devstack sudo[99599]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0b5ba754-1166-4095-834d-eafba1b7a770 tempest-VolumesListAdminTestJSON-1591565788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5f6d55cd-fcc8-4817-80f5-b737b5a23d97" returned: 0 in 0.329s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:08 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0b5ba754-1166-4095-834d-eafba1b7a770 tempest-VolumesListAdminTestJSON-1591565788 None] Lock "cinder-quobyte-5f6d55cd-fcc8-4817-80f5-b737b5a23d97" released by "delete_volume" :: held 0.993s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:02:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3caf70e6-b48f-4132-af3e-8f4948e8de28 tempest-VolumesListAdminTestJSON-1295544767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3caf70e6-b48f-4132-af3e-8f4948e8de28 tempest-VolumesListAdminTestJSON-1295544767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:08 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3caf70e6-b48f-4132-af3e-8f4948e8de28 tempest-VolumesListAdminTestJSON-1295544767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:02:08 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3caf70e6-b48f-4132-af3e-8f4948e8de28 tempest-VolumesListAdminTestJSON-1295544767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:02:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3caf70e6-b48f-4132-af3e-8f4948e8de28 tempest-VolumesListAdminTestJSON-1295544767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3caf70e6-b48f-4132-af3e-8f4948e8de28 tempest-VolumesListAdminTestJSON-1295544767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:08 devstack sudo[99609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:02:08 devstack sudo[99609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:08 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-0b5ba754-1166-4095-834d-eafba1b7a770 tempest-VolumesListAdminTestJSON-1591565788 None] Created reservations ['71cdbf4e-7ad0-43d9-9c15-651b3a7d6faa', '7d584ad0-849c-4bed-bfbc-d937f5e306c3', 'a2e39cd1-ee3c-49aa-8965-df2f976838f8', '72e78ddd-dfee-4f00-87fe-f7fa388f35f6'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:02:08 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=79,cinder:UPDATE=105,cinder:INSERT=26,cinder:DELETE=9 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:02:08 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=91,cinder:UPDATE=93,cinder:INSERT=31,cinder:DELETE=8 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:02:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0b5ba754-1166-4095-834d-eafba1b7a770 tempest-VolumesListAdminTestJSON-1591565788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0b5ba754-1166-4095-834d-eafba1b7a770 tempest-VolumesListAdminTestJSON-1591565788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:08 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0b5ba754-1166-4095-834d-eafba1b7a770 tempest-VolumesListAdminTestJSON-1591565788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:02:08 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0b5ba754-1166-4095-834d-eafba1b7a770 tempest-VolumesListAdminTestJSON-1591565788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:02:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0b5ba754-1166-4095-834d-eafba1b7a770 tempest-VolumesListAdminTestJSON-1591565788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0b5ba754-1166-4095-834d-eafba1b7a770 tempest-VolumesListAdminTestJSON-1591565788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:09 devstack sudo[99614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:02:09 devstack sudo[99614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:09 devstack sudo[99609]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3caf70e6-b48f-4132-af3e-8f4948e8de28 tempest-VolumesListAdminTestJSON-1295544767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.480s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:09 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-3caf70e6-b48f-4132-af3e-8f4948e8de28 tempest-VolumesListAdminTestJSON-1295544767 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:02:09 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-3caf70e6-b48f-4132-af3e-8f4948e8de28 tempest-VolumesListAdminTestJSON-1295544767 None] Deleted volume successfully. Sep 28 15:02:09 devstack sudo[99606]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-368a8871-5bd5-411a-ad70-e95b7ebf296c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-368a8871-5bd5-411a-ad70-e95b7ebf296c.f07b85f7-01ad-4077-b9f9-850b0fbf41bb 1G" returned: 0 in 0.795s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-368a8871-5bd5-411a-ad70-e95b7ebf296c -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-368a8871-5bd5-411a-ad70-e95b7ebf296c.f07b85f7-01ad-4077-b9f9-850b0fbf41bb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:09 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3caf70e6-b48f-4132-af3e-8f4948e8de28 tempest-VolumesListAdminTestJSON-1295544767 None] Lock "cinder-95c47ddf-5ee5-477b-a4ba-1e71a9499075-delete_volume" released by "delete_volume" :: held 2.045s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:02:09 devstack sudo[99618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-368a8871-5bd5-411a-ad70-e95b7ebf296c -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-368a8871-5bd5-411a-ad70-e95b7ebf296c.f07b85f7-01ad-4077-b9f9-850b0fbf41bb Sep 28 15:02:09 devstack sudo[99618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:09 devstack sudo[99614]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0b5ba754-1166-4095-834d-eafba1b7a770 tempest-VolumesListAdminTestJSON-1591565788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.471s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:09 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-0b5ba754-1166-4095-834d-eafba1b7a770 tempest-VolumesListAdminTestJSON-1591565788 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:02:09 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-0b5ba754-1166-4095-834d-eafba1b7a770 tempest-VolumesListAdminTestJSON-1591565788 None] Deleted volume successfully. Sep 28 15:02:09 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0b5ba754-1166-4095-834d-eafba1b7a770 tempest-VolumesListAdminTestJSON-1591565788 None] Lock "cinder-5f6d55cd-fcc8-4817-80f5-b737b5a23d97-delete_volume" released by "delete_volume" :: held 1.927s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:02:09 devstack sudo[99618]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-368a8871-5bd5-411a-ad70-e95b7ebf296c -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-368a8871-5bd5-411a-ad70-e95b7ebf296c.f07b85f7-01ad-4077-b9f9-850b0fbf41bb" returned: 0 in 0.466s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:09 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-368a8871-5bd5-411a-ad70-e95b7ebf296c.f07b85f7-01ad-4077-b9f9-850b0fbf41bb is being set with open permissions: ugo+rw Sep 28 15:02:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-368a8871-5bd5-411a-ad70-e95b7ebf296c.f07b85f7-01ad-4077-b9f9-850b0fbf41bb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:09 devstack sudo[99625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-368a8871-5bd5-411a-ad70-e95b7ebf296c.f07b85f7-01ad-4077-b9f9-850b0fbf41bb Sep 28 15:02:09 devstack sudo[99625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:09 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-36bdaa34-42f9-46a5-a650-bc8b3b17b3a3 tempest-VolumesListAdminTestJSON-1591565788 None] Acquiring lock "cinder-c243a837-58c1-405b-bfba-b8312e356200-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:02:10 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-36bdaa34-42f9-46a5-a650-bc8b3b17b3a3 tempest-VolumesListAdminTestJSON-1591565788 None] Lock "cinder-c243a837-58c1-405b-bfba-b8312e356200-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:02:10 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-36bdaa34-42f9-46a5-a650-bc8b3b17b3a3 tempest-VolumesListAdminTestJSON-1591565788 None] Acquiring lock "cinder-quobyte-c243a837-58c1-405b-bfba-b8312e356200" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:02:10 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-36bdaa34-42f9-46a5-a650-bc8b3b17b3a3 tempest-VolumesListAdminTestJSON-1591565788 None] Lock "cinder-quobyte-c243a837-58c1-405b-bfba-b8312e356200" acquired by "delete_volume" :: waited 0.021s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:02:10 devstack sudo[99625]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-368a8871-5bd5-411a-ad70-e95b7ebf296c.f07b85f7-01ad-4077-b9f9-850b0fbf41bb" returned: 0 in 0.435s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:10 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[83349e0c-1786-4ac0-bfeb-6052fb06bc7d]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-36bdaa34-42f9-46a5-a650-bc8b3b17b3a3 tempest-VolumesListAdminTestJSON-1591565788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c243a837-58c1-405b-bfba-b8312e356200 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-368a8871-5bd5-411a-ad70-e95b7ebf296c.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:10 devstack sudo[99629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-368a8871-5bd5-411a-ad70-e95b7ebf296c.info Sep 28 15:02:10 devstack sudo[99629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:10 devstack sudo[99628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c243a837-58c1-405b-bfba-b8312e356200 Sep 28 15:02:10 devstack sudo[99628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:10 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-98a598b4-8797-4315-8b6c-c30521f63c19 tempest-VolumesMetadataTest-441174111 None] Acquiring lock "cinder-9ea9a174-0e48-450c-8104-0ab3a2a5458b-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:02:10 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-98a598b4-8797-4315-8b6c-c30521f63c19 tempest-VolumesMetadataTest-441174111 None] Lock "cinder-9ea9a174-0e48-450c-8104-0ab3a2a5458b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:02:10 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-98a598b4-8797-4315-8b6c-c30521f63c19 tempest-VolumesMetadataTest-441174111 None] Acquiring lock "cinder-quobyte-9ea9a174-0e48-450c-8104-0ab3a2a5458b" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:02:10 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-98a598b4-8797-4315-8b6c-c30521f63c19 tempest-VolumesMetadataTest-441174111 None] Lock "cinder-quobyte-9ea9a174-0e48-450c-8104-0ab3a2a5458b" acquired by "delete_volume" :: waited 0.035s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:02:10 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfdfdd34-fdad-40fc-bc3d-af755539cc88]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-98a598b4-8797-4315-8b6c-c30521f63c19 tempest-VolumesMetadataTest-441174111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9ea9a174-0e48-450c-8104-0ab3a2a5458b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:10 devstack sudo[99629]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-368a8871-5bd5-411a-ad70-e95b7ebf296c.info" returned: 0 in 0.485s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:10 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-368a8871-5bd5-411a-ad70-e95b7ebf296c.info is being set with open permissions: ugo+rw Sep 28 15:02:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-368a8871-5bd5-411a-ad70-e95b7ebf296c.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:10 devstack sudo[99628]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-36bdaa34-42f9-46a5-a650-bc8b3b17b3a3 tempest-VolumesListAdminTestJSON-1591565788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c243a837-58c1-405b-bfba-b8312e356200" returned: 0 in 0.574s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-36bdaa34-42f9-46a5-a650-bc8b3b17b3a3 tempest-VolumesListAdminTestJSON-1591565788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c243a837-58c1-405b-bfba-b8312e356200 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:10 devstack sudo[99638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-368a8871-5bd5-411a-ad70-e95b7ebf296c.info Sep 28 15:02:10 devstack sudo[99638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:10 devstack sudo[99635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9ea9a174-0e48-450c-8104-0ab3a2a5458b Sep 28 15:02:10 devstack sudo[99635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:10 devstack sudo[99640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c243a837-58c1-405b-bfba-b8312e356200 Sep 28 15:02:10 devstack sudo[99640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:10 devstack sudo[99638]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-368a8871-5bd5-411a-ad70-e95b7ebf296c.info" returned: 0 in 0.301s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:11 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] Acquiring lock "cinder-quobyte-220bd177-6f8b-458e-87e1-816d258ffdaf" by "_copy_volume_from_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:02:11 devstack sudo[99635]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-98a598b4-8797-4315-8b6c-c30521f63c19 tempest-VolumesMetadataTest-441174111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9ea9a174-0e48-450c-8104-0ab3a2a5458b" returned: 0 in 0.429s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-98a598b4-8797-4315-8b6c-c30521f63c19 tempest-VolumesMetadataTest-441174111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9ea9a174-0e48-450c-8104-0ab3a2a5458b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:11 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] Lock "cinder-quobyte-220bd177-6f8b-458e-87e1-816d258ffdaf" acquired by "_copy_volume_from_snapshot" :: waited 0.046s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:02:11 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] snapshot: f07b85f7-01ad-4077-b9f9-850b0fbf41bb, volume: 220bd177-6f8b-458e-87e1-816d258ffdaf, {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 15:02:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:11 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:02:11 devstack sudo[99648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9ea9a174-0e48-450c-8104-0ab3a2a5458b Sep 28 15:02:11 devstack sudo[99648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:11 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:02:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:11 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[3182362e-fe76-4cf2-a714-8f48162bed18]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-368a8871-5bd5-411a-ad70-e95b7ebf296c.f07b85f7-01ad-4077-b9f9-850b0fbf41bb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:11 devstack sudo[99640]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-36bdaa34-42f9-46a5-a650-bc8b3b17b3a3 tempest-VolumesListAdminTestJSON-1591565788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c243a837-58c1-405b-bfba-b8312e356200" returned: 0 in 0.475s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:11 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-36bdaa34-42f9-46a5-a650-bc8b3b17b3a3 tempest-VolumesListAdminTestJSON-1591565788 None] Lock "cinder-quobyte-c243a837-58c1-405b-bfba-b8312e356200" released by "delete_volume" :: held 1.116s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:02:11 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-36bdaa34-42f9-46a5-a650-bc8b3b17b3a3 tempest-VolumesListAdminTestJSON-1591565788 None] Created reservations ['d2092a8e-d631-4825-9bbd-77e86e095ad9', '0132af24-27f1-49ab-88d4-5e75d55ddc1a', '9a6b3592-6a99-4437-9b11-ea5a0872a9fa', 'c5461663-39a5-46a8-be1e-790f24c2a45b'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:02:11 devstack sudo[99651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-368a8871-5bd5-411a-ad70-e95b7ebf296c.f07b85f7-01ad-4077-b9f9-850b0fbf41bb Sep 28 15:02:11 devstack sudo[99651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-36bdaa34-42f9-46a5-a650-bc8b3b17b3a3 tempest-VolumesListAdminTestJSON-1591565788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-36bdaa34-42f9-46a5-a650-bc8b3b17b3a3 tempest-VolumesListAdminTestJSON-1591565788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:11 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-36bdaa34-42f9-46a5-a650-bc8b3b17b3a3 tempest-VolumesListAdminTestJSON-1591565788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:02:11 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-36bdaa34-42f9-46a5-a650-bc8b3b17b3a3 tempest-VolumesListAdminTestJSON-1591565788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:02:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-36bdaa34-42f9-46a5-a650-bc8b3b17b3a3 tempest-VolumesListAdminTestJSON-1591565788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-36bdaa34-42f9-46a5-a650-bc8b3b17b3a3 tempest-VolumesListAdminTestJSON-1591565788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:11 devstack sudo[99653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:02:11 devstack sudo[99653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:11 devstack sudo[99648]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-98a598b4-8797-4315-8b6c-c30521f63c19 tempest-VolumesMetadataTest-441174111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9ea9a174-0e48-450c-8104-0ab3a2a5458b" returned: 0 in 0.401s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:11 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-98a598b4-8797-4315-8b6c-c30521f63c19 tempest-VolumesMetadataTest-441174111 None] Lock "cinder-quobyte-9ea9a174-0e48-450c-8104-0ab3a2a5458b" released by "delete_volume" :: held 0.899s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:02:11 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-98a598b4-8797-4315-8b6c-c30521f63c19 tempest-VolumesMetadataTest-441174111 None] Created reservations ['ee68f452-d6f3-4c76-8f26-7134eaf06f73', '59bca878-25e2-496c-8c70-d5d5a266bad8', 'cfe2930a-ab01-4151-9748-412b45d8041f', '8c8021ac-15cd-47b4-a6ea-c454a4b6caf1'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:02:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-98a598b4-8797-4315-8b6c-c30521f63c19 tempest-VolumesMetadataTest-441174111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-98a598b4-8797-4315-8b6c-c30521f63c19 tempest-VolumesMetadataTest-441174111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:11 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-98a598b4-8797-4315-8b6c-c30521f63c19 tempest-VolumesMetadataTest-441174111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:02:11 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-98a598b4-8797-4315-8b6c-c30521f63c19 tempest-VolumesMetadataTest-441174111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:02:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-98a598b4-8797-4315-8b6c-c30521f63c19 tempest-VolumesMetadataTest-441174111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-98a598b4-8797-4315-8b6c-c30521f63c19 tempest-VolumesMetadataTest-441174111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:11 devstack sudo[99658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:02:11 devstack sudo[99658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:11 devstack sudo[99651]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-368a8871-5bd5-411a-ad70-e95b7ebf296c.f07b85f7-01ad-4077-b9f9-850b0fbf41bb" returned: 0 in 0.693s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:11 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-368a8871-5bd5-411a-ad70-e95b7ebf296c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:02:11 devstack sudo[99653]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:11 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[850acd3a-61f9-4c20-abbb-cbc5f598ca3a]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-368a8871-5bd5-411a-ad70-e95b7ebf296c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-36bdaa34-42f9-46a5-a650-bc8b3b17b3a3 tempest-VolumesListAdminTestJSON-1591565788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.486s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:11 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-36bdaa34-42f9-46a5-a650-bc8b3b17b3a3 tempest-VolumesListAdminTestJSON-1591565788 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:02:11 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-36bdaa34-42f9-46a5-a650-bc8b3b17b3a3 tempest-VolumesListAdminTestJSON-1591565788 None] Deleted volume successfully. Sep 28 15:02:11 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-36bdaa34-42f9-46a5-a650-bc8b3b17b3a3 tempest-VolumesListAdminTestJSON-1591565788 None] Lock "cinder-c243a837-58c1-405b-bfba-b8312e356200-delete_volume" released by "delete_volume" :: held 1.903s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:02:11 devstack sudo[99662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-368a8871-5bd5-411a-ad70-e95b7ebf296c Sep 28 15:02:11 devstack sudo[99662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:12 devstack sudo[99658]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-98a598b4-8797-4315-8b6c-c30521f63c19 tempest-VolumesMetadataTest-441174111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.393s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:12 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-98a598b4-8797-4315-8b6c-c30521f63c19 tempest-VolumesMetadataTest-441174111 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:02:12 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-98a598b4-8797-4315-8b6c-c30521f63c19 tempest-VolumesMetadataTest-441174111 None] Deleted volume successfully. Sep 28 15:02:12 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-98a598b4-8797-4315-8b6c-c30521f63c19 tempest-VolumesMetadataTest-441174111 None] Lock "cinder-9ea9a174-0e48-450c-8104-0ab3a2a5458b-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:02:12 devstack sudo[99662]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-368a8871-5bd5-411a-ad70-e95b7ebf296c" returned: 0 in 0.459s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:12 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-368a8871-5bd5-411a-ad70-e95b7ebf296c {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 15:02:12 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] Creating direct copy from snapshot {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 15:02:12 devstack cinder-volume[87116]: DEBUG cinder.utils [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] Path /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-220bd177-6f8b-458e-87e1-816d258ffdaf not found in is_blk_device check {{(pid=87116) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 15:02:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-368a8871-5bd5-411a-ad70-e95b7ebf296c /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-220bd177-6f8b-458e-87e1-816d258ffdaf {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:12 devstack sudo[99668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-368a8871-5bd5-411a-ad70-e95b7ebf296c /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-220bd177-6f8b-458e-87e1-816d258ffdaf Sep 28 15:02:12 devstack sudo[99668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:12 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b9406517-f7c7-4d0e-a45b-76bc1938a02e tempest-VolumesListAdminTestJSON-1591565788 None] Acquiring lock "cinder-02a6df8b-b419-4489-9b25-3dd3e74692a6-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:02:12 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b9406517-f7c7-4d0e-a45b-76bc1938a02e tempest-VolumesListAdminTestJSON-1591565788 None] Lock "cinder-02a6df8b-b419-4489-9b25-3dd3e74692a6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:02:12 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b9406517-f7c7-4d0e-a45b-76bc1938a02e tempest-VolumesListAdminTestJSON-1591565788 None] Acquiring lock "cinder-quobyte-02a6df8b-b419-4489-9b25-3dd3e74692a6" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:02:12 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b9406517-f7c7-4d0e-a45b-76bc1938a02e tempest-VolumesListAdminTestJSON-1591565788 None] Lock "cinder-quobyte-02a6df8b-b419-4489-9b25-3dd3e74692a6" acquired by "delete_volume" :: waited 0.028s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:02:12 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[957f5dd1-4621-46ee-a6bf-155667927f4e]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b9406517-f7c7-4d0e-a45b-76bc1938a02e tempest-VolumesListAdminTestJSON-1591565788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-02a6df8b-b419-4489-9b25-3dd3e74692a6 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:12 devstack sudo[99670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-02a6df8b-b419-4489-9b25-3dd3e74692a6 Sep 28 15:02:12 devstack sudo[99670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:13 devstack sudo[99670]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b9406517-f7c7-4d0e-a45b-76bc1938a02e tempest-VolumesListAdminTestJSON-1591565788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-02a6df8b-b419-4489-9b25-3dd3e74692a6" returned: 0 in 0.679s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b9406517-f7c7-4d0e-a45b-76bc1938a02e tempest-VolumesListAdminTestJSON-1591565788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-02a6df8b-b419-4489-9b25-3dd3e74692a6 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:13 devstack sudo[99700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-02a6df8b-b419-4489-9b25-3dd3e74692a6 Sep 28 15:02:13 devstack sudo[99700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:13 devstack sudo[99700]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b9406517-f7c7-4d0e-a45b-76bc1938a02e tempest-VolumesListAdminTestJSON-1591565788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-02a6df8b-b419-4489-9b25-3dd3e74692a6" returned: 0 in 0.693s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:14 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b9406517-f7c7-4d0e-a45b-76bc1938a02e tempest-VolumesListAdminTestJSON-1591565788 None] Lock "cinder-quobyte-02a6df8b-b419-4489-9b25-3dd3e74692a6" released by "delete_volume" :: held 1.474s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:02:14 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-b9406517-f7c7-4d0e-a45b-76bc1938a02e tempest-VolumesListAdminTestJSON-1591565788 None] Created reservations ['0e619d48-3009-4b92-8e55-34dcefac7e0c', '96ca63b9-0571-4e4a-bbd2-790b711a6a78', 'cede8a3d-116e-4467-b9bb-fffeef3b0a0d', 'b17d7b5b-043c-4689-b224-1edb8f1db8ec'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:02:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b9406517-f7c7-4d0e-a45b-76bc1938a02e tempest-VolumesListAdminTestJSON-1591565788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b9406517-f7c7-4d0e-a45b-76bc1938a02e tempest-VolumesListAdminTestJSON-1591565788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:14 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b9406517-f7c7-4d0e-a45b-76bc1938a02e tempest-VolumesListAdminTestJSON-1591565788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:02:14 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b9406517-f7c7-4d0e-a45b-76bc1938a02e tempest-VolumesListAdminTestJSON-1591565788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:02:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b9406517-f7c7-4d0e-a45b-76bc1938a02e tempest-VolumesListAdminTestJSON-1591565788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b9406517-f7c7-4d0e-a45b-76bc1938a02e tempest-VolumesListAdminTestJSON-1591565788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:14 devstack sudo[99707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:02:14 devstack sudo[99707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:15 devstack sudo[99707]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b9406517-f7c7-4d0e-a45b-76bc1938a02e tempest-VolumesListAdminTestJSON-1591565788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.656s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:15 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-b9406517-f7c7-4d0e-a45b-76bc1938a02e tempest-VolumesListAdminTestJSON-1591565788 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:02:15 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-b9406517-f7c7-4d0e-a45b-76bc1938a02e tempest-VolumesListAdminTestJSON-1591565788 None] Deleted volume successfully. Sep 28 15:02:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b9406517-f7c7-4d0e-a45b-76bc1938a02e tempest-VolumesListAdminTestJSON-1591565788 None] Lock "cinder-02a6df8b-b419-4489-9b25-3dd3e74692a6-delete_volume" released by "delete_volume" :: held 2.685s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:02:16 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:02:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:16 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:02:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:02:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:17 devstack sudo[99711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:02:17 devstack sudo[99711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:17 devstack sudo[99711]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.782s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:17 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:02:17 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running periodic task VolumeManager._thread_info {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:02:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] thread count: 28 {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:02:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] thread info: [<_MainThread(MainThread, started 135146735652992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:02:22 devstack sudo[99668]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-368a8871-5bd5-411a-ad70-e95b7ebf296c /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-220bd177-6f8b-458e-87e1-816d258ffdaf" returned: 0 in 9.848s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:22 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] Image conversion details: src /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-368a8871-5bd5-411a-ad70-e95b7ebf296c, size 1024.00 MB, duration 9.85 sec, destination /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-220bd177-6f8b-458e-87e1-816d258ffdaf {{(pid=87116) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:02:22 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] Converted 1024.00 MB image at 103.96 MB/s Sep 28 15:02:22 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-220bd177-6f8b-458e-87e1-816d258ffdaf is being set with open permissions: ugo+rw Sep 28 15:02:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-220bd177-6f8b-458e-87e1-816d258ffdaf {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:22 devstack sudo[99716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-220bd177-6f8b-458e-87e1-816d258ffdaf Sep 28 15:02:22 devstack sudo[99716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:22 devstack sudo[99716]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-220bd177-6f8b-458e-87e1-816d258ffdaf" returned: 0 in 0.327s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:22 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] Lock "cinder-quobyte-220bd177-6f8b-458e-87e1-816d258ffdaf" released by "_copy_volume_from_snapshot" :: held 11.454s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:02:22 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] Acquiring lock "cinder-quobyte-f07b85f7-01ad-4077-b9f9-850b0fbf41bb" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:02:22 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] Lock "cinder-quobyte-f07b85f7-01ad-4077-b9f9-850b0fbf41bb" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:02:22 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] Deleting offline snapshot f07b85f7-01ad-4077-b9f9-850b0fbf41bb of volume 368a8871-5bd5-411a-ad70-e95b7ebf296c {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:02:22 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] snapshot_file for this snap is: volume-368a8871-5bd5-411a-ad70-e95b7ebf296c.f07b85f7-01ad-4077-b9f9-850b0fbf41bb {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:02:22 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[5361c2d8-0c5c-4bd5-9d08-d956ee4f03b0]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-368a8871-5bd5-411a-ad70-e95b7ebf296c.f07b85f7-01ad-4077-b9f9-850b0fbf41bb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:22 devstack sudo[99719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-368a8871-5bd5-411a-ad70-e95b7ebf296c.f07b85f7-01ad-4077-b9f9-850b0fbf41bb Sep 28 15:02:22 devstack sudo[99719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:23 devstack sudo[99719]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-368a8871-5bd5-411a-ad70-e95b7ebf296c.f07b85f7-01ad-4077-b9f9-850b0fbf41bb" returned: 0 in 0.509s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:23 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-368a8871-5bd5-411a-ad70-e95b7ebf296c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:02:23 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad34159c-efbe-44c0-a5e3-2da5988796eb]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-368a8871-5bd5-411a-ad70-e95b7ebf296c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:23 devstack sudo[99724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-368a8871-5bd5-411a-ad70-e95b7ebf296c Sep 28 15:02:23 devstack sudo[99724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:23 devstack sudo[99724]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-368a8871-5bd5-411a-ad70-e95b7ebf296c" returned: 0 in 0.692s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-368a8871-5bd5-411a-ad70-e95b7ebf296c.f07b85f7-01ad-4077-b9f9-850b0fbf41bb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:23 devstack sudo[99731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-368a8871-5bd5-411a-ad70-e95b7ebf296c.f07b85f7-01ad-4077-b9f9-850b0fbf41bb Sep 28 15:02:23 devstack sudo[99731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:24 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-47b57689-3f69-46ee-a6a0-b2a6475a2dae tempest-AttachVolumeNegativeTest-950462997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:02:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-47b57689-3f69-46ee-a6a0-b2a6475a2dae tempest-AttachVolumeNegativeTest-950462997 None] Flow 'volume_create_manager' (8d320274-6a3b-4ab9-9d9d-6804814dbe64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:02:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-47b57689-3f69-46ee-a6a0-b2a6475a2dae tempest-AttachVolumeNegativeTest-950462997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da04d670-f6dc-45b1-81af-8cab219a349b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-47b57689-3f69-46ee-a6a0-b2a6475a2dae tempest-AttachVolumeNegativeTest-950462997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da04d670-f6dc-45b1-81af-8cab219a349b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-311044581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e35a4c39-e162-4436-8762-44e1e4ad5f78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='482d3ae3d4794286b2a5140f95848307',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:02:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:02:24Z,use_quota=True,user_id='36e88df4624545bdaee4b33104bd6cc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-47b57689-3f69-46ee-a6a0-b2a6475a2dae tempest-AttachVolumeNegativeTest-950462997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de2c71e8-9edd-4f52-b577-f15475f830ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-47b57689-3f69-46ee-a6a0-b2a6475a2dae tempest-AttachVolumeNegativeTest-950462997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de2c71e8-9edd-4f52-b577-f15475f830ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-47b57689-3f69-46ee-a6a0-b2a6475a2dae tempest-AttachVolumeNegativeTest-950462997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4ce2641-c8e7-4d78-9228-4f242f1314c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-47b57689-3f69-46ee-a6a0-b2a6475a2dae tempest-AttachVolumeNegativeTest-950462997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4ce2641-c8e7-4d78-9228-4f242f1314c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e35a4c39-e162-4436-8762-44e1e4ad5f78', 'volume_name': 'volume-e35a4c39-e162-4436-8762-44e1e4ad5f78', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-47b57689-3f69-46ee-a6a0-b2a6475a2dae tempest-AttachVolumeNegativeTest-950462997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c90426f-de12-4674-ab2c-06fafea890b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-47b57689-3f69-46ee-a6a0-b2a6475a2dae tempest-AttachVolumeNegativeTest-950462997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c90426f-de12-4674-ab2c-06fafea890b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-47b57689-3f69-46ee-a6a0-b2a6475a2dae tempest-AttachVolumeNegativeTest-950462997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d0a18a9-293a-45ec-b582-47f6a9a56bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:24 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-47b57689-3f69-46ee-a6a0-b2a6475a2dae tempest-AttachVolumeNegativeTest-950462997 None] Volume e35a4c39-e162-4436-8762-44e1e4ad5f78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e35a4c39-e162-4436-8762-44e1e4ad5f78', 'volume_size': 1} Sep 28 15:02:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-47b57689-3f69-46ee-a6a0-b2a6475a2dae tempest-AttachVolumeNegativeTest-950462997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:24 devstack sudo[99731]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-368a8871-5bd5-411a-ad70-e95b7ebf296c.f07b85f7-01ad-4077-b9f9-850b0fbf41bb" returned: 0 in 0.616s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-368a8871-5bd5-411a-ad70-e95b7ebf296c.f07b85f7-01ad-4077-b9f9-850b0fbf41bb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:24 devstack sudo[99737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-368a8871-5bd5-411a-ad70-e95b7ebf296c.f07b85f7-01ad-4077-b9f9-850b0fbf41bb Sep 28 15:02:24 devstack sudo[99737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:24 devstack sudo[99737]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-368a8871-5bd5-411a-ad70-e95b7ebf296c.f07b85f7-01ad-4077-b9f9-850b0fbf41bb" returned: 0 in 0.302s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:24 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] Lock "cinder-quobyte-f07b85f7-01ad-4077-b9f9-850b0fbf41bb" released by "_delete_snapshot" :: held 2.287s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:02:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.109s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-47b57689-3f69-46ee-a6a0-b2a6475a2dae tempest-AttachVolumeNegativeTest-950462997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.474s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:24 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-47b57689-3f69-46ee-a6a0-b2a6475a2dae tempest-AttachVolumeNegativeTest-950462997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-311044581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e35a4c39-e162-4436-8762-44e1e4ad5f78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='482d3ae3d4794286b2a5140f95848307',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:02:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:02:24Z,use_quota=True,user_id='36e88df4624545bdaee4b33104bd6cc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:02:24 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-47b57689-3f69-46ee-a6a0-b2a6475a2dae tempest-AttachVolumeNegativeTest-950462997 None] Creating volume e35a4c39-e162-4436-8762-44e1e4ad5f78 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:02:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-47b57689-3f69-46ee-a6a0-b2a6475a2dae tempest-AttachVolumeNegativeTest-950462997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-47b57689-3f69-46ee-a6a0-b2a6475a2dae tempest-AttachVolumeNegativeTest-950462997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:24 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-47b57689-3f69-46ee-a6a0-b2a6475a2dae tempest-AttachVolumeNegativeTest-950462997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:02:24 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-47b57689-3f69-46ee-a6a0-b2a6475a2dae tempest-AttachVolumeNegativeTest-950462997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:02:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-47b57689-3f69-46ee-a6a0-b2a6475a2dae tempest-AttachVolumeNegativeTest-950462997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:24 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-47b57689-3f69-46ee-a6a0-b2a6475a2dae tempest-AttachVolumeNegativeTest-950462997 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:02:24 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-47b57689-3f69-46ee-a6a0-b2a6475a2dae tempest-AttachVolumeNegativeTest-950462997 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:02:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-47b57689-3f69-46ee-a6a0-b2a6475a2dae tempest-AttachVolumeNegativeTest-950462997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e35a4c39-e162-4436-8762-44e1e4ad5f78 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2effb30e-bc77-48cc-8f2f-dabe49c6d91b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-220bd177-6f8b-458e-87e1-816d258ffdaf', 'volume_size': 1, 'source_volid': '368a8871-5bd5-411a-ad70-e95b7ebf296c', 'source_volstatus': 'available'}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:24 devstack sudo[99740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e35a4c39-e162-4436-8762-44e1e4ad5f78 1073741824 Sep 28 15:02:24 devstack sudo[99740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92fc2e09-d941-44ea-8459-5dfedfe2b4b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:25 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] Volume volume-220bd177-6f8b-458e-87e1-816d258ffdaf (220bd177-6f8b-458e-87e1-816d258ffdaf): created successfully Sep 28 15:02:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92fc2e09-d941-44ea-8459-5dfedfe2b4b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] Flow 'volume_create_manager' (8d6940ae-b9c5-4841-a5a6-5a57eff637f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:02:25 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-a123a865-6d7f-4ab4-8f8d-a8629fc36fa6 tempest-VolumesGetTest-421307961 None] Created volume successfully. Sep 28 15:02:25 devstack sudo[99740]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-47b57689-3f69-46ee-a6a0-b2a6475a2dae tempest-AttachVolumeNegativeTest-950462997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e35a4c39-e162-4436-8762-44e1e4ad5f78 1073741824" returned: 0 in 0.667s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-47b57689-3f69-46ee-a6a0-b2a6475a2dae tempest-AttachVolumeNegativeTest-950462997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e35a4c39-e162-4436-8762-44e1e4ad5f78 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:25 devstack sudo[99746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e35a4c39-e162-4436-8762-44e1e4ad5f78 Sep 28 15:02:25 devstack sudo[99746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:26 devstack sudo[99746]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-47b57689-3f69-46ee-a6a0-b2a6475a2dae tempest-AttachVolumeNegativeTest-950462997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e35a4c39-e162-4436-8762-44e1e4ad5f78" returned: 0 in 0.353s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-47b57689-3f69-46ee-a6a0-b2a6475a2dae tempest-AttachVolumeNegativeTest-950462997 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:02:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-47b57689-3f69-46ee-a6a0-b2a6475a2dae tempest-AttachVolumeNegativeTest-950462997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-47b57689-3f69-46ee-a6a0-b2a6475a2dae tempest-AttachVolumeNegativeTest-950462997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d0a18a9-293a-45ec-b582-47f6a9a56bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e35a4c39-e162-4436-8762-44e1e4ad5f78', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-47b57689-3f69-46ee-a6a0-b2a6475a2dae tempest-AttachVolumeNegativeTest-950462997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f53f3da-642f-46bb-b303-0a0bdf758ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:26 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-47b57689-3f69-46ee-a6a0-b2a6475a2dae tempest-AttachVolumeNegativeTest-950462997 None] Volume volume-e35a4c39-e162-4436-8762-44e1e4ad5f78 (e35a4c39-e162-4436-8762-44e1e4ad5f78): created successfully Sep 28 15:02:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-47b57689-3f69-46ee-a6a0-b2a6475a2dae tempest-AttachVolumeNegativeTest-950462997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f53f3da-642f-46bb-b303-0a0bdf758ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-47b57689-3f69-46ee-a6a0-b2a6475a2dae tempest-AttachVolumeNegativeTest-950462997 None] Flow 'volume_create_manager' (8d320274-6a3b-4ab9-9d9d-6804814dbe64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:02:26 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-79e520be-d683-4059-bc43-77572b8bba53 tempest-VolumesTransfersTest-1146600325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:02:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-79e520be-d683-4059-bc43-77572b8bba53 tempest-VolumesTransfersTest-1146600325 None] Flow 'volume_create_manager' (6ed7fe07-f70e-4c87-b473-45231616c510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:02:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-79e520be-d683-4059-bc43-77572b8bba53 tempest-VolumesTransfersTest-1146600325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c766ec36-edf6-4bc4-a6ed-88cb9cd7c8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:26 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-47b57689-3f69-46ee-a6a0-b2a6475a2dae tempest-AttachVolumeNegativeTest-950462997 None] Created volume successfully. Sep 28 15:02:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-79e520be-d683-4059-bc43-77572b8bba53 tempest-VolumesTransfersTest-1146600325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c766ec36-edf6-4bc4-a6ed-88cb9cd7c8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:02:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-218660405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ede2032-4777-4a74-b5b7-7e151c3bc45c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e739b8d235f46dd89b023ba2e65af40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:02:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:02:26Z,use_quota=True,user_id='ed92bb09c745483180f1ce815f5a71ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-79e520be-d683-4059-bc43-77572b8bba53 tempest-VolumesTransfersTest-1146600325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ef85f5d-3d04-4f3a-a2e2-c4cfdbcefaca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-79e520be-d683-4059-bc43-77572b8bba53 tempest-VolumesTransfersTest-1146600325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ef85f5d-3d04-4f3a-a2e2-c4cfdbcefaca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-79e520be-d683-4059-bc43-77572b8bba53 tempest-VolumesTransfersTest-1146600325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce3eb37f-1ce9-4f92-bc26-333813308c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-79e520be-d683-4059-bc43-77572b8bba53 tempest-VolumesTransfersTest-1146600325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce3eb37f-1ce9-4f92-bc26-333813308c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ede2032-4777-4a74-b5b7-7e151c3bc45c', 'volume_name': 'volume-5ede2032-4777-4a74-b5b7-7e151c3bc45c', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-79e520be-d683-4059-bc43-77572b8bba53 tempest-VolumesTransfersTest-1146600325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bdac99c-6320-48b3-a4c7-564da0a58c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-79e520be-d683-4059-bc43-77572b8bba53 tempest-VolumesTransfersTest-1146600325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bdac99c-6320-48b3-a4c7-564da0a58c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-79e520be-d683-4059-bc43-77572b8bba53 tempest-VolumesTransfersTest-1146600325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d5b68fc-13c9-4912-9354-83de176bea15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:26 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-79e520be-d683-4059-bc43-77572b8bba53 tempest-VolumesTransfersTest-1146600325 None] Volume 5ede2032-4777-4a74-b5b7-7e151c3bc45c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ede2032-4777-4a74-b5b7-7e151c3bc45c', 'volume_size': 1} Sep 28 15:02:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-79e520be-d683-4059-bc43-77572b8bba53 tempest-VolumesTransfersTest-1146600325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-79e520be-d683-4059-bc43-77572b8bba53 tempest-VolumesTransfersTest-1146600325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-79e520be-d683-4059-bc43-77572b8bba53 tempest-VolumesTransfersTest-1146600325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:02:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-218660405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ede2032-4777-4a74-b5b7-7e151c3bc45c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e739b8d235f46dd89b023ba2e65af40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:02:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:02:26Z,use_quota=True,user_id='ed92bb09c745483180f1ce815f5a71ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:02:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-79e520be-d683-4059-bc43-77572b8bba53 tempest-VolumesTransfersTest-1146600325 None] Creating volume 5ede2032-4777-4a74-b5b7-7e151c3bc45c {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:02:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-79e520be-d683-4059-bc43-77572b8bba53 tempest-VolumesTransfersTest-1146600325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-79e520be-d683-4059-bc43-77572b8bba53 tempest-VolumesTransfersTest-1146600325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-79e520be-d683-4059-bc43-77572b8bba53 tempest-VolumesTransfersTest-1146600325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:02:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-79e520be-d683-4059-bc43-77572b8bba53 tempest-VolumesTransfersTest-1146600325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:02:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-79e520be-d683-4059-bc43-77572b8bba53 tempest-VolumesTransfersTest-1146600325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-79e520be-d683-4059-bc43-77572b8bba53 tempest-VolumesTransfersTest-1146600325 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:02:26 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-79e520be-d683-4059-bc43-77572b8bba53 tempest-VolumesTransfersTest-1146600325 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:02:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-79e520be-d683-4059-bc43-77572b8bba53 tempest-VolumesTransfersTest-1146600325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5ede2032-4777-4a74-b5b7-7e151c3bc45c 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:26 devstack sudo[99749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5ede2032-4777-4a74-b5b7-7e151c3bc45c 1073741824 Sep 28 15:02:26 devstack sudo[99749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:26 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cdfe08e-8518-4023-8207-865cf2ffc890 tempest-VolumesGetTest-421307961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:02:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5cdfe08e-8518-4023-8207-865cf2ffc890 tempest-VolumesGetTest-421307961 None] Flow 'volume_create_manager' (4a1dbb33-bf58-4b86-89ab-4b077edf6a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:02:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5cdfe08e-8518-4023-8207-865cf2ffc890 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca221562-6ba9-4e0a-9417-44b8d78dfbab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:26 devstack sudo[99749]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-79e520be-d683-4059-bc43-77572b8bba53 tempest-VolumesTransfersTest-1146600325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5ede2032-4777-4a74-b5b7-7e151c3bc45c 1073741824" returned: 0 in 0.689s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5cdfe08e-8518-4023-8207-865cf2ffc890 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca221562-6ba9-4e0a-9417-44b8d78dfbab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:02:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1372093068',display_name='tempest-VolumesGetTest-Volume-1560879018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec1d6d3d-1f55-4c18-9c04-7a1a1d35ed0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faba40f947cd4221a56196fd85c2337f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:02:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:02:27Z,use_quota=True,user_id='91ba074109b045f1a62611658fb66015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5cdfe08e-8518-4023-8207-865cf2ffc890 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be56025e-64fa-4d53-8d98-8e64d6541a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5cdfe08e-8518-4023-8207-865cf2ffc890 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be56025e-64fa-4d53-8d98-8e64d6541a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5cdfe08e-8518-4023-8207-865cf2ffc890 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0154b7b0-b7fb-41c9-87d2-17b35496e674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5cdfe08e-8518-4023-8207-865cf2ffc890 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0154b7b0-b7fb-41c9-87d2-17b35496e674) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec1d6d3d-1f55-4c18-9c04-7a1a1d35ed0f', 'volume_name': 'volume-ec1d6d3d-1f55-4c18-9c04-7a1a1d35ed0f', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5cdfe08e-8518-4023-8207-865cf2ffc890 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96572d0d-4a2b-4116-8b88-b4c39ad1a3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5cdfe08e-8518-4023-8207-865cf2ffc890 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96572d0d-4a2b-4116-8b88-b4c39ad1a3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5cdfe08e-8518-4023-8207-865cf2ffc890 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9a3f2ce-05b1-4968-8f68-3693f769efb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:27 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-5cdfe08e-8518-4023-8207-865cf2ffc890 tempest-VolumesGetTest-421307961 None] Volume ec1d6d3d-1f55-4c18-9c04-7a1a1d35ed0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec1d6d3d-1f55-4c18-9c04-7a1a1d35ed0f', 'volume_size': 1} Sep 28 15:02:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5cdfe08e-8518-4023-8207-865cf2ffc890 tempest-VolumesGetTest-421307961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-79e520be-d683-4059-bc43-77572b8bba53 tempest-VolumesTransfersTest-1146600325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5ede2032-4777-4a74-b5b7-7e151c3bc45c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:27 devstack sudo[99758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5ede2032-4777-4a74-b5b7-7e151c3bc45c Sep 28 15:02:27 devstack sudo[99758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:27 devstack sudo[99758]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-79e520be-d683-4059-bc43-77572b8bba53 tempest-VolumesTransfersTest-1146600325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5ede2032-4777-4a74-b5b7-7e151c3bc45c" returned: 0 in 0.348s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-79e520be-d683-4059-bc43-77572b8bba53 tempest-VolumesTransfersTest-1146600325 None] <== create_volume: return (1190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:02:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-79e520be-d683-4059-bc43-77572b8bba53 tempest-VolumesTransfersTest-1146600325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.195s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5cdfe08e-8518-4023-8207-865cf2ffc890 tempest-VolumesGetTest-421307961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.406s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5cdfe08e-8518-4023-8207-865cf2ffc890 tempest-VolumesGetTest-421307961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:02:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1372093068',display_name='tempest-VolumesGetTest-Volume-1560879018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec1d6d3d-1f55-4c18-9c04-7a1a1d35ed0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faba40f947cd4221a56196fd85c2337f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:02:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:02:27Z,use_quota=True,user_id='91ba074109b045f1a62611658fb66015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:02:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-5cdfe08e-8518-4023-8207-865cf2ffc890 tempest-VolumesGetTest-421307961 None] Creating volume ec1d6d3d-1f55-4c18-9c04-7a1a1d35ed0f {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:02:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5cdfe08e-8518-4023-8207-865cf2ffc890 tempest-VolumesGetTest-421307961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5cdfe08e-8518-4023-8207-865cf2ffc890 tempest-VolumesGetTest-421307961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5cdfe08e-8518-4023-8207-865cf2ffc890 tempest-VolumesGetTest-421307961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:02:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5cdfe08e-8518-4023-8207-865cf2ffc890 tempest-VolumesGetTest-421307961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:02:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5cdfe08e-8518-4023-8207-865cf2ffc890 tempest-VolumesGetTest-421307961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5cdfe08e-8518-4023-8207-865cf2ffc890 tempest-VolumesGetTest-421307961 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:02:27 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-5cdfe08e-8518-4023-8207-865cf2ffc890 tempest-VolumesGetTest-421307961 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:02:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5cdfe08e-8518-4023-8207-865cf2ffc890 tempest-VolumesGetTest-421307961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ec1d6d3d-1f55-4c18-9c04-7a1a1d35ed0f 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:27 devstack sudo[99761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ec1d6d3d-1f55-4c18-9c04-7a1a1d35ed0f 1073741824 Sep 28 15:02:27 devstack sudo[99761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-79e520be-d683-4059-bc43-77572b8bba53 tempest-VolumesTransfersTest-1146600325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d5b68fc-13c9-4912-9354-83de176bea15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ede2032-4777-4a74-b5b7-7e151c3bc45c', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-79e520be-d683-4059-bc43-77572b8bba53 tempest-VolumesTransfersTest-1146600325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (252daa18-e56c-453f-a544-b6ac7f6575e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:27 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cc706ea-e6e3-4980-b840-cdfb7cca48c2 tempest-AbsoluteLimitsTests-113440203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:02:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8cc706ea-e6e3-4980-b840-cdfb7cca48c2 tempest-AbsoluteLimitsTests-113440203 None] Flow 'volume_create_manager' (383e854e-fa76-4160-99f4-428b3ae33cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:02:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8cc706ea-e6e3-4980-b840-cdfb7cca48c2 tempest-AbsoluteLimitsTests-113440203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d089c804-e056-408a-8810-37dd37fe117b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:27 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-79e520be-d683-4059-bc43-77572b8bba53 tempest-VolumesTransfersTest-1146600325 None] Volume volume-5ede2032-4777-4a74-b5b7-7e151c3bc45c (5ede2032-4777-4a74-b5b7-7e151c3bc45c): created successfully Sep 28 15:02:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-79e520be-d683-4059-bc43-77572b8bba53 tempest-VolumesTransfersTest-1146600325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (252daa18-e56c-453f-a544-b6ac7f6575e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-79e520be-d683-4059-bc43-77572b8bba53 tempest-VolumesTransfersTest-1146600325 None] Flow 'volume_create_manager' (6ed7fe07-f70e-4c87-b473-45231616c510) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:02:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8cc706ea-e6e3-4980-b840-cdfb7cca48c2 tempest-AbsoluteLimitsTests-113440203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d089c804-e056-408a-8810-37dd37fe117b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:02:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2123891230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b43e232-3936-4d7a-aee2-3cd039fcd319,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='608e2eef694d464aa8ce7a7c620a41ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:02:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:02:27Z,use_quota=True,user_id='986c41d0a51144029ceef3fac00bab8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8cc706ea-e6e3-4980-b840-cdfb7cca48c2 tempest-AbsoluteLimitsTests-113440203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c1e6366-6d74-45fb-b8fb-d6edd92dc0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8cc706ea-e6e3-4980-b840-cdfb7cca48c2 tempest-AbsoluteLimitsTests-113440203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c1e6366-6d74-45fb-b8fb-d6edd92dc0a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8cc706ea-e6e3-4980-b840-cdfb7cca48c2 tempest-AbsoluteLimitsTests-113440203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce527245-6be0-430c-889d-482da76e97c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8cc706ea-e6e3-4980-b840-cdfb7cca48c2 tempest-AbsoluteLimitsTests-113440203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce527245-6be0-430c-889d-482da76e97c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b43e232-3936-4d7a-aee2-3cd039fcd319', 'volume_name': 'volume-4b43e232-3936-4d7a-aee2-3cd039fcd319', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8cc706ea-e6e3-4980-b840-cdfb7cca48c2 tempest-AbsoluteLimitsTests-113440203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a198c8e3-d872-45b9-9d54-53c3d25be12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8cc706ea-e6e3-4980-b840-cdfb7cca48c2 tempest-AbsoluteLimitsTests-113440203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a198c8e3-d872-45b9-9d54-53c3d25be12d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8cc706ea-e6e3-4980-b840-cdfb7cca48c2 tempest-AbsoluteLimitsTests-113440203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f152b3f7-4f1d-4cc5-83b8-ccef38af542a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:27 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-8cc706ea-e6e3-4980-b840-cdfb7cca48c2 tempest-AbsoluteLimitsTests-113440203 None] Volume 4b43e232-3936-4d7a-aee2-3cd039fcd319: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b43e232-3936-4d7a-aee2-3cd039fcd319', 'volume_size': 1} Sep 28 15:02:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8cc706ea-e6e3-4980-b840-cdfb7cca48c2 tempest-AbsoluteLimitsTests-113440203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:27 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-79e520be-d683-4059-bc43-77572b8bba53 tempest-VolumesTransfersTest-1146600325 None] Created volume successfully. Sep 28 15:02:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-6f35cc7f-e5c0-4b24-84c5-5d0704d25e0d req-7d0a0ee5-816f-4396-af1b-94950fb25d05 tempest-AttachVolumeNegativeTest-950462997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:27 devstack sudo[99761]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5cdfe08e-8518-4023-8207-865cf2ffc890 tempest-VolumesGetTest-421307961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ec1d6d3d-1f55-4c18-9c04-7a1a1d35ed0f 1073741824" returned: 0 in 0.504s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5cdfe08e-8518-4023-8207-865cf2ffc890 tempest-VolumesGetTest-421307961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ec1d6d3d-1f55-4c18-9c04-7a1a1d35ed0f {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:28 devstack sudo[99775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ec1d6d3d-1f55-4c18-9c04-7a1a1d35ed0f Sep 28 15:02:28 devstack sudo[99775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:28 devstack sudo[99775]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5cdfe08e-8518-4023-8207-865cf2ffc890 tempest-VolumesGetTest-421307961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ec1d6d3d-1f55-4c18-9c04-7a1a1d35ed0f" returned: 0 in 0.270s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:28 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5cdfe08e-8518-4023-8207-865cf2ffc890 tempest-VolumesGetTest-421307961 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:02:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5cdfe08e-8518-4023-8207-865cf2ffc890 tempest-VolumesGetTest-421307961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8cc706ea-e6e3-4980-b840-cdfb7cca48c2 tempest-AbsoluteLimitsTests-113440203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.653s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:28 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8cc706ea-e6e3-4980-b840-cdfb7cca48c2 tempest-AbsoluteLimitsTests-113440203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:02:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2123891230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b43e232-3936-4d7a-aee2-3cd039fcd319,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='608e2eef694d464aa8ce7a7c620a41ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:02:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:02:27Z,use_quota=True,user_id='986c41d0a51144029ceef3fac00bab8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:02:28 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-8cc706ea-e6e3-4980-b840-cdfb7cca48c2 tempest-AbsoluteLimitsTests-113440203 None] Creating volume 4b43e232-3936-4d7a-aee2-3cd039fcd319 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:02:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8cc706ea-e6e3-4980-b840-cdfb7cca48c2 tempest-AbsoluteLimitsTests-113440203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8cc706ea-e6e3-4980-b840-cdfb7cca48c2 tempest-AbsoluteLimitsTests-113440203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:28 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8cc706ea-e6e3-4980-b840-cdfb7cca48c2 tempest-AbsoluteLimitsTests-113440203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:02:28 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8cc706ea-e6e3-4980-b840-cdfb7cca48c2 tempest-AbsoluteLimitsTests-113440203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:02:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8cc706ea-e6e3-4980-b840-cdfb7cca48c2 tempest-AbsoluteLimitsTests-113440203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:28 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8cc706ea-e6e3-4980-b840-cdfb7cca48c2 tempest-AbsoluteLimitsTests-113440203 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:02:28 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-8cc706ea-e6e3-4980-b840-cdfb7cca48c2 tempest-AbsoluteLimitsTests-113440203 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:02:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8cc706ea-e6e3-4980-b840-cdfb7cca48c2 tempest-AbsoluteLimitsTests-113440203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4b43e232-3936-4d7a-aee2-3cd039fcd319 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:28 devstack sudo[99778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4b43e232-3936-4d7a-aee2-3cd039fcd319 1073741824 Sep 28 15:02:28 devstack sudo[99778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5cdfe08e-8518-4023-8207-865cf2ffc890 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9a3f2ce-05b1-4968-8f68-3693f769efb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec1d6d3d-1f55-4c18-9c04-7a1a1d35ed0f', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5cdfe08e-8518-4023-8207-865cf2ffc890 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a762bf8-64f4-49fb-9892-37656c0b614c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:28 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-5cdfe08e-8518-4023-8207-865cf2ffc890 tempest-VolumesGetTest-421307961 None] Volume volume-ec1d6d3d-1f55-4c18-9c04-7a1a1d35ed0f (ec1d6d3d-1f55-4c18-9c04-7a1a1d35ed0f): created successfully Sep 28 15:02:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5cdfe08e-8518-4023-8207-865cf2ffc890 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a762bf8-64f4-49fb-9892-37656c0b614c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5cdfe08e-8518-4023-8207-865cf2ffc890 tempest-VolumesGetTest-421307961 None] Flow 'volume_create_manager' (4a1dbb33-bf58-4b86-89ab-4b077edf6a01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:02:28 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-5cdfe08e-8518-4023-8207-865cf2ffc890 tempest-VolumesGetTest-421307961 None] Created volume successfully. Sep 28 15:02:28 devstack sudo[99778]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8cc706ea-e6e3-4980-b840-cdfb7cca48c2 tempest-AbsoluteLimitsTests-113440203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4b43e232-3936-4d7a-aee2-3cd039fcd319 1073741824" returned: 0 in 0.545s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8cc706ea-e6e3-4980-b840-cdfb7cca48c2 tempest-AbsoluteLimitsTests-113440203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4b43e232-3936-4d7a-aee2-3cd039fcd319 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:28 devstack sudo[99785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4b43e232-3936-4d7a-aee2-3cd039fcd319 Sep 28 15:02:28 devstack sudo[99785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:29 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-2e8029a9-c79f-4069-a418-ddc838185685 tempest-VolumesTransfersTest-1541882685 None] Transfer volume completed successfully. Sep 28 15:02:29 devstack sudo[99785]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8cc706ea-e6e3-4980-b840-cdfb7cca48c2 tempest-AbsoluteLimitsTests-113440203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4b43e232-3936-4d7a-aee2-3cd039fcd319" returned: 0 in 0.342s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:29 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8cc706ea-e6e3-4980-b840-cdfb7cca48c2 tempest-AbsoluteLimitsTests-113440203 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:02:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8cc706ea-e6e3-4980-b840-cdfb7cca48c2 tempest-AbsoluteLimitsTests-113440203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-6f35cc7f-e5c0-4b24-84c5-5d0704d25e0d req-7d0a0ee5-816f-4396-af1b-94950fb25d05 tempest-AttachVolumeNegativeTest-950462997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.535s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8cc706ea-e6e3-4980-b840-cdfb7cca48c2 tempest-AbsoluteLimitsTests-113440203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f152b3f7-4f1d-4cc5-83b8-ccef38af542a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b43e232-3936-4d7a-aee2-3cd039fcd319', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8cc706ea-e6e3-4980-b840-cdfb7cca48c2 tempest-AbsoluteLimitsTests-113440203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0acd3f7a-357b-49bf-abfc-f8f15b34a1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-6f35cc7f-e5c0-4b24-84c5-5d0704d25e0d req-7d0a0ee5-816f-4396-af1b-94950fb25d05 tempest-AttachVolumeNegativeTest-950462997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:29 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-8cc706ea-e6e3-4980-b840-cdfb7cca48c2 tempest-AbsoluteLimitsTests-113440203 None] Volume volume-4b43e232-3936-4d7a-aee2-3cd039fcd319 (4b43e232-3936-4d7a-aee2-3cd039fcd319): created successfully Sep 28 15:02:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8cc706ea-e6e3-4980-b840-cdfb7cca48c2 tempest-AbsoluteLimitsTests-113440203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0acd3f7a-357b-49bf-abfc-f8f15b34a1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8cc706ea-e6e3-4980-b840-cdfb7cca48c2 tempest-AbsoluteLimitsTests-113440203 None] Flow 'volume_create_manager' (383e854e-fa76-4160-99f4-428b3ae33cfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:02:29 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-8cc706ea-e6e3-4980-b840-cdfb7cca48c2 tempest-AbsoluteLimitsTests-113440203 None] Created volume successfully. Sep 28 15:02:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-6f35cc7f-e5c0-4b24-84c5-5d0704d25e0d req-7d0a0ee5-816f-4396-af1b-94950fb25d05 tempest-AttachVolumeNegativeTest-950462997 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1', 'name': 'volume-e35a4c39-e162-4436-8762-44e1e4ad5f78', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9ea941c2-8228-46fb-9d77-a653c5fb01de', 'enforce_multipath': True} {{(pid=87116) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:02:29 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-6f35cc7f-e5c0-4b24-84c5-5d0704d25e0d req-7d0a0ee5-816f-4396-af1b-94950fb25d05 tempest-AttachVolumeNegativeTest-950462997 None] attachment_update completed successfully. Sep 28 15:02:29 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0230a517-86bb-42fd-930b-a81e99537d07 tempest-VolumesGetTest-421307961 None] Acquiring lock "cinder-ec1d6d3d-1f55-4c18-9c04-7a1a1d35ed0f-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:02:29 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0230a517-86bb-42fd-930b-a81e99537d07 tempest-VolumesGetTest-421307961 None] Lock "cinder-ec1d6d3d-1f55-4c18-9c04-7a1a1d35ed0f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:02:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0230a517-86bb-42fd-930b-a81e99537d07 tempest-VolumesGetTest-421307961 None] Acquiring lock "cinder-quobyte-ec1d6d3d-1f55-4c18-9c04-7a1a1d35ed0f" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:02:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0230a517-86bb-42fd-930b-a81e99537d07 tempest-VolumesGetTest-421307961 None] Lock "cinder-quobyte-ec1d6d3d-1f55-4c18-9c04-7a1a1d35ed0f" acquired by "delete_volume" :: waited 0.035s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:02:30 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a81fd14-e7ce-4dce-bb4d-658aaf68775f]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0230a517-86bb-42fd-930b-a81e99537d07 tempest-VolumesGetTest-421307961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ec1d6d3d-1f55-4c18-9c04-7a1a1d35ed0f {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d01c7985-0000-4f8d-b6f6-e8a9ab31d98f tempest-AbsoluteLimitsTests-113440203 None] Acquiring lock "cinder-4b43e232-3936-4d7a-aee2-3cd039fcd319-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:02:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d01c7985-0000-4f8d-b6f6-e8a9ab31d98f tempest-AbsoluteLimitsTests-113440203 None] Lock "cinder-4b43e232-3936-4d7a-aee2-3cd039fcd319-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:02:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3d0c888f-889c-4307-a346-c93ce1f954fb tempest-VolumesTransfersTest-186114192 None] Acquiring lock "cinder-5ede2032-4777-4a74-b5b7-7e151c3bc45c-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:02:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3d0c888f-889c-4307-a346-c93ce1f954fb tempest-VolumesTransfersTest-186114192 None] Lock "cinder-5ede2032-4777-4a74-b5b7-7e151c3bc45c-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:02:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d01c7985-0000-4f8d-b6f6-e8a9ab31d98f tempest-AbsoluteLimitsTests-113440203 None] Acquiring lock "cinder-quobyte-4b43e232-3936-4d7a-aee2-3cd039fcd319" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:02:30 devstack sudo[100202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ec1d6d3d-1f55-4c18-9c04-7a1a1d35ed0f Sep 28 15:02:30 devstack sudo[100202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d01c7985-0000-4f8d-b6f6-e8a9ab31d98f tempest-AbsoluteLimitsTests-113440203 None] Lock "cinder-quobyte-4b43e232-3936-4d7a-aee2-3cd039fcd319" acquired by "delete_volume" :: waited 0.048s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:02:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3d0c888f-889c-4307-a346-c93ce1f954fb tempest-VolumesTransfersTest-186114192 None] Acquiring lock "cinder-quobyte-5ede2032-4777-4a74-b5b7-7e151c3bc45c" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:02:30 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[e350f240-f8a2-40e0-b7dc-ce732148e5c2]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d01c7985-0000-4f8d-b6f6-e8a9ab31d98f tempest-AbsoluteLimitsTests-113440203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4b43e232-3936-4d7a-aee2-3cd039fcd319 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3d0c888f-889c-4307-a346-c93ce1f954fb tempest-VolumesTransfersTest-186114192 None] Lock "cinder-quobyte-5ede2032-4777-4a74-b5b7-7e151c3bc45c" acquired by "delete_volume" :: waited 0.043s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:02:30 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[35510dab-1d98-41ad-833c-290b39ca7375]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3d0c888f-889c-4307-a346-c93ce1f954fb tempest-VolumesTransfersTest-186114192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5ede2032-4777-4a74-b5b7-7e151c3bc45c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:30 devstack sudo[100239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4b43e232-3936-4d7a-aee2-3cd039fcd319 Sep 28 15:02:30 devstack sudo[100239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:30 devstack sudo[100243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5ede2032-4777-4a74-b5b7-7e151c3bc45c Sep 28 15:02:30 devstack sudo[100243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:30 devstack sudo[100202]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0230a517-86bb-42fd-930b-a81e99537d07 tempest-VolumesGetTest-421307961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ec1d6d3d-1f55-4c18-9c04-7a1a1d35ed0f" returned: 0 in 0.821s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0230a517-86bb-42fd-930b-a81e99537d07 tempest-VolumesGetTest-421307961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ec1d6d3d-1f55-4c18-9c04-7a1a1d35ed0f {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:31 devstack sudo[100254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ec1d6d3d-1f55-4c18-9c04-7a1a1d35ed0f Sep 28 15:02:31 devstack sudo[100254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:31 devstack sudo[100239]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d01c7985-0000-4f8d-b6f6-e8a9ab31d98f tempest-AbsoluteLimitsTests-113440203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4b43e232-3936-4d7a-aee2-3cd039fcd319" returned: 0 in 0.683s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d01c7985-0000-4f8d-b6f6-e8a9ab31d98f tempest-AbsoluteLimitsTests-113440203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4b43e232-3936-4d7a-aee2-3cd039fcd319 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:31 devstack sudo[100259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4b43e232-3936-4d7a-aee2-3cd039fcd319 Sep 28 15:02:31 devstack sudo[100259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:31 devstack sudo[100254]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0230a517-86bb-42fd-930b-a81e99537d07 tempest-VolumesGetTest-421307961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ec1d6d3d-1f55-4c18-9c04-7a1a1d35ed0f" returned: 0 in 0.400s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:31 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0230a517-86bb-42fd-930b-a81e99537d07 tempest-VolumesGetTest-421307961 None] Lock "cinder-quobyte-ec1d6d3d-1f55-4c18-9c04-7a1a1d35ed0f" released by "delete_volume" :: held 1.327s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:02:31 devstack sudo[100243]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3d0c888f-889c-4307-a346-c93ce1f954fb tempest-VolumesTransfersTest-186114192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5ede2032-4777-4a74-b5b7-7e151c3bc45c" returned: 0 in 0.821s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3d0c888f-889c-4307-a346-c93ce1f954fb tempest-VolumesTransfersTest-186114192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5ede2032-4777-4a74-b5b7-7e151c3bc45c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:31 devstack sudo[100265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5ede2032-4777-4a74-b5b7-7e151c3bc45c Sep 28 15:02:31 devstack sudo[100265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:31 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-0230a517-86bb-42fd-930b-a81e99537d07 tempest-VolumesGetTest-421307961 None] Created reservations ['aa4b4f80-a309-401d-8fe6-0bf42e2b27f4', 'de7b24f4-b9a5-47bc-b45f-5bde4aef8b9a', 'd9a5ea8e-36af-439a-afec-bcc3a03efc11', 'caa0519b-d642-44cb-8719-03c4b9845215'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:02:31 devstack sudo[100259]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d01c7985-0000-4f8d-b6f6-e8a9ab31d98f tempest-AbsoluteLimitsTests-113440203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4b43e232-3936-4d7a-aee2-3cd039fcd319" returned: 0 in 0.378s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:31 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d01c7985-0000-4f8d-b6f6-e8a9ab31d98f tempest-AbsoluteLimitsTests-113440203 None] Lock "cinder-quobyte-4b43e232-3936-4d7a-aee2-3cd039fcd319" released by "delete_volume" :: held 1.142s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:02:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0230a517-86bb-42fd-930b-a81e99537d07 tempest-VolumesGetTest-421307961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0230a517-86bb-42fd-930b-a81e99537d07 tempest-VolumesGetTest-421307961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:31 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0230a517-86bb-42fd-930b-a81e99537d07 tempest-VolumesGetTest-421307961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:02:31 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0230a517-86bb-42fd-930b-a81e99537d07 tempest-VolumesGetTest-421307961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:02:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0230a517-86bb-42fd-930b-a81e99537d07 tempest-VolumesGetTest-421307961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0230a517-86bb-42fd-930b-a81e99537d07 tempest-VolumesGetTest-421307961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:31 devstack sudo[100268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:02:31 devstack sudo[100268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:31 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-d01c7985-0000-4f8d-b6f6-e8a9ab31d98f tempest-AbsoluteLimitsTests-113440203 None] Created reservations ['bdc59c88-24cb-4e29-b41b-ec880a97ba0c', 'e0f92f50-b388-4b9e-adbc-ce9e32843491', 'f2b5a66d-f22a-4ba6-a5d7-4bd4688b98ca', 'dee38b6c-7503-436f-b56c-8d7922b59a0e'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:02:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d01c7985-0000-4f8d-b6f6-e8a9ab31d98f tempest-AbsoluteLimitsTests-113440203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d01c7985-0000-4f8d-b6f6-e8a9ab31d98f tempest-AbsoluteLimitsTests-113440203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:31 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d01c7985-0000-4f8d-b6f6-e8a9ab31d98f tempest-AbsoluteLimitsTests-113440203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:02:31 devstack sudo[100265]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:31 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d01c7985-0000-4f8d-b6f6-e8a9ab31d98f tempest-AbsoluteLimitsTests-113440203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:02:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d01c7985-0000-4f8d-b6f6-e8a9ab31d98f tempest-AbsoluteLimitsTests-113440203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d01c7985-0000-4f8d-b6f6-e8a9ab31d98f tempest-AbsoluteLimitsTests-113440203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3d0c888f-889c-4307-a346-c93ce1f954fb tempest-VolumesTransfersTest-186114192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5ede2032-4777-4a74-b5b7-7e151c3bc45c" returned: 0 in 0.384s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:31 devstack sudo[100271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:02:31 devstack sudo[100271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:31 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3d0c888f-889c-4307-a346-c93ce1f954fb tempest-VolumesTransfersTest-186114192 None] Lock "cinder-quobyte-5ede2032-4777-4a74-b5b7-7e151c3bc45c" released by "delete_volume" :: held 1.302s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:02:31 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-3d0c888f-889c-4307-a346-c93ce1f954fb tempest-VolumesTransfersTest-186114192 None] Created reservations ['964ff84e-f03d-4300-8633-7eacc444e14b', 'e95d4c5c-477a-4d9e-a6c0-90aa63d0677d', '61f53347-abcf-4e17-a685-fcd1076720b0', '5c81a97b-de6d-46b3-ad1b-3c5affea3ef3'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:02:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3d0c888f-889c-4307-a346-c93ce1f954fb tempest-VolumesTransfersTest-186114192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3d0c888f-889c-4307-a346-c93ce1f954fb tempest-VolumesTransfersTest-186114192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:31 devstack sudo[100268]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:31 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3d0c888f-889c-4307-a346-c93ce1f954fb tempest-VolumesTransfersTest-186114192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:02:31 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3d0c888f-889c-4307-a346-c93ce1f954fb tempest-VolumesTransfersTest-186114192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:02:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3d0c888f-889c-4307-a346-c93ce1f954fb tempest-VolumesTransfersTest-186114192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3d0c888f-889c-4307-a346-c93ce1f954fb tempest-VolumesTransfersTest-186114192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0230a517-86bb-42fd-930b-a81e99537d07 tempest-VolumesGetTest-421307961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.399s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:32 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-0230a517-86bb-42fd-930b-a81e99537d07 tempest-VolumesGetTest-421307961 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:02:32 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-0230a517-86bb-42fd-930b-a81e99537d07 tempest-VolumesGetTest-421307961 None] Deleted volume successfully. Sep 28 15:02:32 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0230a517-86bb-42fd-930b-a81e99537d07 tempest-VolumesGetTest-421307961 None] Lock "cinder-ec1d6d3d-1f55-4c18-9c04-7a1a1d35ed0f-delete_volume" released by "delete_volume" :: held 2.089s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:02:32 devstack sudo[100274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:02:32 devstack sudo[100274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:32 devstack sudo[100271]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d01c7985-0000-4f8d-b6f6-e8a9ab31d98f tempest-AbsoluteLimitsTests-113440203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.353s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:32 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-d01c7985-0000-4f8d-b6f6-e8a9ab31d98f tempest-AbsoluteLimitsTests-113440203 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:02:32 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-d01c7985-0000-4f8d-b6f6-e8a9ab31d98f tempest-AbsoluteLimitsTests-113440203 None] Deleted volume successfully. Sep 28 15:02:32 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d01c7985-0000-4f8d-b6f6-e8a9ab31d98f tempest-AbsoluteLimitsTests-113440203 None] Lock "cinder-4b43e232-3936-4d7a-aee2-3cd039fcd319-delete_volume" released by "delete_volume" :: held 1.907s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:02:32 devstack sudo[100274]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3d0c888f-889c-4307-a346-c93ce1f954fb tempest-VolumesTransfersTest-186114192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.356s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:32 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-3d0c888f-889c-4307-a346-c93ce1f954fb tempest-VolumesTransfersTest-186114192 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:02:32 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-3d0c888f-889c-4307-a346-c93ce1f954fb tempest-VolumesTransfersTest-186114192 None] Deleted volume successfully. Sep 28 15:02:32 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3d0c888f-889c-4307-a346-c93ce1f954fb tempest-VolumesTransfersTest-186114192 None] Lock "cinder-5ede2032-4777-4a74-b5b7-7e151c3bc45c-delete_volume" released by "delete_volume" :: held 2.038s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:02:32 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-81ed68f2-0540-4772-9475-7dbba4f003f5 tempest-VolumesGetTest-421307961 None] Acquiring lock "cinder-220bd177-6f8b-458e-87e1-816d258ffdaf-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:02:32 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-81ed68f2-0540-4772-9475-7dbba4f003f5 tempest-VolumesGetTest-421307961 None] Lock "cinder-220bd177-6f8b-458e-87e1-816d258ffdaf-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:02:32 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-81ed68f2-0540-4772-9475-7dbba4f003f5 tempest-VolumesGetTest-421307961 None] Acquiring lock "cinder-quobyte-220bd177-6f8b-458e-87e1-816d258ffdaf" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:02:32 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-81ed68f2-0540-4772-9475-7dbba4f003f5 tempest-VolumesGetTest-421307961 None] Lock "cinder-quobyte-220bd177-6f8b-458e-87e1-816d258ffdaf" acquired by "delete_volume" :: waited 0.025s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:02:32 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[619ea69e-c0d9-4cf8-862a-99b2e7ab76bb]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-81ed68f2-0540-4772-9475-7dbba4f003f5 tempest-VolumesGetTest-421307961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-220bd177-6f8b-458e-87e1-816d258ffdaf {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:32 devstack sudo[100284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-220bd177-6f8b-458e-87e1-816d258ffdaf Sep 28 15:02:32 devstack sudo[100284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:33 devstack sudo[100284]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-81ed68f2-0540-4772-9475-7dbba4f003f5 tempest-VolumesGetTest-421307961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-220bd177-6f8b-458e-87e1-816d258ffdaf" returned: 0 in 0.566s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-81ed68f2-0540-4772-9475-7dbba4f003f5 tempest-VolumesGetTest-421307961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-220bd177-6f8b-458e-87e1-816d258ffdaf {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:33 devstack sudo[100293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-220bd177-6f8b-458e-87e1-816d258ffdaf Sep 28 15:02:33 devstack sudo[100293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:33 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-6d63c72a-c4b2-472d-9fe6-737f323cdb67 req-7b562022-0c20-49a4-804b-2d0299acd095 tempest-AttachVolumeNegativeTest-950462997 None] Terminate volume connection completed successfully. Sep 28 15:02:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-6d63c72a-c4b2-472d-9fe6-737f323cdb67 req-7b562022-0c20-49a4-804b-2d0299acd095 tempest-AttachVolumeNegativeTest-950462997 None] Deleting attachment 9ea941c2-8228-46fb-9d77-a653c5fb01de. {{(pid=87116) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:02:33 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-633a39e5-b971-474c-95ee-ee36891e50ff tempest-VolumesTransfersTest-1146600325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:02:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-633a39e5-b971-474c-95ee-ee36891e50ff tempest-VolumesTransfersTest-1146600325 None] Flow 'volume_create_manager' (a1890b18-6109-4353-96a1-5218730b36e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:02:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-633a39e5-b971-474c-95ee-ee36891e50ff tempest-VolumesTransfersTest-1146600325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f1ffffa-fee4-4efb-b60e-f27509ec4ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:33 devstack sudo[100293]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-81ed68f2-0540-4772-9475-7dbba4f003f5 tempest-VolumesGetTest-421307961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-220bd177-6f8b-458e-87e1-816d258ffdaf" returned: 0 in 0.471s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-633a39e5-b971-474c-95ee-ee36891e50ff tempest-VolumesTransfersTest-1146600325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f1ffffa-fee4-4efb-b60e-f27509ec4ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:02:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1864113203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c949314-59c8-494f-9de4-09527b45dca2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e739b8d235f46dd89b023ba2e65af40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:02:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:02:34Z,use_quota=True,user_id='ed92bb09c745483180f1ce815f5a71ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-633a39e5-b971-474c-95ee-ee36891e50ff tempest-VolumesTransfersTest-1146600325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba4af555-ea1f-414e-a13d-75beeaf9f8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-633a39e5-b971-474c-95ee-ee36891e50ff tempest-VolumesTransfersTest-1146600325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba4af555-ea1f-414e-a13d-75beeaf9f8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-633a39e5-b971-474c-95ee-ee36891e50ff tempest-VolumesTransfersTest-1146600325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8bdf568-069e-4aff-bcc7-16dc4a21a7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-633a39e5-b971-474c-95ee-ee36891e50ff tempest-VolumesTransfersTest-1146600325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8bdf568-069e-4aff-bcc7-16dc4a21a7c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c949314-59c8-494f-9de4-09527b45dca2', 'volume_name': 'volume-3c949314-59c8-494f-9de4-09527b45dca2', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-633a39e5-b971-474c-95ee-ee36891e50ff tempest-VolumesTransfersTest-1146600325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faafd8e5-423b-4472-abb6-aa86b55e39e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-633a39e5-b971-474c-95ee-ee36891e50ff tempest-VolumesTransfersTest-1146600325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faafd8e5-423b-4472-abb6-aa86b55e39e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-633a39e5-b971-474c-95ee-ee36891e50ff tempest-VolumesTransfersTest-1146600325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b711bb2-5524-4275-a0d9-589b9b718512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:33 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-633a39e5-b971-474c-95ee-ee36891e50ff tempest-VolumesTransfersTest-1146600325 None] Volume 3c949314-59c8-494f-9de4-09527b45dca2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c949314-59c8-494f-9de4-09527b45dca2', 'volume_size': 1} Sep 28 15:02:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-633a39e5-b971-474c-95ee-ee36891e50ff tempest-VolumesTransfersTest-1146600325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-633a39e5-b971-474c-95ee-ee36891e50ff tempest-VolumesTransfersTest-1146600325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:33 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-633a39e5-b971-474c-95ee-ee36891e50ff tempest-VolumesTransfersTest-1146600325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:02:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1864113203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c949314-59c8-494f-9de4-09527b45dca2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e739b8d235f46dd89b023ba2e65af40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:02:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:02:34Z,use_quota=True,user_id='ed92bb09c745483180f1ce815f5a71ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:02:33 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-633a39e5-b971-474c-95ee-ee36891e50ff tempest-VolumesTransfersTest-1146600325 None] Creating volume 3c949314-59c8-494f-9de4-09527b45dca2 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:02:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-633a39e5-b971-474c-95ee-ee36891e50ff tempest-VolumesTransfersTest-1146600325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-633a39e5-b971-474c-95ee-ee36891e50ff tempest-VolumesTransfersTest-1146600325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:33 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-633a39e5-b971-474c-95ee-ee36891e50ff tempest-VolumesTransfersTest-1146600325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:02:33 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-633a39e5-b971-474c-95ee-ee36891e50ff tempest-VolumesTransfersTest-1146600325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:02:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-633a39e5-b971-474c-95ee-ee36891e50ff tempest-VolumesTransfersTest-1146600325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:33 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-633a39e5-b971-474c-95ee-ee36891e50ff tempest-VolumesTransfersTest-1146600325 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:02:33 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-633a39e5-b971-474c-95ee-ee36891e50ff tempest-VolumesTransfersTest-1146600325 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:02:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-633a39e5-b971-474c-95ee-ee36891e50ff tempest-VolumesTransfersTest-1146600325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3c949314-59c8-494f-9de4-09527b45dca2 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-81ed68f2-0540-4772-9475-7dbba4f003f5 tempest-VolumesGetTest-421307961 None] Lock "cinder-quobyte-220bd177-6f8b-458e-87e1-816d258ffdaf" released by "delete_volume" :: held 1.229s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:02:33 devstack sudo[100323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3c949314-59c8-494f-9de4-09527b45dca2 1073741824 Sep 28 15:02:33 devstack sudo[100323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:33 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-81ed68f2-0540-4772-9475-7dbba4f003f5 tempest-VolumesGetTest-421307961 None] Created reservations ['3e33d406-c9f3-4124-9ab6-86b85be8d681', '6d95edb3-bcb5-4bd1-b644-d0110dd7f52e', 'cf22ab9e-45da-4553-89ac-056ef4f97c77', '69af3aad-5d02-4026-99bc-dfe02f1a4c6f'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:02:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-81ed68f2-0540-4772-9475-7dbba4f003f5 tempest-VolumesGetTest-421307961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-81ed68f2-0540-4772-9475-7dbba4f003f5 tempest-VolumesGetTest-421307961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:34 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-81ed68f2-0540-4772-9475-7dbba4f003f5 tempest-VolumesGetTest-421307961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:02:34 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-81ed68f2-0540-4772-9475-7dbba4f003f5 tempest-VolumesGetTest-421307961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:02:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-81ed68f2-0540-4772-9475-7dbba4f003f5 tempest-VolumesGetTest-421307961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-81ed68f2-0540-4772-9475-7dbba4f003f5 tempest-VolumesGetTest-421307961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:34 devstack sudo[100325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:02:34 devstack sudo[100325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:34 devstack sudo[100325]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-81ed68f2-0540-4772-9475-7dbba4f003f5 tempest-VolumesGetTest-421307961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.555s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:34 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-81ed68f2-0540-4772-9475-7dbba4f003f5 tempest-VolumesGetTest-421307961 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:02:34 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-81ed68f2-0540-4772-9475-7dbba4f003f5 tempest-VolumesGetTest-421307961 None] Deleted volume successfully. Sep 28 15:02:34 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-81ed68f2-0540-4772-9475-7dbba4f003f5 tempest-VolumesGetTest-421307961 None] Lock "cinder-220bd177-6f8b-458e-87e1-816d258ffdaf-delete_volume" released by "delete_volume" :: held 2.160s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:02:34 devstack sudo[100323]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-633a39e5-b971-474c-95ee-ee36891e50ff tempest-VolumesTransfersTest-1146600325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3c949314-59c8-494f-9de4-09527b45dca2 1073741824" returned: 0 in 0.915s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-633a39e5-b971-474c-95ee-ee36891e50ff tempest-VolumesTransfersTest-1146600325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3c949314-59c8-494f-9de4-09527b45dca2 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:34 devstack sudo[100335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3c949314-59c8-494f-9de4-09527b45dca2 Sep 28 15:02:34 devstack sudo[100335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:35 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-78b1d77c-83df-4b3d-ac7f-9ed079abd515 tempest-VolumesGetTest-421307961 None] Acquiring lock "cinder-368a8871-5bd5-411a-ad70-e95b7ebf296c-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:02:35 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-78b1d77c-83df-4b3d-ac7f-9ed079abd515 tempest-VolumesGetTest-421307961 None] Lock "cinder-368a8871-5bd5-411a-ad70-e95b7ebf296c-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:02:35 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-78b1d77c-83df-4b3d-ac7f-9ed079abd515 tempest-VolumesGetTest-421307961 None] Acquiring lock "cinder-quobyte-368a8871-5bd5-411a-ad70-e95b7ebf296c" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:02:35 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-78b1d77c-83df-4b3d-ac7f-9ed079abd515 tempest-VolumesGetTest-421307961 None] Lock "cinder-quobyte-368a8871-5bd5-411a-ad70-e95b7ebf296c" acquired by "delete_volume" :: waited 0.033s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:02:35 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[884c5fbc-0c5c-4c4f-96cf-f6d2a75dacc1]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-78b1d77c-83df-4b3d-ac7f-9ed079abd515 tempest-VolumesGetTest-421307961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-368a8871-5bd5-411a-ad70-e95b7ebf296c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:35 devstack sudo[100335]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-633a39e5-b971-474c-95ee-ee36891e50ff tempest-VolumesTransfersTest-1146600325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3c949314-59c8-494f-9de4-09527b45dca2" returned: 0 in 0.666s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-633a39e5-b971-474c-95ee-ee36891e50ff tempest-VolumesTransfersTest-1146600325 None] <== create_volume: return (1644ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:02:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-633a39e5-b971-474c-95ee-ee36891e50ff tempest-VolumesTransfersTest-1146600325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.649s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-633a39e5-b971-474c-95ee-ee36891e50ff tempest-VolumesTransfersTest-1146600325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b711bb2-5524-4275-a0d9-589b9b718512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c949314-59c8-494f-9de4-09527b45dca2', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-633a39e5-b971-474c-95ee-ee36891e50ff tempest-VolumesTransfersTest-1146600325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42f7aea8-1150-48f4-aa1f-b2554a12970e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:35 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-633a39e5-b971-474c-95ee-ee36891e50ff tempest-VolumesTransfersTest-1146600325 None] Volume volume-3c949314-59c8-494f-9de4-09527b45dca2 (3c949314-59c8-494f-9de4-09527b45dca2): created successfully Sep 28 15:02:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-633a39e5-b971-474c-95ee-ee36891e50ff tempest-VolumesTransfersTest-1146600325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42f7aea8-1150-48f4-aa1f-b2554a12970e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-633a39e5-b971-474c-95ee-ee36891e50ff tempest-VolumesTransfersTest-1146600325 None] Flow 'volume_create_manager' (a1890b18-6109-4353-96a1-5218730b36e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:02:35 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-633a39e5-b971-474c-95ee-ee36891e50ff tempest-VolumesTransfersTest-1146600325 None] Created volume successfully. Sep 28 15:02:35 devstack sudo[100356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-368a8871-5bd5-411a-ad70-e95b7ebf296c Sep 28 15:02:35 devstack sudo[100356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:36 devstack sudo[100356]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-78b1d77c-83df-4b3d-ac7f-9ed079abd515 tempest-VolumesGetTest-421307961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-368a8871-5bd5-411a-ad70-e95b7ebf296c" returned: 0 in 0.589s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-78b1d77c-83df-4b3d-ac7f-9ed079abd515 tempest-VolumesGetTest-421307961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-368a8871-5bd5-411a-ad70-e95b7ebf296c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:36 devstack sudo[100363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-368a8871-5bd5-411a-ad70-e95b7ebf296c Sep 28 15:02:36 devstack sudo[100363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:36 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fb83c0e4-ee03-4432-aba3-a4f01258ed46 tempest-VolumesTransfersTest-186114192 None] Acquiring lock "cinder-3c949314-59c8-494f-9de4-09527b45dca2-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:02:36 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fb83c0e4-ee03-4432-aba3-a4f01258ed46 tempest-VolumesTransfersTest-186114192 None] Lock "cinder-3c949314-59c8-494f-9de4-09527b45dca2-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:02:36 devstack sudo[100363]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-78b1d77c-83df-4b3d-ac7f-9ed079abd515 tempest-VolumesGetTest-421307961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-368a8871-5bd5-411a-ad70-e95b7ebf296c" returned: 0 in 0.460s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:36 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fb83c0e4-ee03-4432-aba3-a4f01258ed46 tempest-VolumesTransfersTest-186114192 None] Acquiring lock "cinder-quobyte-3c949314-59c8-494f-9de4-09527b45dca2" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:02:36 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-78b1d77c-83df-4b3d-ac7f-9ed079abd515 tempest-VolumesGetTest-421307961 None] Lock "cinder-quobyte-368a8871-5bd5-411a-ad70-e95b7ebf296c" released by "delete_volume" :: held 1.171s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:02:36 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fb83c0e4-ee03-4432-aba3-a4f01258ed46 tempest-VolumesTransfersTest-186114192 None] Lock "cinder-quobyte-3c949314-59c8-494f-9de4-09527b45dca2" acquired by "delete_volume" :: waited 0.042s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:02:36 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fcef2ba-c87d-4f02-926f-73938ff2b9b6]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fb83c0e4-ee03-4432-aba3-a4f01258ed46 tempest-VolumesTransfersTest-186114192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3c949314-59c8-494f-9de4-09527b45dca2 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:36 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-78b1d77c-83df-4b3d-ac7f-9ed079abd515 tempest-VolumesGetTest-421307961 None] Created reservations ['cc325c62-6dca-455a-8304-b472504669da', 'd6f627bb-5de4-49b5-aa5d-d15a3cf452e5', 'f15eb007-1859-485a-ad64-33aa66541b26', 'b575b5ce-dec8-46e3-b942-89dbb96e1205'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:02:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-78b1d77c-83df-4b3d-ac7f-9ed079abd515 tempest-VolumesGetTest-421307961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-78b1d77c-83df-4b3d-ac7f-9ed079abd515 tempest-VolumesGetTest-421307961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:36 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-78b1d77c-83df-4b3d-ac7f-9ed079abd515 tempest-VolumesGetTest-421307961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:02:36 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-78b1d77c-83df-4b3d-ac7f-9ed079abd515 tempest-VolumesGetTest-421307961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:02:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-78b1d77c-83df-4b3d-ac7f-9ed079abd515 tempest-VolumesGetTest-421307961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-78b1d77c-83df-4b3d-ac7f-9ed079abd515 tempest-VolumesGetTest-421307961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:36 devstack sudo[100366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3c949314-59c8-494f-9de4-09527b45dca2 Sep 28 15:02:36 devstack sudo[100366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:36 devstack sudo[100369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:02:36 devstack sudo[100369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:37 devstack sudo[100369]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-78b1d77c-83df-4b3d-ac7f-9ed079abd515 tempest-VolumesGetTest-421307961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.496s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:37 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-78b1d77c-83df-4b3d-ac7f-9ed079abd515 tempest-VolumesGetTest-421307961 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:02:37 devstack sudo[100366]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fb83c0e4-ee03-4432-aba3-a4f01258ed46 tempest-VolumesTransfersTest-186114192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3c949314-59c8-494f-9de4-09527b45dca2" returned: 0 in 0.689s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fb83c0e4-ee03-4432-aba3-a4f01258ed46 tempest-VolumesTransfersTest-186114192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3c949314-59c8-494f-9de4-09527b45dca2 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:37 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-78b1d77c-83df-4b3d-ac7f-9ed079abd515 tempest-VolumesGetTest-421307961 None] Deleted volume successfully. Sep 28 15:02:37 devstack sudo[100378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3c949314-59c8-494f-9de4-09527b45dca2 Sep 28 15:02:37 devstack sudo[100378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:37 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-78b1d77c-83df-4b3d-ac7f-9ed079abd515 tempest-VolumesGetTest-421307961 None] Lock "cinder-368a8871-5bd5-411a-ad70-e95b7ebf296c-delete_volume" released by "delete_volume" :: held 2.125s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:02:37 devstack sudo[100378]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fb83c0e4-ee03-4432-aba3-a4f01258ed46 tempest-VolumesTransfersTest-186114192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3c949314-59c8-494f-9de4-09527b45dca2" returned: 0 in 0.447s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:37 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fb83c0e4-ee03-4432-aba3-a4f01258ed46 tempest-VolumesTransfersTest-186114192 None] Lock "cinder-quobyte-3c949314-59c8-494f-9de4-09527b45dca2" released by "delete_volume" :: held 1.211s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:02:37 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-fb83c0e4-ee03-4432-aba3-a4f01258ed46 tempest-VolumesTransfersTest-186114192 None] Created reservations ['952e7230-b7f2-4781-87a7-8af5f123f7a5', '5ea77e2b-2081-492b-b04c-97df4ecc249f', '327caaf7-a877-42d3-bd77-3eb0a561c92e', 'c181c27a-9624-4a0e-bcc6-4cb794b1d405'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:02:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-fb83c0e4-ee03-4432-aba3-a4f01258ed46 tempest-VolumesTransfersTest-186114192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-fb83c0e4-ee03-4432-aba3-a4f01258ed46 tempest-VolumesTransfersTest-186114192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:37 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-fb83c0e4-ee03-4432-aba3-a4f01258ed46 tempest-VolumesTransfersTest-186114192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:02:37 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-fb83c0e4-ee03-4432-aba3-a4f01258ed46 tempest-VolumesTransfersTest-186114192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:02:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-fb83c0e4-ee03-4432-aba3-a4f01258ed46 tempest-VolumesTransfersTest-186114192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fb83c0e4-ee03-4432-aba3-a4f01258ed46 tempest-VolumesTransfersTest-186114192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:38 devstack sudo[100381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:02:38 devstack sudo[100381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:38 devstack sudo[100381]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fb83c0e4-ee03-4432-aba3-a4f01258ed46 tempest-VolumesTransfersTest-186114192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.414s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:38 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-fb83c0e4-ee03-4432-aba3-a4f01258ed46 tempest-VolumesTransfersTest-186114192 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:02:38 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-fb83c0e4-ee03-4432-aba3-a4f01258ed46 tempest-VolumesTransfersTest-186114192 None] Deleted volume successfully. Sep 28 15:02:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fb83c0e4-ee03-4432-aba3-a4f01258ed46 tempest-VolumesTransfersTest-186114192 None] Lock "cinder-3c949314-59c8-494f-9de4-09527b45dca2-delete_volume" released by "delete_volume" :: held 2.074s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:02:39 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:02:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] Flow 'volume_create_manager' (85a71e89-a86d-458d-928e-9cdaf41f7cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:02:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c33c06d6-deaa-490a-8b1e-09d4d41ee533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c33c06d6-deaa-490a-8b1e-09d4d41ee533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:02:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-606114888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a08243d-5446-4953-8f00-5e587467a130,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='faba40f947cd4221a56196fd85c2337f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:02:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:02:39Z,use_quota=True,user_id='91ba074109b045f1a62611658fb66015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (753af7fc-9ed4-4171-88b0-2b4be2cd5737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (753af7fc-9ed4-4171-88b0-2b4be2cd5737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (206c2498-5725-4881-b248-b7d153334313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:39 devstack cinder-volume[87116]: DEBUG cinder.image.glance [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] Creating Keystone auth plugin from conf {{(pid=87116) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 15:02:39 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a584faa3-63d0-4c2f-8cc3-a80a918af36a tempest-AttachVolumeNegativeTest-950462997 None] Acquiring lock "cinder-e35a4c39-e162-4436-8762-44e1e4ad5f78-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:02:39 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a584faa3-63d0-4c2f-8cc3-a80a918af36a tempest-AttachVolumeNegativeTest-950462997 None] Lock "cinder-e35a4c39-e162-4436-8762-44e1e4ad5f78-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:02:39 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a584faa3-63d0-4c2f-8cc3-a80a918af36a tempest-AttachVolumeNegativeTest-950462997 None] Acquiring lock "cinder-quobyte-e35a4c39-e162-4436-8762-44e1e4ad5f78" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:02:39 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a584faa3-63d0-4c2f-8cc3-a80a918af36a tempest-AttachVolumeNegativeTest-950462997 None] Lock "cinder-quobyte-e35a4c39-e162-4436-8762-44e1e4ad5f78" acquired by "delete_volume" :: waited 0.022s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:02:40 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d2405c-0596-4fec-91c8-8542b0c072d0]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a584faa3-63d0-4c2f-8cc3-a80a918af36a tempest-AttachVolumeNegativeTest-950462997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e35a4c39-e162-4436-8762-44e1e4ad5f78 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:40 devstack sudo[100384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e35a4c39-e162-4436-8762-44e1e4ad5f78 Sep 28 15:02:40 devstack sudo[100384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (206c2498-5725-4881-b248-b7d153334313) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7a08243d-5446-4953-8f00-5e587467a130', 'volume_name': 'volume-7a08243d-5446-4953-8f00-5e587467a130', 'volume_size': 1, 'image_id': '660a4fad-84c6-40b7-a594-44d16c0701ee', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/660a4fad-84c6-40b7-a594-44d16c0701ee', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca088c9271854d40ba6017d33affee18', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '660a4fad-84c6-40b7-a594-44d16c0701ee', 'created_at': datetime.datetime(2026, 9, 28, 12, 47, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 47, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/660a4fad-84c6-40b7-a594-44d16c0701ee/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49433170-aed8-4293-b2f7-22243811446f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49433170-aed8-4293-b2f7-22243811446f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d425a547-7d52-4992-b416-fbcf98f84bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:40 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] Volume 7a08243d-5446-4953-8f00-5e587467a130: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7a08243d-5446-4953-8f00-5e587467a130', 'volume_size': 1, 'image_id': '660a4fad-84c6-40b7-a594-44d16c0701ee', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/660a4fad-84c6-40b7-a594-44d16c0701ee', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca088c9271854d40ba6017d33affee18', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '660a4fad-84c6-40b7-a594-44d16c0701ee', 'created_at': datetime.datetime(2026, 9, 28, 12, 47, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 47, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/660a4fad-84c6-40b7-a594-44d16c0701ee/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 15:02:40 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] Trying to clone 7a08243d-5446-4953-8f00-5e587467a130 from image 660a4fad-84c6-40b7-a594-44d16c0701ee at location (None, [{'url': 'file:///opt/stack/data/glance/images/660a4fad-84c6-40b7-a594-44d16c0701ee', 'metadata': {}}]). {{(pid=87116) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 15:02:40 devstack sudo[100384]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a584faa3-63d0-4c2f-8cc3-a80a918af36a tempest-AttachVolumeNegativeTest-950462997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e35a4c39-e162-4436-8762-44e1e4ad5f78" returned: 0 in 0.694s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a584faa3-63d0-4c2f-8cc3-a80a918af36a tempest-AttachVolumeNegativeTest-950462997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e35a4c39-e162-4436-8762-44e1e4ad5f78 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:40 devstack sudo[100390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e35a4c39-e162-4436-8762-44e1e4ad5f78 Sep 28 15:02:40 devstack sudo[100390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:40 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_08gmahrsdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87116) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 15:02:40 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] Image download 20.69 MB at 20.69 MB/s Sep 28 15:02:41 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e27d8e-6bd6-4d0b-a839-03ae8d84b78d]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_08gmahrsdevstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:41 devstack sudo[100390]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a584faa3-63d0-4c2f-8cc3-a80a918af36a tempest-AttachVolumeNegativeTest-950462997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e35a4c39-e162-4436-8762-44e1e4ad5f78" returned: 0 in 0.458s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a584faa3-63d0-4c2f-8cc3-a80a918af36a tempest-AttachVolumeNegativeTest-950462997 None] Lock "cinder-quobyte-e35a4c39-e162-4436-8762-44e1e4ad5f78" released by "delete_volume" :: held 1.227s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:02:41 devstack sudo[100393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_08gmahrsdevstack@QuobyteHD Sep 28 15:02:41 devstack sudo[100393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:41 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-a584faa3-63d0-4c2f-8cc3-a80a918af36a tempest-AttachVolumeNegativeTest-950462997 None] Created reservations ['c62bc36a-d689-4cf7-b514-82ba2da1aed1', '64b6a909-cb07-43c9-be17-6c9024b6871c', '81bca104-827a-4d57-a181-5168f0353a3f', '0f1c316a-3b45-4116-b32e-c88fa69dec54'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:02:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a584faa3-63d0-4c2f-8cc3-a80a918af36a tempest-AttachVolumeNegativeTest-950462997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a584faa3-63d0-4c2f-8cc3-a80a918af36a tempest-AttachVolumeNegativeTest-950462997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:41 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a584faa3-63d0-4c2f-8cc3-a80a918af36a tempest-AttachVolumeNegativeTest-950462997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:02:41 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a584faa3-63d0-4c2f-8cc3-a80a918af36a tempest-AttachVolumeNegativeTest-950462997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:02:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a584faa3-63d0-4c2f-8cc3-a80a918af36a tempest-AttachVolumeNegativeTest-950462997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a584faa3-63d0-4c2f-8cc3-a80a918af36a tempest-AttachVolumeNegativeTest-950462997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:41 devstack sudo[100399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:02:41 devstack sudo[100399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:41 devstack sudo[100393]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_08gmahrsdevstack@QuobyteHD" returned: 0 in 0.535s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:41 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] Temporary image 660a4fad-84c6-40b7-a594-44d16c0701ee is fetched for user 91ba074109b045f1a62611658fb66015. {{(pid=87116) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 15:02:41 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[de047ea1-a94a-4393-aa39-7c5859787b65]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_08gmahrsdevstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:41 devstack sudo[100401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_08gmahrsdevstack@QuobyteHD Sep 28 15:02:41 devstack sudo[100401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:41 devstack sudo[100399]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a584faa3-63d0-4c2f-8cc3-a80a918af36a tempest-AttachVolumeNegativeTest-950462997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.342s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:41 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-a584faa3-63d0-4c2f-8cc3-a80a918af36a tempest-AttachVolumeNegativeTest-950462997 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:02:41 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-a584faa3-63d0-4c2f-8cc3-a80a918af36a tempest-AttachVolumeNegativeTest-950462997 None] Deleted volume successfully. Sep 28 15:02:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a584faa3-63d0-4c2f-8cc3-a80a918af36a tempest-AttachVolumeNegativeTest-950462997 None] Lock "cinder-e35a4c39-e162-4436-8762-44e1e4ad5f78-delete_volume" released by "delete_volume" :: held 1.955s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:02:42 devstack sudo[100401]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_08gmahrsdevstack@QuobyteHD" returned: 0 in 0.470s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:42 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:02:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-606114888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a08243d-5446-4953-8f00-5e587467a130,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='faba40f947cd4221a56196fd85c2337f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:02:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:02:39Z,use_quota=True,user_id='91ba074109b045f1a62611658fb66015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:02:42 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] Creating volume 7a08243d-5446-4953-8f00-5e587467a130 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:02:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:42 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:02:42 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:02:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:42 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:02:42 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:02:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7a08243d-5446-4953-8f00-5e587467a130 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:42 devstack sudo[100407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7a08243d-5446-4953-8f00-5e587467a130 1073741824 Sep 28 15:02:42 devstack sudo[100407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:42 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-31ae8852-5cc4-4692-8bd4-a709439fabf9 tempest-AttachVolumeNegativeTest-950462997 None] Acquiring lock "cinder-3262b077-bb66-4ab4-b9cc-b289865fbdc1-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:02:42 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-31ae8852-5cc4-4692-8bd4-a709439fabf9 tempest-AttachVolumeNegativeTest-950462997 None] Lock "cinder-3262b077-bb66-4ab4-b9cc-b289865fbdc1-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:02:42 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-31ae8852-5cc4-4692-8bd4-a709439fabf9 tempest-AttachVolumeNegativeTest-950462997 None] Acquiring lock "cinder-quobyte-3262b077-bb66-4ab4-b9cc-b289865fbdc1" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:02:42 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-31ae8852-5cc4-4692-8bd4-a709439fabf9 tempest-AttachVolumeNegativeTest-950462997 None] Lock "cinder-quobyte-3262b077-bb66-4ab4-b9cc-b289865fbdc1" acquired by "delete_volume" :: waited 0.026s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:02:42 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f06724-bc1b-4397-8aba-84f857372c93]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-31ae8852-5cc4-4692-8bd4-a709439fabf9 tempest-AttachVolumeNegativeTest-950462997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3262b077-bb66-4ab4-b9cc-b289865fbdc1 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:42 devstack sudo[100412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3262b077-bb66-4ab4-b9cc-b289865fbdc1 Sep 28 15:02:42 devstack sudo[100412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:42 devstack sudo[100407]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7a08243d-5446-4953-8f00-5e587467a130 1073741824" returned: 0 in 0.709s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7a08243d-5446-4953-8f00-5e587467a130 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:42 devstack sudo[100415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7a08243d-5446-4953-8f00-5e587467a130 Sep 28 15:02:42 devstack sudo[100415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:43 devstack sudo[100412]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-31ae8852-5cc4-4692-8bd4-a709439fabf9 tempest-AttachVolumeNegativeTest-950462997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3262b077-bb66-4ab4-b9cc-b289865fbdc1" returned: 0 in 0.622s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-31ae8852-5cc4-4692-8bd4-a709439fabf9 tempest-AttachVolumeNegativeTest-950462997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3262b077-bb66-4ab4-b9cc-b289865fbdc1 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:43 devstack sudo[100420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3262b077-bb66-4ab4-b9cc-b289865fbdc1 Sep 28 15:02:43 devstack sudo[100420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:43 devstack sudo[100415]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7a08243d-5446-4953-8f00-5e587467a130" returned: 0 in 0.463s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:43 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] <== create_volume: return (1240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:02:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.242s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:43 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c542740-c531-4218-80b4-d1e4d08a3138 tempest-VolumesCloneTest-1766322604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:02:43 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0c542740-c531-4218-80b4-d1e4d08a3138 tempest-VolumesCloneTest-1766322604 None] Flow 'volume_create_manager' (5c8f9726-39c0-480a-acf0-e4f958127c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:02:43 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0c542740-c531-4218-80b4-d1e4d08a3138 tempest-VolumesCloneTest-1766322604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (462f15ae-3b0f-4cfb-9438-948fb88a69df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:43 devstack cinder-volume[87116]: DEBUG cinder.volume.volume_utils [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] Attempting download of 660a4fad-84c6-40b7-a594-44d16c0701ee ((None, [{'url': 'file:///opt/stack/data/glance/images/660a4fad-84c6-40b7-a594-44d16c0701ee', 'metadata': {}}])) to volume 7a08243d-5446-4953-8f00-5e587467a130. {{(pid=87116) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1208}} Sep 28 15:02:43 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0c542740-c531-4218-80b4-d1e4d08a3138 tempest-VolumesCloneTest-1766322604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (462f15ae-3b0f-4cfb-9438-948fb88a69df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:02:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-260739722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaaccc2f-1a6f-4c03-9a09-99472ff34bb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d1f836273054554a0ad17ab8d073e51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:02:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:02:43Z,use_quota=True,user_id='9470af014800434888bd2994b0e84cb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:43 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0c542740-c531-4218-80b4-d1e4d08a3138 tempest-VolumesCloneTest-1766322604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad8421a3-28dd-49b1-bab6-9058d33ece73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:43 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0c542740-c531-4218-80b4-d1e4d08a3138 tempest-VolumesCloneTest-1766322604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad8421a3-28dd-49b1-bab6-9058d33ece73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:43 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0c542740-c531-4218-80b4-d1e4d08a3138 tempest-VolumesCloneTest-1766322604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0b6b490-5d4a-47b1-a553-759edf14275c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:43 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0c542740-c531-4218-80b4-d1e4d08a3138 tempest-VolumesCloneTest-1766322604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0b6b490-5d4a-47b1-a553-759edf14275c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eaaccc2f-1a6f-4c03-9a09-99472ff34bb6', 'volume_name': 'volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:43 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0c542740-c531-4218-80b4-d1e4d08a3138 tempest-VolumesCloneTest-1766322604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (239256a2-4ba4-4bcd-b4e0-3133ff2b6018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:43 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0c542740-c531-4218-80b4-d1e4d08a3138 tempest-VolumesCloneTest-1766322604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (239256a2-4ba4-4bcd-b4e0-3133ff2b6018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:43 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0c542740-c531-4218-80b4-d1e4d08a3138 tempest-VolumesCloneTest-1766322604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42ee3c0f-6303-4a92-8298-f7cf449e91c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:43 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-0c542740-c531-4218-80b4-d1e4d08a3138 tempest-VolumesCloneTest-1766322604 None] Volume eaaccc2f-1a6f-4c03-9a09-99472ff34bb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6', 'volume_size': 1} Sep 28 15:02:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0c542740-c531-4218-80b4-d1e4d08a3138 tempest-VolumesCloneTest-1766322604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0c542740-c531-4218-80b4-d1e4d08a3138 tempest-VolumesCloneTest-1766322604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:43 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0c542740-c531-4218-80b4-d1e4d08a3138 tempest-VolumesCloneTest-1766322604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:02:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-260739722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaaccc2f-1a6f-4c03-9a09-99472ff34bb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d1f836273054554a0ad17ab8d073e51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:02:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:02:43Z,use_quota=True,user_id='9470af014800434888bd2994b0e84cb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:02:43 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-0c542740-c531-4218-80b4-d1e4d08a3138 tempest-VolumesCloneTest-1766322604 None] Creating volume eaaccc2f-1a6f-4c03-9a09-99472ff34bb6 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:02:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0c542740-c531-4218-80b4-d1e4d08a3138 tempest-VolumesCloneTest-1766322604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0c542740-c531-4218-80b4-d1e4d08a3138 tempest-VolumesCloneTest-1766322604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:43 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0c542740-c531-4218-80b4-d1e4d08a3138 tempest-VolumesCloneTest-1766322604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:02:43 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0c542740-c531-4218-80b4-d1e4d08a3138 tempest-VolumesCloneTest-1766322604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:02:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0c542740-c531-4218-80b4-d1e4d08a3138 tempest-VolumesCloneTest-1766322604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:43 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0c542740-c531-4218-80b4-d1e4d08a3138 tempest-VolumesCloneTest-1766322604 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:02:43 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-0c542740-c531-4218-80b4-d1e4d08a3138 tempest-VolumesCloneTest-1766322604 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:02:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0c542740-c531-4218-80b4-d1e4d08a3138 tempest-VolumesCloneTest-1766322604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:43 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e201b49-d0c5-4c97-82a0-5c8eeb13e03b]: (4, 'raw') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_660a4fad-84c6-40b7-a594-44d16c0701ee_3p7a9zl9 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:43 devstack sudo[100424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6 1073741824 Sep 28 15:02:43 devstack sudo[100424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:43 devstack sudo[100420]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-31ae8852-5cc4-4692-8bd4-a709439fabf9 tempest-AttachVolumeNegativeTest-950462997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3262b077-bb66-4ab4-b9cc-b289865fbdc1" returned: 0 in 0.429s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-31ae8852-5cc4-4692-8bd4-a709439fabf9 tempest-AttachVolumeNegativeTest-950462997 None] Lock "cinder-quobyte-3262b077-bb66-4ab4-b9cc-b289865fbdc1" released by "delete_volume" :: held 1.158s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:02:43 devstack sudo[100426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_660a4fad-84c6-40b7-a594-44d16c0701ee_3p7a9zl9 Sep 28 15:02:43 devstack sudo[100426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:43 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-31ae8852-5cc4-4692-8bd4-a709439fabf9 tempest-AttachVolumeNegativeTest-950462997 None] Created reservations ['3c504f83-fabe-4a0a-9fd8-0a39a9769e4b', '856cefaa-1508-43ad-a9c4-48f8b043b570', 'd13e414c-cc85-4b15-925b-114a62dcd90c', 'a9bbc633-974d-457f-8a7b-b2a05d12f8ff'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:02:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-31ae8852-5cc4-4692-8bd4-a709439fabf9 tempest-AttachVolumeNegativeTest-950462997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-31ae8852-5cc4-4692-8bd4-a709439fabf9 tempest-AttachVolumeNegativeTest-950462997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:43 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-31ae8852-5cc4-4692-8bd4-a709439fabf9 tempest-AttachVolumeNegativeTest-950462997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:02:43 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-31ae8852-5cc4-4692-8bd4-a709439fabf9 tempest-AttachVolumeNegativeTest-950462997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:02:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-31ae8852-5cc4-4692-8bd4-a709439fabf9 tempest-AttachVolumeNegativeTest-950462997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-31ae8852-5cc4-4692-8bd4-a709439fabf9 tempest-AttachVolumeNegativeTest-950462997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:43 devstack sudo[100428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:02:43 devstack sudo[100428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:44 devstack sudo[100426]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_660a4fad-84c6-40b7-a594-44d16c0701ee_3p7a9zl9" returned: 0 in 0.461s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_660a4fad-84c6-40b7-a594-44d16c0701ee_3p7a9zl9 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:44 devstack sudo[100437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_660a4fad-84c6-40b7-a594-44d16c0701ee_3p7a9zl9 Sep 28 15:02:44 devstack sudo[100437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:44 devstack sudo[100424]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0c542740-c531-4218-80b4-d1e4d08a3138 tempest-VolumesCloneTest-1766322604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6 1073741824" returned: 0 in 0.730s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:44 devstack sudo[100428]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-31ae8852-5cc4-4692-8bd4-a709439fabf9 tempest-AttachVolumeNegativeTest-950462997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.418s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:44 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-31ae8852-5cc4-4692-8bd4-a709439fabf9 tempest-AttachVolumeNegativeTest-950462997 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:02:44 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-31ae8852-5cc4-4692-8bd4-a709439fabf9 tempest-AttachVolumeNegativeTest-950462997 None] Deleted volume successfully. Sep 28 15:02:44 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-31ae8852-5cc4-4692-8bd4-a709439fabf9 tempest-AttachVolumeNegativeTest-950462997 None] Lock "cinder-3262b077-bb66-4ab4-b9cc-b289865fbdc1-delete_volume" released by "delete_volume" :: held 1.923s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:02:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0c542740-c531-4218-80b4-d1e4d08a3138 tempest-VolumesCloneTest-1766322604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:44 devstack sudo[100440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6 Sep 28 15:02:44 devstack sudo[100440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:44 devstack sudo[100437]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_660a4fad-84c6-40b7-a594-44d16c0701ee_3p7a9zl9" returned: 1 in 0.426s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_660a4fad-84c6-40b7-a594-44d16c0701ee_3p7a9zl9' failed. Not Retrying. {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:02:44 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbb31c1-3cd7-48e8-ba6e-2032024f99a8]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_08gmahrsdevstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:44 devstack sudo[100440]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0c542740-c531-4218-80b4-d1e4d08a3138 tempest-VolumesCloneTest-1766322604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6" returned: 0 in 0.258s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:44 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0c542740-c531-4218-80b4-d1e4d08a3138 tempest-VolumesCloneTest-1766322604 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:02:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0c542740-c531-4218-80b4-d1e4d08a3138 tempest-VolumesCloneTest-1766322604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:44 devstack sudo[100444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_08gmahrsdevstack@QuobyteHD Sep 28 15:02:44 devstack sudo[100444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:44 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0c542740-c531-4218-80b4-d1e4d08a3138 tempest-VolumesCloneTest-1766322604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42ee3c0f-6303-4a92-8298-f7cf449e91c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:44 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0c542740-c531-4218-80b4-d1e4d08a3138 tempest-VolumesCloneTest-1766322604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe80cf26-4a38-472d-a5f6-3da173196359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:44 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-0c542740-c531-4218-80b4-d1e4d08a3138 tempest-VolumesCloneTest-1766322604 None] Volume volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6 (eaaccc2f-1a6f-4c03-9a09-99472ff34bb6): created successfully Sep 28 15:02:44 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0c542740-c531-4218-80b4-d1e4d08a3138 tempest-VolumesCloneTest-1766322604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe80cf26-4a38-472d-a5f6-3da173196359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:44 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0c542740-c531-4218-80b4-d1e4d08a3138 tempest-VolumesCloneTest-1766322604 None] Flow 'volume_create_manager' (5c8f9726-39c0-480a-acf0-e4f958127c98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:02:44 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-0c542740-c531-4218-80b4-d1e4d08a3138 tempest-VolumesCloneTest-1766322604 None] Created volume successfully. Sep 28 15:02:44 devstack sudo[100444]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_08gmahrsdevstack@QuobyteHD" returned: 0 in 0.419s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:44 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] 660a4fad-84c6-40b7-a594-44d16c0701ee was qcow2, converting to qcow2 {{(pid=87116) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 15:02:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_08gmahrsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7a08243d-5446-4953-8f00-5e587467a130 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:44 devstack sudo[100450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_08gmahrsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7a08243d-5446-4953-8f00-5e587467a130 Sep 28 15:02:44 devstack sudo[100450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c1503245-a207-411d-a529-0cb6da5ff551 tempest-AttachVolumeNegativeTest-950462997 None] Acquiring lock "cinder-bc204839-e0c8-466a-abaf-e82ecc532a3f-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:02:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c1503245-a207-411d-a529-0cb6da5ff551 tempest-AttachVolumeNegativeTest-950462997 None] Lock "cinder-bc204839-e0c8-466a-abaf-e82ecc532a3f-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:02:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c1503245-a207-411d-a529-0cb6da5ff551 tempest-AttachVolumeNegativeTest-950462997 None] Acquiring lock "cinder-quobyte-bc204839-e0c8-466a-abaf-e82ecc532a3f" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:02:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c1503245-a207-411d-a529-0cb6da5ff551 tempest-AttachVolumeNegativeTest-950462997 None] Lock "cinder-quobyte-bc204839-e0c8-466a-abaf-e82ecc532a3f" acquired by "delete_volume" :: waited 0.023s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:02:45 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[5959eb91-7565-4415-807c-3a50fadda045]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c1503245-a207-411d-a529-0cb6da5ff551 tempest-AttachVolumeNegativeTest-950462997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bc204839-e0c8-466a-abaf-e82ecc532a3f {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:45 devstack sudo[100452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bc204839-e0c8-466a-abaf-e82ecc532a3f Sep 28 15:02:45 devstack sudo[100452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:45 devstack sudo[100452]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c1503245-a207-411d-a529-0cb6da5ff551 tempest-AttachVolumeNegativeTest-950462997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bc204839-e0c8-466a-abaf-e82ecc532a3f" returned: 0 in 0.508s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c1503245-a207-411d-a529-0cb6da5ff551 tempest-AttachVolumeNegativeTest-950462997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bc204839-e0c8-466a-abaf-e82ecc532a3f {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:45 devstack sudo[100462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bc204839-e0c8-466a-abaf-e82ecc532a3f Sep 28 15:02:45 devstack sudo[100462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:46 devstack sudo[100462]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c1503245-a207-411d-a529-0cb6da5ff551 tempest-AttachVolumeNegativeTest-950462997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bc204839-e0c8-466a-abaf-e82ecc532a3f" returned: 0 in 0.660s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c1503245-a207-411d-a529-0cb6da5ff551 tempest-AttachVolumeNegativeTest-950462997 None] Lock "cinder-quobyte-bc204839-e0c8-466a-abaf-e82ecc532a3f" released by "delete_volume" :: held 1.234s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:02:46 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:02:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] Flow 'volume_create_manager' (e2593e5b-81cd-440f-9e41-1457b75bbf22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:02:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ab0c243-0029-4d10-a03e-31ec705204e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ab0c243-0029-4d10-a03e-31ec705204e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-60097492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a826ceb0-d2c9-4fb5-8246-3abf8a975dc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d1f836273054554a0ad17ab8d073e51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:02:46Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=eaaccc2f-1a6f-4c03-9a09-99472ff34bb6,status='creating',terminated_at=None,updated_at=2026-09-28T13:02:46Z,use_quota=True,user_id='9470af014800434888bd2994b0e84cb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2079bfb-678e-4d39-a4ac-1550dfae5322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2079bfb-678e-4d39-a4ac-1550dfae5322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a0213f3-1aa2-44a6-83d6-deacdad223fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a0213f3-1aa2-44a6-83d6-deacdad223fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'a826ceb0-d2c9-4fb5-8246-3abf8a975dc1', 'volume_name': 'volume-a826ceb0-d2c9-4fb5-8246-3abf8a975dc1', 'volume_size': 2, 'source_volid': 'eaaccc2f-1a6f-4c03-9a09-99472ff34bb6', 'source_volstatus': 'available'}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f618dfd2-6583-4b54-980b-484a805d56d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f618dfd2-6583-4b54-980b-484a805d56d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f13d3355-f8d4-430b-9ebb-5b92fe44bad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:46 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] Volume a826ceb0-d2c9-4fb5-8246-3abf8a975dc1: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-a826ceb0-d2c9-4fb5-8246-3abf8a975dc1', 'volume_size': 2, 'source_volid': 'eaaccc2f-1a6f-4c03-9a09-99472ff34bb6', 'source_volstatus': 'available'} Sep 28 15:02:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:46 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] Cloning volume eaaccc2f-1a6f-4c03-9a09-99472ff34bb6 to volume a826ceb0-d2c9-4fb5-8246-3abf8a975dc1 Sep 28 15:02:46 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-c1503245-a207-411d-a529-0cb6da5ff551 tempest-AttachVolumeNegativeTest-950462997 None] Created reservations ['fc545d75-7eb4-4fa8-b50d-7470eb9a72ef', 'e2cfe8cc-ff7f-49bd-9887-446024fad49f', '8831aab8-925d-4a1c-829c-7fbb20d7c5be', '8b5f9e3b-02b0-460a-ba5c-b2f0a9a4af64'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:02:46 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] Creating offline snapshot 037a0ede-e861-4305-a09a-b185650a859a of volume eaaccc2f-1a6f-4c03-9a09-99472ff34bb6 {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:02:46 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[640b0bc4-539a-4244-8996-33959e04216a]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c1503245-a207-411d-a529-0cb6da5ff551 tempest-AttachVolumeNegativeTest-950462997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c1503245-a207-411d-a529-0cb6da5ff551 tempest-AttachVolumeNegativeTest-950462997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:46 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c1503245-a207-411d-a529-0cb6da5ff551 tempest-AttachVolumeNegativeTest-950462997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:02:46 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c1503245-a207-411d-a529-0cb6da5ff551 tempest-AttachVolumeNegativeTest-950462997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:02:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c1503245-a207-411d-a529-0cb6da5ff551 tempest-AttachVolumeNegativeTest-950462997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c1503245-a207-411d-a529-0cb6da5ff551 tempest-AttachVolumeNegativeTest-950462997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:46 devstack sudo[100469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:02:46 devstack sudo[100469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:46 devstack sudo[100468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6 Sep 28 15:02:46 devstack sudo[100468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:47 devstack sudo[100469]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c1503245-a207-411d-a529-0cb6da5ff551 tempest-AttachVolumeNegativeTest-950462997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.418s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:47 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-c1503245-a207-411d-a529-0cb6da5ff551 tempest-AttachVolumeNegativeTest-950462997 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:02:47 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-c1503245-a207-411d-a529-0cb6da5ff551 tempest-AttachVolumeNegativeTest-950462997 None] Deleted volume successfully. Sep 28 15:02:47 devstack sudo[100468]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6" returned: 0 in 0.537s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6.037a0ede-e861-4305-a09a-b185650a859a 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:47 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c1503245-a207-411d-a529-0cb6da5ff551 tempest-AttachVolumeNegativeTest-950462997 None] Lock "cinder-bc204839-e0c8-466a-abaf-e82ecc532a3f-delete_volume" released by "delete_volume" :: held 2.217s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:02:47 devstack sudo[100477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6.037a0ede-e861-4305-a09a-b185650a859a 1G Sep 28 15:02:47 devstack sudo[100477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:47 devstack sudo[100450]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_08gmahrsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7a08243d-5446-4953-8f00-5e587467a130" returned: 0 in 2.855s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:47 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_08gmahrsdevstack@QuobyteHD, size 112.00 MB, duration 2.86 sec, destination /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7a08243d-5446-4953-8f00-5e587467a130 {{(pid=87116) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:02:47 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] Converted 112.00 MB image at 39.22 MB/s Sep 28 15:02:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7a08243d-5446-4953-8f00-5e587467a130 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:47 devstack sudo[100483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7a08243d-5446-4953-8f00-5e587467a130 1G Sep 28 15:02:47 devstack sudo[100483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:47 devstack sudo[100477]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6.037a0ede-e861-4305-a09a-b185650a859a 1G" returned: 0 in 0.631s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6.037a0ede-e861-4305-a09a-b185650a859a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:47 devstack sudo[100485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6.037a0ede-e861-4305-a09a-b185650a859a Sep 28 15:02:47 devstack sudo[100485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:48 devstack sudo[100483]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7a08243d-5446-4953-8f00-5e587467a130 1G" returned: 0 in 0.470s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:48 devstack cinder-volume[87116]: DEBUG cinder.volume.volume_utils [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] Downloaded image 660a4fad-84c6-40b7-a594-44d16c0701ee ((None, [{'url': 'file:///opt/stack/data/glance/images/660a4fad-84c6-40b7-a594-44d16c0701ee', 'metadata': {}}])) to volume 7a08243d-5446-4953-8f00-5e587467a130 successfully. {{(pid=87116) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1253}} Sep 28 15:02:48 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] Temporary image 660a4fad-84c6-40b7-a594-44d16c0701ee for user 91ba074109b045f1a62611658fb66015 is deleted. {{(pid=87116) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 15:02:48 devstack cinder-volume[87116]: DEBUG cinder.volume.volume_utils [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] Marking volume 7a08243d-5446-4953-8f00-5e587467a130 as bootable. {{(pid=87116) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1157}} Sep 28 15:02:48 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] Copying metadata from image 660a4fad-84c6-40b7-a594-44d16c0701ee to 7a08243d-5446-4953-8f00-5e587467a130. {{(pid=87116) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 15:02:48 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] Creating volume glance metadata for volume 7a08243d-5446-4953-8f00-5e587467a130 backed by image 660a4fad-84c6-40b7-a594-44d16c0701ee with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '660a4fad-84c6-40b7-a594-44d16c0701ee', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87116) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 15:02:48 devstack sudo[100485]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6.037a0ede-e861-4305-a09a-b185650a859a" returned: 0 in 0.477s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:48 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6.037a0ede-e861-4305-a09a-b185650a859a is being set with open permissions: ugo+rw Sep 28 15:02:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6.037a0ede-e861-4305-a09a-b185650a859a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:48 devstack sudo[100494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6.037a0ede-e861-4305-a09a-b185650a859a Sep 28 15:02:48 devstack sudo[100494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d425a547-7d52-4992-b416-fbcf98f84bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a08243d-5446-4953-8f00-5e587467a130', 'volume_size': 1, 'image_id': '660a4fad-84c6-40b7-a594-44d16c0701ee', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/660a4fad-84c6-40b7-a594-44d16c0701ee', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca088c9271854d40ba6017d33affee18', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '660a4fad-84c6-40b7-a594-44d16c0701ee', 'created_at': datetime.datetime(2026, 9, 28, 12, 47, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 47, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/660a4fad-84c6-40b7-a594-44d16c0701ee/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cee9687-3aa5-4455-9d73-66147e7e4f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:48 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] Volume volume-7a08243d-5446-4953-8f00-5e587467a130 (7a08243d-5446-4953-8f00-5e587467a130): created successfully Sep 28 15:02:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cee9687-3aa5-4455-9d73-66147e7e4f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] Flow 'volume_create_manager' (85a71e89-a86d-458d-928e-9cdaf41f7cbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:02:48 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-e10954bb-ae75-4325-b661-4d78410751c2 tempest-VolumesGetTest-421307961 None] Created volume successfully. Sep 28 15:02:48 devstack sudo[100494]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6.037a0ede-e861-4305-a09a-b185650a859a" returned: 0 in 0.353s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:48 devstack sudo[100497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6.info Sep 28 15:02:48 devstack sudo[100497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:49 devstack sudo[100497]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6.info" returned: 0 in 0.379s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:49 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6.info is being set with open permissions: ugo+rw Sep 28 15:02:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:49 devstack sudo[100500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6.info Sep 28 15:02:49 devstack sudo[100500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:49 devstack sudo[100500]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6.info" returned: 0 in 0.368s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:49 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] Acquiring lock "cinder-quobyte-a826ceb0-d2c9-4fb5-8246-3abf8a975dc1" by "_copy_volume_from_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:02:49 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] Lock "cinder-quobyte-a826ceb0-d2c9-4fb5-8246-3abf8a975dc1" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:02:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] snapshot: 037a0ede-e861-4305-a09a-b185650a859a, volume: a826ceb0-d2c9-4fb5-8246-3abf8a975dc1, {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 15:02:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:02:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:02:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:49 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[96cc1eca-bd9e-4728-8a17-fb3232964856]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6.037a0ede-e861-4305-a09a-b185650a859a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:49 devstack sudo[100503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6.037a0ede-e861-4305-a09a-b185650a859a Sep 28 15:02:49 devstack sudo[100503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:50 devstack sudo[100503]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6.037a0ede-e861-4305-a09a-b185650a859a" returned: 0 in 0.654s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:50 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:02:50 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-7040819e-3932-4934-98d5-991f584b7e93 tempest-VolumesGetTest-421307961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:02:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7040819e-3932-4934-98d5-991f584b7e93 tempest-VolumesGetTest-421307961 None] Flow 'volume_create_manager' (10569768-6bdd-4a9a-8b6d-6e8ce83167de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:02:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7040819e-3932-4934-98d5-991f584b7e93 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bec41d1-d54d-4fbb-a828-18b284952192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:50 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[39952425-dd55-4ac4-ac59-2d2fa8de32de]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7040819e-3932-4934-98d5-991f584b7e93 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bec41d1-d54d-4fbb-a828-18b284952192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:02:50Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-287230643',display_name='tempest-VolumesGetTest-Volume-717953920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51133e5b-1681-49c0-96de-9333eb7c4000,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faba40f947cd4221a56196fd85c2337f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:02:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:02:50Z,use_quota=True,user_id='91ba074109b045f1a62611658fb66015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7040819e-3932-4934-98d5-991f584b7e93 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3dcf519-28d2-4857-93a3-a557e3ad7e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7040819e-3932-4934-98d5-991f584b7e93 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3dcf519-28d2-4857-93a3-a557e3ad7e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7040819e-3932-4934-98d5-991f584b7e93 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36cf45bd-c588-4312-ad6a-6d329bfff09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7040819e-3932-4934-98d5-991f584b7e93 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36cf45bd-c588-4312-ad6a-6d329bfff09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51133e5b-1681-49c0-96de-9333eb7c4000', 'volume_name': 'volume-51133e5b-1681-49c0-96de-9333eb7c4000', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7040819e-3932-4934-98d5-991f584b7e93 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b233bbd3-bcaa-4dd9-b212-a553220321b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7040819e-3932-4934-98d5-991f584b7e93 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b233bbd3-bcaa-4dd9-b212-a553220321b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7040819e-3932-4934-98d5-991f584b7e93 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32e29fed-5325-40c1-b8f1-91d631f0d123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:50 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-7040819e-3932-4934-98d5-991f584b7e93 tempest-VolumesGetTest-421307961 None] Volume 51133e5b-1681-49c0-96de-9333eb7c4000: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51133e5b-1681-49c0-96de-9333eb7c4000', 'volume_size': 1} Sep 28 15:02:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7040819e-3932-4934-98d5-991f584b7e93 tempest-VolumesGetTest-421307961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:50 devstack sudo[100509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6 Sep 28 15:02:50 devstack sudo[100509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:50 devstack sudo[100509]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6" returned: 0 in 0.514s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:50 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6 {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 15:02:50 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] Creating direct copy from snapshot {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 15:02:50 devstack cinder-volume[87116]: DEBUG cinder.utils [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] Path /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a826ceb0-d2c9-4fb5-8246-3abf8a975dc1 not found in is_blk_device check {{(pid=87116) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 15:02:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a826ceb0-d2c9-4fb5-8246-3abf8a975dc1 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:50 devstack sudo[100516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a826ceb0-d2c9-4fb5-8246-3abf8a975dc1 Sep 28 15:02:50 devstack sudo[100516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:51 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-1033ea9b-0045-4c41-85a4-7fafa748f411 tempest-VolumesTransfersV357Test-807036277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:02:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1033ea9b-0045-4c41-85a4-7fafa748f411 tempest-VolumesTransfersV357Test-807036277 None] Flow 'volume_create_manager' (05ab8c63-356a-43c1-aacc-f0a7960e0206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:02:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1033ea9b-0045-4c41-85a4-7fafa748f411 tempest-VolumesTransfersV357Test-807036277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5df9742a-5962-40ec-badd-93dcee8e4f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1033ea9b-0045-4c41-85a4-7fafa748f411 tempest-VolumesTransfersV357Test-807036277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5df9742a-5962-40ec-badd-93dcee8e4f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:02:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2146397416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2435dcc-7e75-4719-8ce9-ef93b55618dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f3cb4b323c34baca55278f165285fed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:02:52Z,use_quota=True,user_id='c1c67c92369d4ac5a55f7a39a0d6dc18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1033ea9b-0045-4c41-85a4-7fafa748f411 tempest-VolumesTransfersV357Test-807036277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6184fcf-6136-496e-90f6-39921021468c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1033ea9b-0045-4c41-85a4-7fafa748f411 tempest-VolumesTransfersV357Test-807036277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6184fcf-6136-496e-90f6-39921021468c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1033ea9b-0045-4c41-85a4-7fafa748f411 tempest-VolumesTransfersV357Test-807036277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f8962e3-5489-407d-876e-623027fa7082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1033ea9b-0045-4c41-85a4-7fafa748f411 tempest-VolumesTransfersV357Test-807036277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f8962e3-5489-407d-876e-623027fa7082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2435dcc-7e75-4719-8ce9-ef93b55618dd', 'volume_name': 'volume-f2435dcc-7e75-4719-8ce9-ef93b55618dd', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1033ea9b-0045-4c41-85a4-7fafa748f411 tempest-VolumesTransfersV357Test-807036277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02e4bee5-2a48-4a9a-a0ec-671d8f37570c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1033ea9b-0045-4c41-85a4-7fafa748f411 tempest-VolumesTransfersV357Test-807036277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02e4bee5-2a48-4a9a-a0ec-671d8f37570c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1033ea9b-0045-4c41-85a4-7fafa748f411 tempest-VolumesTransfersV357Test-807036277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93e61d7f-ccf3-444a-bdf6-d8b5c3820d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:52 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-1033ea9b-0045-4c41-85a4-7fafa748f411 tempest-VolumesTransfersV357Test-807036277 None] Volume f2435dcc-7e75-4719-8ce9-ef93b55618dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2435dcc-7e75-4719-8ce9-ef93b55618dd', 'volume_size': 1} Sep 28 15:02:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1033ea9b-0045-4c41-85a4-7fafa748f411 tempest-VolumesTransfersV357Test-807036277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:58 devstack sudo[100516]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a826ceb0-d2c9-4fb5-8246-3abf8a975dc1" returned: 0 in 7.953s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:58 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] Image conversion details: src /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6, size 1024.00 MB, duration 7.95 sec, destination /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a826ceb0-d2c9-4fb5-8246-3abf8a975dc1 {{(pid=87116) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:02:58 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] Converted 1024.00 MB image at 128.74 MB/s Sep 28 15:02:58 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a826ceb0-d2c9-4fb5-8246-3abf8a975dc1 is being set with open permissions: ugo+rw Sep 28 15:02:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a826ceb0-d2c9-4fb5-8246-3abf8a975dc1 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:58 devstack sudo[100530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a826ceb0-d2c9-4fb5-8246-3abf8a975dc1 Sep 28 15:02:58 devstack sudo[100530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:59 devstack sudo[100530]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a826ceb0-d2c9-4fb5-8246-3abf8a975dc1" returned: 0 in 0.344s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:59 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] Lock "cinder-quobyte-a826ceb0-d2c9-4fb5-8246-3abf8a975dc1" released by "_copy_volume_from_snapshot" :: held 9.602s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:02:59 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] Acquiring lock "cinder-quobyte-037a0ede-e861-4305-a09a-b185650a859a" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:02:59 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] Lock "cinder-quobyte-037a0ede-e861-4305-a09a-b185650a859a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:02:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] Deleting offline snapshot 037a0ede-e861-4305-a09a-b185650a859a of volume eaaccc2f-1a6f-4c03-9a09-99472ff34bb6 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:02:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] snapshot_file for this snap is: volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6.037a0ede-e861-4305-a09a-b185650a859a {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:02:59 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a64034-9c0b-4311-8d4b-957cf028711d]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6.037a0ede-e861-4305-a09a-b185650a859a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:59 devstack sudo[100533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6.037a0ede-e861-4305-a09a-b185650a859a Sep 28 15:02:59 devstack sudo[100533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:59 devstack sudo[100533]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6.037a0ede-e861-4305-a09a-b185650a859a" returned: 0 in 0.435s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:02:59 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[15036cbc-6077-4765-98dd-64dd5a1e5a36]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:59 devstack sudo[100538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6 Sep 28 15:02:59 devstack sudo[100538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:00 devstack sudo[100538]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6" returned: 0 in 0.645s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6.037a0ede-e861-4305-a09a-b185650a859a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:00 devstack sudo[100543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6.037a0ede-e861-4305-a09a-b185650a859a Sep 28 15:03:00 devstack sudo[100543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:00 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [req-dca08f04-2254-45b1-b542-19ff5f1dcfb6 req-4e528394-4204-4cea-9c62-a71a2a2b7c86 tempest-VolumesGetTestJSON-290504136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:03:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-dca08f04-2254-45b1-b542-19ff5f1dcfb6 req-4e528394-4204-4cea-9c62-a71a2a2b7c86 tempest-VolumesGetTestJSON-290504136 None] Flow 'volume_create_manager' (a522ad8b-2355-411f-b54c-8f6c75c86eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-dca08f04-2254-45b1-b542-19ff5f1dcfb6 req-4e528394-4204-4cea-9c62-a71a2a2b7c86 tempest-VolumesGetTestJSON-290504136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b52611fd-c362-42ad-a8f4-09faa97b9f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-dca08f04-2254-45b1-b542-19ff5f1dcfb6 req-4e528394-4204-4cea-9c62-a71a2a2b7c86 tempest-VolumesGetTestJSON-290504136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b52611fd-c362-42ad-a8f4-09faa97b9f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1165396524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffe082a5-d613-41c6-9894-582f1493b74d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='be88e6f09ae2469a8ce83eb6c98aca38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:00Z,use_quota=True,user_id='227cb03f30cb4cecb25e64d51573a41f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-dca08f04-2254-45b1-b542-19ff5f1dcfb6 req-4e528394-4204-4cea-9c62-a71a2a2b7c86 tempest-VolumesGetTestJSON-290504136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (513d826c-946c-4e17-a18b-c00d5f5e1037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-dca08f04-2254-45b1-b542-19ff5f1dcfb6 req-4e528394-4204-4cea-9c62-a71a2a2b7c86 tempest-VolumesGetTestJSON-290504136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (513d826c-946c-4e17-a18b-c00d5f5e1037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-dca08f04-2254-45b1-b542-19ff5f1dcfb6 req-4e528394-4204-4cea-9c62-a71a2a2b7c86 tempest-VolumesGetTestJSON-290504136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3597f5b8-b183-4f80-addc-30731597d050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-dca08f04-2254-45b1-b542-19ff5f1dcfb6 req-4e528394-4204-4cea-9c62-a71a2a2b7c86 tempest-VolumesGetTestJSON-290504136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3597f5b8-b183-4f80-addc-30731597d050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffe082a5-d613-41c6-9894-582f1493b74d', 'volume_name': 'volume-ffe082a5-d613-41c6-9894-582f1493b74d', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-dca08f04-2254-45b1-b542-19ff5f1dcfb6 req-4e528394-4204-4cea-9c62-a71a2a2b7c86 tempest-VolumesGetTestJSON-290504136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c235ace-eaea-42b5-ab18-91e2435d6dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-dca08f04-2254-45b1-b542-19ff5f1dcfb6 req-4e528394-4204-4cea-9c62-a71a2a2b7c86 tempest-VolumesGetTestJSON-290504136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c235ace-eaea-42b5-ab18-91e2435d6dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-dca08f04-2254-45b1-b542-19ff5f1dcfb6 req-4e528394-4204-4cea-9c62-a71a2a2b7c86 tempest-VolumesGetTestJSON-290504136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdf0bdea-4f13-4928-8719-3fb85e9f8af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:00 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [req-dca08f04-2254-45b1-b542-19ff5f1dcfb6 req-4e528394-4204-4cea-9c62-a71a2a2b7c86 tempest-VolumesGetTestJSON-290504136 None] Volume ffe082a5-d613-41c6-9894-582f1493b74d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffe082a5-d613-41c6-9894-582f1493b74d', 'volume_size': 1} Sep 28 15:03:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-dca08f04-2254-45b1-b542-19ff5f1dcfb6 req-4e528394-4204-4cea-9c62-a71a2a2b7c86 tempest-VolumesGetTestJSON-290504136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:00 devstack sudo[100543]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6.037a0ede-e861-4305-a09a-b185650a859a" returned: 0 in 0.367s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6.037a0ede-e861-4305-a09a-b185650a859a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:00 devstack sudo[100550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6.037a0ede-e861-4305-a09a-b185650a859a Sep 28 15:03:00 devstack sudo[100550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:01 devstack sudo[100550]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6.037a0ede-e861-4305-a09a-b185650a859a" returned: 0 in 0.266s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:01 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] Lock "cinder-quobyte-037a0ede-e861-4305-a09a-b185650a859a" released by "_delete_snapshot" :: held 1.835s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.432s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7040819e-3932-4934-98d5-991f584b7e93 tempest-VolumesGetTest-421307961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.674s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7040819e-3932-4934-98d5-991f584b7e93 tempest-VolumesGetTest-421307961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:02:50Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-287230643',display_name='tempest-VolumesGetTest-Volume-717953920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51133e5b-1681-49c0-96de-9333eb7c4000,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faba40f947cd4221a56196fd85c2337f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:02:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:02:50Z,use_quota=True,user_id='91ba074109b045f1a62611658fb66015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:03:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-7040819e-3932-4934-98d5-991f584b7e93 tempest-VolumesGetTest-421307961 None] Creating volume 51133e5b-1681-49c0-96de-9333eb7c4000 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:03:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7040819e-3932-4934-98d5-991f584b7e93 tempest-VolumesGetTest-421307961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7040819e-3932-4934-98d5-991f584b7e93 tempest-VolumesGetTest-421307961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7040819e-3932-4934-98d5-991f584b7e93 tempest-VolumesGetTest-421307961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:03:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7040819e-3932-4934-98d5-991f584b7e93 tempest-VolumesGetTest-421307961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:03:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7040819e-3932-4934-98d5-991f584b7e93 tempest-VolumesGetTest-421307961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7040819e-3932-4934-98d5-991f584b7e93 tempest-VolumesGetTest-421307961 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:03:01 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-7040819e-3932-4934-98d5-991f584b7e93 tempest-VolumesGetTest-421307961 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:03:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7040819e-3932-4934-98d5-991f584b7e93 tempest-VolumesGetTest-421307961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-51133e5b-1681-49c0-96de-9333eb7c4000 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:01 devstack sudo[100553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-51133e5b-1681-49c0-96de-9333eb7c4000 1073741824 Sep 28 15:03:01 devstack sudo[100553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f13d3355-f8d4-430b-9ebb-5b92fe44bad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a826ceb0-d2c9-4fb5-8246-3abf8a975dc1', 'volume_size': 2, 'source_volid': 'eaaccc2f-1a6f-4c03-9a09-99472ff34bb6', 'source_volstatus': 'available'}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c9e4987-1e9d-4f5f-b61a-5c06f3878ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:01 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] Volume volume-a826ceb0-d2c9-4fb5-8246-3abf8a975dc1 (a826ceb0-d2c9-4fb5-8246-3abf8a975dc1): created successfully Sep 28 15:03:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c9e4987-1e9d-4f5f-b61a-5c06f3878ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] Flow 'volume_create_manager' (e2593e5b-81cd-440f-9e41-1457b75bbf22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:01 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-1532c7ad-9d5b-4708-99a0-a2869bf4fe71 tempest-VolumesCloneTest-1766322604 None] Created volume successfully. Sep 28 15:03:01 devstack sudo[100553]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7040819e-3932-4934-98d5-991f584b7e93 tempest-VolumesGetTest-421307961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-51133e5b-1681-49c0-96de-9333eb7c4000 1073741824" returned: 0 in 0.504s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7040819e-3932-4934-98d5-991f584b7e93 tempest-VolumesGetTest-421307961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-51133e5b-1681-49c0-96de-9333eb7c4000 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:01 devstack sudo[100558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-51133e5b-1681-49c0-96de-9333eb7c4000 Sep 28 15:03:01 devstack sudo[100558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:01 devstack sudo[100558]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7040819e-3932-4934-98d5-991f584b7e93 tempest-VolumesGetTest-421307961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-51133e5b-1681-49c0-96de-9333eb7c4000" returned: 0 in 0.280s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7040819e-3932-4934-98d5-991f584b7e93 tempest-VolumesGetTest-421307961 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:03:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7040819e-3932-4934-98d5-991f584b7e93 tempest-VolumesGetTest-421307961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1033ea9b-0045-4c41-85a4-7fafa748f411 tempest-VolumesTransfersV357Test-807036277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.786s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1033ea9b-0045-4c41-85a4-7fafa748f411 tempest-VolumesTransfersV357Test-807036277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:02:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2146397416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2435dcc-7e75-4719-8ce9-ef93b55618dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f3cb4b323c34baca55278f165285fed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:02:52Z,use_quota=True,user_id='c1c67c92369d4ac5a55f7a39a0d6dc18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:03:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-1033ea9b-0045-4c41-85a4-7fafa748f411 tempest-VolumesTransfersV357Test-807036277 None] Creating volume f2435dcc-7e75-4719-8ce9-ef93b55618dd {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:03:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1033ea9b-0045-4c41-85a4-7fafa748f411 tempest-VolumesTransfersV357Test-807036277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1033ea9b-0045-4c41-85a4-7fafa748f411 tempest-VolumesTransfersV357Test-807036277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1033ea9b-0045-4c41-85a4-7fafa748f411 tempest-VolumesTransfersV357Test-807036277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:03:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1033ea9b-0045-4c41-85a4-7fafa748f411 tempest-VolumesTransfersV357Test-807036277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:03:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1033ea9b-0045-4c41-85a4-7fafa748f411 tempest-VolumesTransfersV357Test-807036277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1033ea9b-0045-4c41-85a4-7fafa748f411 tempest-VolumesTransfersV357Test-807036277 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:03:01 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-1033ea9b-0045-4c41-85a4-7fafa748f411 tempest-VolumesTransfersV357Test-807036277 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:03:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1033ea9b-0045-4c41-85a4-7fafa748f411 tempest-VolumesTransfersV357Test-807036277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f2435dcc-7e75-4719-8ce9-ef93b55618dd 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7040819e-3932-4934-98d5-991f584b7e93 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32e29fed-5325-40c1-b8f1-91d631f0d123) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51133e5b-1681-49c0-96de-9333eb7c4000', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:01 devstack sudo[100561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f2435dcc-7e75-4719-8ce9-ef93b55618dd 1073741824 Sep 28 15:03:01 devstack sudo[100561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7040819e-3932-4934-98d5-991f584b7e93 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af422d17-807f-470b-b2fd-869240caa0ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:02 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-7040819e-3932-4934-98d5-991f584b7e93 tempest-VolumesGetTest-421307961 None] Volume volume-51133e5b-1681-49c0-96de-9333eb7c4000 (51133e5b-1681-49c0-96de-9333eb7c4000): created successfully Sep 28 15:03:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7040819e-3932-4934-98d5-991f584b7e93 tempest-VolumesGetTest-421307961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af422d17-807f-470b-b2fd-869240caa0ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7040819e-3932-4934-98d5-991f584b7e93 tempest-VolumesGetTest-421307961 None] Flow 'volume_create_manager' (10569768-6bdd-4a9a-8b6d-6e8ce83167de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:02 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-7040819e-3932-4934-98d5-991f584b7e93 tempest-VolumesGetTest-421307961 None] Created volume successfully. Sep 28 15:03:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a51d93d9-a460-4aec-9506-5bfe6be7c509 tempest-VolumesCloneTest-1766322604 None] Acquiring lock "cinder-a826ceb0-d2c9-4fb5-8246-3abf8a975dc1-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a51d93d9-a460-4aec-9506-5bfe6be7c509 tempest-VolumesCloneTest-1766322604 None] Lock "cinder-a826ceb0-d2c9-4fb5-8246-3abf8a975dc1-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a51d93d9-a460-4aec-9506-5bfe6be7c509 tempest-VolumesCloneTest-1766322604 None] Acquiring lock "cinder-quobyte-a826ceb0-d2c9-4fb5-8246-3abf8a975dc1" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a51d93d9-a460-4aec-9506-5bfe6be7c509 tempest-VolumesCloneTest-1766322604 None] Lock "cinder-quobyte-a826ceb0-d2c9-4fb5-8246-3abf8a975dc1" acquired by "delete_volume" :: waited 0.021s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:02 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[16de07f8-e8fe-4ad7-a141-cc3dd4aecfd0]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a51d93d9-a460-4aec-9506-5bfe6be7c509 tempest-VolumesCloneTest-1766322604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a826ceb0-d2c9-4fb5-8246-3abf8a975dc1 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:02 devstack sudo[100567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a826ceb0-d2c9-4fb5-8246-3abf8a975dc1 Sep 28 15:03:02 devstack sudo[100567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:02 devstack sudo[100561]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-249aeec9-80c1-4a8b-b844-ef11cd1b66d0 tempest-VolumesGetTest-421307961 None] Acquiring lock "cinder-51133e5b-1681-49c0-96de-9333eb7c4000-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1033ea9b-0045-4c41-85a4-7fafa748f411 tempest-VolumesTransfersV357Test-807036277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f2435dcc-7e75-4719-8ce9-ef93b55618dd 1073741824" returned: 0 in 0.688s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-249aeec9-80c1-4a8b-b844-ef11cd1b66d0 tempest-VolumesGetTest-421307961 None] Lock "cinder-51133e5b-1681-49c0-96de-9333eb7c4000-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1033ea9b-0045-4c41-85a4-7fafa748f411 tempest-VolumesTransfersV357Test-807036277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f2435dcc-7e75-4719-8ce9-ef93b55618dd {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-249aeec9-80c1-4a8b-b844-ef11cd1b66d0 tempest-VolumesGetTest-421307961 None] Acquiring lock "cinder-quobyte-51133e5b-1681-49c0-96de-9333eb7c4000" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:02 devstack sudo[100569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f2435dcc-7e75-4719-8ce9-ef93b55618dd Sep 28 15:03:02 devstack sudo[100569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-249aeec9-80c1-4a8b-b844-ef11cd1b66d0 tempest-VolumesGetTest-421307961 None] Lock "cinder-quobyte-51133e5b-1681-49c0-96de-9333eb7c4000" acquired by "delete_volume" :: waited 0.025s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:02 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[0859c5ba-1439-4894-956d-20b39eb0e7da]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-249aeec9-80c1-4a8b-b844-ef11cd1b66d0 tempest-VolumesGetTest-421307961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-51133e5b-1681-49c0-96de-9333eb7c4000 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:02 devstack sudo[100571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-51133e5b-1681-49c0-96de-9333eb7c4000 Sep 28 15:03:02 devstack sudo[100571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:03 devstack sudo[100567]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a51d93d9-a460-4aec-9506-5bfe6be7c509 tempest-VolumesCloneTest-1766322604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a826ceb0-d2c9-4fb5-8246-3abf8a975dc1" returned: 0 in 0.562s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a51d93d9-a460-4aec-9506-5bfe6be7c509 tempest-VolumesCloneTest-1766322604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a826ceb0-d2c9-4fb5-8246-3abf8a975dc1 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:03 devstack sudo[100576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a826ceb0-d2c9-4fb5-8246-3abf8a975dc1 Sep 28 15:03:03 devstack sudo[100576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:03 devstack sudo[100569]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1033ea9b-0045-4c41-85a4-7fafa748f411 tempest-VolumesTransfersV357Test-807036277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f2435dcc-7e75-4719-8ce9-ef93b55618dd" returned: 0 in 0.390s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1033ea9b-0045-4c41-85a4-7fafa748f411 tempest-VolumesTransfersV357Test-807036277 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:03:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1033ea9b-0045-4c41-85a4-7fafa748f411 tempest-VolumesTransfersV357Test-807036277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.163s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-dca08f04-2254-45b1-b542-19ff5f1dcfb6 req-4e528394-4204-4cea-9c62-a71a2a2b7c86 tempest-VolumesGetTestJSON-290504136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.558s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [req-dca08f04-2254-45b1-b542-19ff5f1dcfb6 req-4e528394-4204-4cea-9c62-a71a2a2b7c86 tempest-VolumesGetTestJSON-290504136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1165396524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffe082a5-d613-41c6-9894-582f1493b74d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='be88e6f09ae2469a8ce83eb6c98aca38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:00Z,use_quota=True,user_id='227cb03f30cb4cecb25e64d51573a41f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:03:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [req-dca08f04-2254-45b1-b542-19ff5f1dcfb6 req-4e528394-4204-4cea-9c62-a71a2a2b7c86 tempest-VolumesGetTestJSON-290504136 None] Creating volume ffe082a5-d613-41c6-9894-582f1493b74d {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:03:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-dca08f04-2254-45b1-b542-19ff5f1dcfb6 req-4e528394-4204-4cea-9c62-a71a2a2b7c86 tempest-VolumesGetTestJSON-290504136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-dca08f04-2254-45b1-b542-19ff5f1dcfb6 req-4e528394-4204-4cea-9c62-a71a2a2b7c86 tempest-VolumesGetTestJSON-290504136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [req-dca08f04-2254-45b1-b542-19ff5f1dcfb6 req-4e528394-4204-4cea-9c62-a71a2a2b7c86 tempest-VolumesGetTestJSON-290504136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:03:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [req-dca08f04-2254-45b1-b542-19ff5f1dcfb6 req-4e528394-4204-4cea-9c62-a71a2a2b7c86 tempest-VolumesGetTestJSON-290504136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:03:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-dca08f04-2254-45b1-b542-19ff5f1dcfb6 req-4e528394-4204-4cea-9c62-a71a2a2b7c86 tempest-VolumesGetTestJSON-290504136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [req-dca08f04-2254-45b1-b542-19ff5f1dcfb6 req-4e528394-4204-4cea-9c62-a71a2a2b7c86 tempest-VolumesGetTestJSON-290504136 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:03:03 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [req-dca08f04-2254-45b1-b542-19ff5f1dcfb6 req-4e528394-4204-4cea-9c62-a71a2a2b7c86 tempest-VolumesGetTestJSON-290504136 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:03:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-dca08f04-2254-45b1-b542-19ff5f1dcfb6 req-4e528394-4204-4cea-9c62-a71a2a2b7c86 tempest-VolumesGetTestJSON-290504136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ffe082a5-d613-41c6-9894-582f1493b74d 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1033ea9b-0045-4c41-85a4-7fafa748f411 tempest-VolumesTransfersV357Test-807036277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93e61d7f-ccf3-444a-bdf6-d8b5c3820d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2435dcc-7e75-4719-8ce9-ef93b55618dd', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1033ea9b-0045-4c41-85a4-7fafa748f411 tempest-VolumesTransfersV357Test-807036277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96caf076-e7c7-43b0-b9ee-9298523145be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:03 devstack sudo[100579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ffe082a5-d613-41c6-9894-582f1493b74d 1073741824 Sep 28 15:03:03 devstack sudo[100579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:03 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-1033ea9b-0045-4c41-85a4-7fafa748f411 tempest-VolumesTransfersV357Test-807036277 None] Volume volume-f2435dcc-7e75-4719-8ce9-ef93b55618dd (f2435dcc-7e75-4719-8ce9-ef93b55618dd): created successfully Sep 28 15:03:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1033ea9b-0045-4c41-85a4-7fafa748f411 tempest-VolumesTransfersV357Test-807036277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96caf076-e7c7-43b0-b9ee-9298523145be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1033ea9b-0045-4c41-85a4-7fafa748f411 tempest-VolumesTransfersV357Test-807036277 None] Flow 'volume_create_manager' (05ab8c63-356a-43c1-aacc-f0a7960e0206) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:03 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-1033ea9b-0045-4c41-85a4-7fafa748f411 tempest-VolumesTransfersV357Test-807036277 None] Created volume successfully. Sep 28 15:03:03 devstack sudo[100576]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a51d93d9-a460-4aec-9506-5bfe6be7c509 tempest-VolumesCloneTest-1766322604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a826ceb0-d2c9-4fb5-8246-3abf8a975dc1" returned: 0 in 0.369s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:03 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a51d93d9-a460-4aec-9506-5bfe6be7c509 tempest-VolumesCloneTest-1766322604 None] Lock "cinder-quobyte-a826ceb0-d2c9-4fb5-8246-3abf8a975dc1" released by "delete_volume" :: held 0.994s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:03 devstack sudo[100571]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-249aeec9-80c1-4a8b-b844-ef11cd1b66d0 tempest-VolumesGetTest-421307961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-51133e5b-1681-49c0-96de-9333eb7c4000" returned: 0 in 0.605s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-249aeec9-80c1-4a8b-b844-ef11cd1b66d0 tempest-VolumesGetTest-421307961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-51133e5b-1681-49c0-96de-9333eb7c4000 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:03 devstack sudo[100585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-51133e5b-1681-49c0-96de-9333eb7c4000 Sep 28 15:03:03 devstack sudo[100585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:03 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-a51d93d9-a460-4aec-9506-5bfe6be7c509 tempest-VolumesCloneTest-1766322604 None] Created reservations ['aa86ecba-33c3-4e14-9ff4-24f73039fcc3', '7440d999-28e4-45c6-b8ea-edaf29aa4a9a', 'c00cf2df-ba26-448f-9eff-d03fe0a37a8d', '280b5c3a-1455-4b38-90e0-973bbbfde889'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:03:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a51d93d9-a460-4aec-9506-5bfe6be7c509 tempest-VolumesCloneTest-1766322604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a51d93d9-a460-4aec-9506-5bfe6be7c509 tempest-VolumesCloneTest-1766322604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a51d93d9-a460-4aec-9506-5bfe6be7c509 tempest-VolumesCloneTest-1766322604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:03:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a51d93d9-a460-4aec-9506-5bfe6be7c509 tempest-VolumesCloneTest-1766322604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:03:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a51d93d9-a460-4aec-9506-5bfe6be7c509 tempest-VolumesCloneTest-1766322604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a51d93d9-a460-4aec-9506-5bfe6be7c509 tempest-VolumesCloneTest-1766322604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:03 devstack sudo[100591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:03:03 devstack sudo[100591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:03 devstack sudo[100585]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-249aeec9-80c1-4a8b-b844-ef11cd1b66d0 tempest-VolumesGetTest-421307961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-51133e5b-1681-49c0-96de-9333eb7c4000" returned: 0 in 0.406s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:03 devstack sudo[100579]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:03 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-249aeec9-80c1-4a8b-b844-ef11cd1b66d0 tempest-VolumesGetTest-421307961 None] Lock "cinder-quobyte-51133e5b-1681-49c0-96de-9333eb7c4000" released by "delete_volume" :: held 1.084s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-dca08f04-2254-45b1-b542-19ff5f1dcfb6 req-4e528394-4204-4cea-9c62-a71a2a2b7c86 tempest-VolumesGetTestJSON-290504136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ffe082a5-d613-41c6-9894-582f1493b74d 1073741824" returned: 0 in 0.718s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-dca08f04-2254-45b1-b542-19ff5f1dcfb6 req-4e528394-4204-4cea-9c62-a71a2a2b7c86 tempest-VolumesGetTestJSON-290504136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ffe082a5-d613-41c6-9894-582f1493b74d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:03 devstack sudo[100596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ffe082a5-d613-41c6-9894-582f1493b74d Sep 28 15:03:03 devstack sudo[100596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:03 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-249aeec9-80c1-4a8b-b844-ef11cd1b66d0 tempest-VolumesGetTest-421307961 None] Created reservations ['983a861b-6ac8-4dcb-a350-87c9a7c5eb79', '580f3539-5ff3-40ac-a249-a430039ccafa', '7230cf53-e19d-484f-9209-645408ae5c5d', '51bdda28-cfd9-4c3d-87a7-9aece4fee1fe'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:03:03 devstack sudo[100591]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a51d93d9-a460-4aec-9506-5bfe6be7c509 tempest-VolumesCloneTest-1766322604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.380s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:03 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-a51d93d9-a460-4aec-9506-5bfe6be7c509 tempest-VolumesCloneTest-1766322604 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:03:04 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-a51d93d9-a460-4aec-9506-5bfe6be7c509 tempest-VolumesCloneTest-1766322604 None] Deleted volume successfully. Sep 28 15:03:04 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a51d93d9-a460-4aec-9506-5bfe6be7c509 tempest-VolumesCloneTest-1766322604 None] Lock "cinder-a826ceb0-d2c9-4fb5-8246-3abf8a975dc1-delete_volume" released by "delete_volume" :: held 1.726s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-249aeec9-80c1-4a8b-b844-ef11cd1b66d0 tempest-VolumesGetTest-421307961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-249aeec9-80c1-4a8b-b844-ef11cd1b66d0 tempest-VolumesGetTest-421307961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:04 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-249aeec9-80c1-4a8b-b844-ef11cd1b66d0 tempest-VolumesGetTest-421307961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:03:04 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-249aeec9-80c1-4a8b-b844-ef11cd1b66d0 tempest-VolumesGetTest-421307961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:03:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-249aeec9-80c1-4a8b-b844-ef11cd1b66d0 tempest-VolumesGetTest-421307961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-249aeec9-80c1-4a8b-b844-ef11cd1b66d0 tempest-VolumesGetTest-421307961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:04 devstack sudo[100598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:03:04 devstack sudo[100598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:04 devstack sudo[100596]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-dca08f04-2254-45b1-b542-19ff5f1dcfb6 req-4e528394-4204-4cea-9c62-a71a2a2b7c86 tempest-VolumesGetTestJSON-290504136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ffe082a5-d613-41c6-9894-582f1493b74d" returned: 0 in 0.393s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:04 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [req-dca08f04-2254-45b1-b542-19ff5f1dcfb6 req-4e528394-4204-4cea-9c62-a71a2a2b7c86 tempest-VolumesGetTestJSON-290504136 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:03:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-dca08f04-2254-45b1-b542-19ff5f1dcfb6 req-4e528394-4204-4cea-9c62-a71a2a2b7c86 tempest-VolumesGetTestJSON-290504136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-dca08f04-2254-45b1-b542-19ff5f1dcfb6 req-4e528394-4204-4cea-9c62-a71a2a2b7c86 tempest-VolumesGetTestJSON-290504136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdf0bdea-4f13-4928-8719-3fb85e9f8af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffe082a5-d613-41c6-9894-582f1493b74d', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-dca08f04-2254-45b1-b542-19ff5f1dcfb6 req-4e528394-4204-4cea-9c62-a71a2a2b7c86 tempest-VolumesGetTestJSON-290504136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5627ab05-e1b0-475d-ba73-c4357a28bf34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:04 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [req-dca08f04-2254-45b1-b542-19ff5f1dcfb6 req-4e528394-4204-4cea-9c62-a71a2a2b7c86 tempest-VolumesGetTestJSON-290504136 None] Volume volume-ffe082a5-d613-41c6-9894-582f1493b74d (ffe082a5-d613-41c6-9894-582f1493b74d): created successfully Sep 28 15:03:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-dca08f04-2254-45b1-b542-19ff5f1dcfb6 req-4e528394-4204-4cea-9c62-a71a2a2b7c86 tempest-VolumesGetTestJSON-290504136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5627ab05-e1b0-475d-ba73-c4357a28bf34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-dca08f04-2254-45b1-b542-19ff5f1dcfb6 req-4e528394-4204-4cea-9c62-a71a2a2b7c86 tempest-VolumesGetTestJSON-290504136 None] Flow 'volume_create_manager' (a522ad8b-2355-411f-b54c-8f6c75c86eb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:04 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-dca08f04-2254-45b1-b542-19ff5f1dcfb6 req-4e528394-4204-4cea-9c62-a71a2a2b7c86 tempest-VolumesGetTestJSON-290504136 None] Created volume successfully. Sep 28 15:03:04 devstack sudo[100598]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-249aeec9-80c1-4a8b-b844-ef11cd1b66d0 tempest-VolumesGetTest-421307961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.352s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:04 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-249aeec9-80c1-4a8b-b844-ef11cd1b66d0 tempest-VolumesGetTest-421307961 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:03:04 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-249aeec9-80c1-4a8b-b844-ef11cd1b66d0 tempest-VolumesGetTest-421307961 None] Deleted volume successfully. Sep 28 15:03:04 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-249aeec9-80c1-4a8b-b844-ef11cd1b66d0 tempest-VolumesGetTest-421307961 None] Lock "cinder-51133e5b-1681-49c0-96de-9333eb7c4000-delete_volume" released by "delete_volume" :: held 1.846s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:04 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-189737fe-7399-4b1e-b1f5-ebe8932c57ad tempest-VolumesCloneTest-1766322604 None] Acquiring lock "cinder-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:04 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-189737fe-7399-4b1e-b1f5-ebe8932c57ad tempest-VolumesCloneTest-1766322604 None] Lock "cinder-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:04 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-189737fe-7399-4b1e-b1f5-ebe8932c57ad tempest-VolumesCloneTest-1766322604 None] Acquiring lock "cinder-quobyte-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:04 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-189737fe-7399-4b1e-b1f5-ebe8932c57ad tempest-VolumesCloneTest-1766322604 None] Lock "cinder-quobyte-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6" acquired by "delete_volume" :: waited 0.028s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:04 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[23172ca2-af9d-49de-8931-566e05d5a4c0]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-189737fe-7399-4b1e-b1f5-ebe8932c57ad tempest-VolumesCloneTest-1766322604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:05 devstack sudo[100602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6 Sep 28 15:03:05 devstack sudo[100602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:05 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c37e97a5-f15f-47c3-9877-52d1587776a5 tempest-VolumesGetTest-421307961 None] Acquiring lock "cinder-7a08243d-5446-4953-8f00-5e587467a130-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:05 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c37e97a5-f15f-47c3-9877-52d1587776a5 tempest-VolumesGetTest-421307961 None] Lock "cinder-7a08243d-5446-4953-8f00-5e587467a130-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:05 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c37e97a5-f15f-47c3-9877-52d1587776a5 tempest-VolumesGetTest-421307961 None] Acquiring lock "cinder-quobyte-7a08243d-5446-4953-8f00-5e587467a130" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:05 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c37e97a5-f15f-47c3-9877-52d1587776a5 tempest-VolumesGetTest-421307961 None] Lock "cinder-quobyte-7a08243d-5446-4953-8f00-5e587467a130" acquired by "delete_volume" :: waited 0.023s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:05 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf695900-291d-43db-9af1-bb8afcb50ba6]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c37e97a5-f15f-47c3-9877-52d1587776a5 tempest-VolumesGetTest-421307961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7a08243d-5446-4953-8f00-5e587467a130 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:05 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-02ba06bf-cb6e-450e-9d25-899f67a8bf77 req-1ef5f7f5-d9be-4461-aca6-79a19713687d tempest-VolumesGetTestJSON-290504136 None] Acquiring lock "cinder-ffe082a5-d613-41c6-9894-582f1493b74d-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:05 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-02ba06bf-cb6e-450e-9d25-899f67a8bf77 req-1ef5f7f5-d9be-4461-aca6-79a19713687d tempest-VolumesGetTestJSON-290504136 None] Lock "cinder-ffe082a5-d613-41c6-9894-582f1493b74d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:05 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-02ba06bf-cb6e-450e-9d25-899f67a8bf77 req-1ef5f7f5-d9be-4461-aca6-79a19713687d tempest-VolumesGetTestJSON-290504136 None] Acquiring lock "cinder-quobyte-ffe082a5-d613-41c6-9894-582f1493b74d" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:05 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-5b604896-3efe-4120-be72-84bb13f4802d tempest-VolumesTransfersV357Test-916425220 None] Transfer volume completed successfully. Sep 28 15:03:05 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-02ba06bf-cb6e-450e-9d25-899f67a8bf77 req-1ef5f7f5-d9be-4461-aca6-79a19713687d tempest-VolumesGetTestJSON-290504136 None] Lock "cinder-quobyte-ffe082a5-d613-41c6-9894-582f1493b74d" acquired by "delete_volume" :: waited 0.027s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:05 devstack sudo[100604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7a08243d-5446-4953-8f00-5e587467a130 Sep 28 15:03:05 devstack sudo[100604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:05 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[1246db64-4abd-4f18-887d-fc82240576e1]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-02ba06bf-cb6e-450e-9d25-899f67a8bf77 req-1ef5f7f5-d9be-4461-aca6-79a19713687d tempest-VolumesGetTestJSON-290504136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ffe082a5-d613-41c6-9894-582f1493b74d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:05 devstack sudo[100602]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-189737fe-7399-4b1e-b1f5-ebe8932c57ad tempest-VolumesCloneTest-1766322604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6" returned: 0 in 0.622s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-189737fe-7399-4b1e-b1f5-ebe8932c57ad tempest-VolumesCloneTest-1766322604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:05 devstack sudo[100610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6 Sep 28 15:03:05 devstack sudo[100610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:05 devstack sudo[100609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ffe082a5-d613-41c6-9894-582f1493b74d Sep 28 15:03:05 devstack sudo[100609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:05 devstack sudo[100604]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c37e97a5-f15f-47c3-9877-52d1587776a5 tempest-VolumesGetTest-421307961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7a08243d-5446-4953-8f00-5e587467a130" returned: 0 in 0.577s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c37e97a5-f15f-47c3-9877-52d1587776a5 tempest-VolumesGetTest-421307961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7a08243d-5446-4953-8f00-5e587467a130 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:05 devstack sudo[100616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7a08243d-5446-4953-8f00-5e587467a130 Sep 28 15:03:05 devstack sudo[100616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:05 devstack sudo[100610]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-189737fe-7399-4b1e-b1f5-ebe8932c57ad tempest-VolumesCloneTest-1766322604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6" returned: 0 in 0.458s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:05 devstack sudo[100609]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-02ba06bf-cb6e-450e-9d25-899f67a8bf77 req-1ef5f7f5-d9be-4461-aca6-79a19713687d tempest-VolumesGetTestJSON-290504136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ffe082a5-d613-41c6-9894-582f1493b74d" returned: 0 in 0.511s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-02ba06bf-cb6e-450e-9d25-899f67a8bf77 req-1ef5f7f5-d9be-4461-aca6-79a19713687d tempest-VolumesGetTestJSON-290504136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ffe082a5-d613-41c6-9894-582f1493b74d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:05 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-189737fe-7399-4b1e-b1f5-ebe8932c57ad tempest-VolumesCloneTest-1766322604 None] Lock "cinder-quobyte-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6" released by "delete_volume" :: held 1.222s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:06 devstack sudo[100623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ffe082a5-d613-41c6-9894-582f1493b74d Sep 28 15:03:06 devstack sudo[100623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:06 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-189737fe-7399-4b1e-b1f5-ebe8932c57ad tempest-VolumesCloneTest-1766322604 None] Created reservations ['ba5bf244-6f1f-489a-a2ae-8ea363a8d868', '003196e4-9f31-410c-9a7f-dd05c993578b', '6744f635-847d-4b8d-9cf8-50312dfb5794', '53e6dd70-ecb0-4553-ad9a-c079a74297a6'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:03:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-189737fe-7399-4b1e-b1f5-ebe8932c57ad tempest-VolumesCloneTest-1766322604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-189737fe-7399-4b1e-b1f5-ebe8932c57ad tempest-VolumesCloneTest-1766322604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-189737fe-7399-4b1e-b1f5-ebe8932c57ad tempest-VolumesCloneTest-1766322604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:03:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-189737fe-7399-4b1e-b1f5-ebe8932c57ad tempest-VolumesCloneTest-1766322604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:03:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-189737fe-7399-4b1e-b1f5-ebe8932c57ad tempest-VolumesCloneTest-1766322604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-189737fe-7399-4b1e-b1f5-ebe8932c57ad tempest-VolumesCloneTest-1766322604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:06 devstack sudo[100616]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c37e97a5-f15f-47c3-9877-52d1587776a5 tempest-VolumesGetTest-421307961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7a08243d-5446-4953-8f00-5e587467a130" returned: 0 in 0.420s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:06 devstack sudo[100626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:03:06 devstack sudo[100626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c37e97a5-f15f-47c3-9877-52d1587776a5 tempest-VolumesGetTest-421307961 None] Lock "cinder-quobyte-7a08243d-5446-4953-8f00-5e587467a130" released by "delete_volume" :: held 1.097s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3086c5f3-9ead-43a3-bab7-9c73ccdd053d tempest-VolumesTransfersV357Test-1371605380 None] Acquiring lock "cinder-f2435dcc-7e75-4719-8ce9-ef93b55618dd-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3086c5f3-9ead-43a3-bab7-9c73ccdd053d tempest-VolumesTransfersV357Test-1371605380 None] Lock "cinder-f2435dcc-7e75-4719-8ce9-ef93b55618dd-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:06 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-c37e97a5-f15f-47c3-9877-52d1587776a5 tempest-VolumesGetTest-421307961 None] Created reservations ['62d1dace-11bb-4cd2-b055-ab4751a375f7', '2a79fe81-69a4-4bfc-9ee8-1b7da6e67c2a', '21c96f97-fdce-4cda-9626-89541004b546', '3592853e-e344-44c1-b4be-ae5e495f083a'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:03:06 devstack sudo[100623]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-02ba06bf-cb6e-450e-9d25-899f67a8bf77 req-1ef5f7f5-d9be-4461-aca6-79a19713687d tempest-VolumesGetTestJSON-290504136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ffe082a5-d613-41c6-9894-582f1493b74d" returned: 0 in 0.416s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3086c5f3-9ead-43a3-bab7-9c73ccdd053d tempest-VolumesTransfersV357Test-1371605380 None] Acquiring lock "cinder-quobyte-f2435dcc-7e75-4719-8ce9-ef93b55618dd" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-02ba06bf-cb6e-450e-9d25-899f67a8bf77 req-1ef5f7f5-d9be-4461-aca6-79a19713687d tempest-VolumesGetTestJSON-290504136 None] Lock "cinder-quobyte-ffe082a5-d613-41c6-9894-582f1493b74d" released by "delete_volume" :: held 1.012s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3086c5f3-9ead-43a3-bab7-9c73ccdd053d tempest-VolumesTransfersV357Test-1371605380 None] Lock "cinder-quobyte-f2435dcc-7e75-4719-8ce9-ef93b55618dd" acquired by "delete_volume" :: waited 0.039s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:06 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b150eda-75c5-446f-b2f1-33c247a1304c]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3086c5f3-9ead-43a3-bab7-9c73ccdd053d tempest-VolumesTransfersV357Test-1371605380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f2435dcc-7e75-4719-8ce9-ef93b55618dd {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c37e97a5-f15f-47c3-9877-52d1587776a5 tempest-VolumesGetTest-421307961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c37e97a5-f15f-47c3-9877-52d1587776a5 tempest-VolumesGetTest-421307961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c37e97a5-f15f-47c3-9877-52d1587776a5 tempest-VolumesGetTest-421307961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:03:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c37e97a5-f15f-47c3-9877-52d1587776a5 tempest-VolumesGetTest-421307961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:03:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c37e97a5-f15f-47c3-9877-52d1587776a5 tempest-VolumesGetTest-421307961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c37e97a5-f15f-47c3-9877-52d1587776a5 tempest-VolumesGetTest-421307961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:06 devstack sudo[100631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:03:06 devstack sudo[100631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:06 devstack cinder-volume[87116]: DEBUG cinder.quota [req-02ba06bf-cb6e-450e-9d25-899f67a8bf77 req-1ef5f7f5-d9be-4461-aca6-79a19713687d tempest-VolumesGetTestJSON-290504136 None] Created reservations ['31edd5fd-71ba-40a0-a504-806f1c8c9dd0', '81c4600e-b6d8-4c9a-a8f9-bfad419aecc7', '5caef58a-5b68-4ec0-a38c-0c9e0898a013', 'bd2b66b2-2d92-474c-a4be-f2a43c48a965'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:03:06 devstack sudo[100626]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-189737fe-7399-4b1e-b1f5-ebe8932c57ad tempest-VolumesCloneTest-1766322604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.445s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:06 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-189737fe-7399-4b1e-b1f5-ebe8932c57ad tempest-VolumesCloneTest-1766322604 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:03:06 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-189737fe-7399-4b1e-b1f5-ebe8932c57ad tempest-VolumesCloneTest-1766322604 None] Deleted volume successfully. Sep 28 15:03:06 devstack sudo[100629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f2435dcc-7e75-4719-8ce9-ef93b55618dd Sep 28 15:03:06 devstack sudo[100629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-189737fe-7399-4b1e-b1f5-ebe8932c57ad tempest-VolumesCloneTest-1766322604 None] Lock "cinder-eaaccc2f-1a6f-4c03-9a09-99472ff34bb6-delete_volume" released by "delete_volume" :: held 1.984s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-02ba06bf-cb6e-450e-9d25-899f67a8bf77 req-1ef5f7f5-d9be-4461-aca6-79a19713687d tempest-VolumesGetTestJSON-290504136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-02ba06bf-cb6e-450e-9d25-899f67a8bf77 req-1ef5f7f5-d9be-4461-aca6-79a19713687d tempest-VolumesGetTestJSON-290504136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [req-02ba06bf-cb6e-450e-9d25-899f67a8bf77 req-1ef5f7f5-d9be-4461-aca6-79a19713687d tempest-VolumesGetTestJSON-290504136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:03:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [req-02ba06bf-cb6e-450e-9d25-899f67a8bf77 req-1ef5f7f5-d9be-4461-aca6-79a19713687d tempest-VolumesGetTestJSON-290504136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:03:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-02ba06bf-cb6e-450e-9d25-899f67a8bf77 req-1ef5f7f5-d9be-4461-aca6-79a19713687d tempest-VolumesGetTestJSON-290504136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-02ba06bf-cb6e-450e-9d25-899f67a8bf77 req-1ef5f7f5-d9be-4461-aca6-79a19713687d tempest-VolumesGetTestJSON-290504136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:06 devstack sudo[100634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:03:06 devstack sudo[100634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:06 devstack sudo[100631]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c37e97a5-f15f-47c3-9877-52d1587776a5 tempest-VolumesGetTest-421307961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.337s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:06 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-c37e97a5-f15f-47c3-9877-52d1587776a5 tempest-VolumesGetTest-421307961 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:03:06 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-c37e97a5-f15f-47c3-9877-52d1587776a5 tempest-VolumesGetTest-421307961 None] Deleted volume successfully. Sep 28 15:03:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c37e97a5-f15f-47c3-9877-52d1587776a5 tempest-VolumesGetTest-421307961 None] Lock "cinder-7a08243d-5446-4953-8f00-5e587467a130-delete_volume" released by "delete_volume" :: held 1.904s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:07 devstack sudo[100629]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:07 devstack sudo[100634]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3086c5f3-9ead-43a3-bab7-9c73ccdd053d tempest-VolumesTransfersV357Test-1371605380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f2435dcc-7e75-4719-8ce9-ef93b55618dd" returned: 0 in 0.517s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3086c5f3-9ead-43a3-bab7-9c73ccdd053d tempest-VolumesTransfersV357Test-1371605380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f2435dcc-7e75-4719-8ce9-ef93b55618dd {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-02ba06bf-cb6e-450e-9d25-899f67a8bf77 req-1ef5f7f5-d9be-4461-aca6-79a19713687d tempest-VolumesGetTestJSON-290504136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.303s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:07 devstack cinder-volume[87116]: DEBUG cinder.manager [req-02ba06bf-cb6e-450e-9d25-899f67a8bf77 req-1ef5f7f5-d9be-4461-aca6-79a19713687d tempest-VolumesGetTestJSON-290504136 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:03:07 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-02ba06bf-cb6e-450e-9d25-899f67a8bf77 req-1ef5f7f5-d9be-4461-aca6-79a19713687d tempest-VolumesGetTestJSON-290504136 None] Deleted volume successfully. Sep 28 15:03:07 devstack sudo[100641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f2435dcc-7e75-4719-8ce9-ef93b55618dd Sep 28 15:03:07 devstack sudo[100641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:07 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-02ba06bf-cb6e-450e-9d25-899f67a8bf77 req-1ef5f7f5-d9be-4461-aca6-79a19713687d tempest-VolumesGetTestJSON-290504136 None] Lock "cinder-ffe082a5-d613-41c6-9894-582f1493b74d-delete_volume" released by "delete_volume" :: held 1.755s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:07 devstack sudo[100641]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3086c5f3-9ead-43a3-bab7-9c73ccdd053d tempest-VolumesTransfersV357Test-1371605380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f2435dcc-7e75-4719-8ce9-ef93b55618dd" returned: 0 in 0.313s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:07 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3086c5f3-9ead-43a3-bab7-9c73ccdd053d tempest-VolumesTransfersV357Test-1371605380 None] Lock "cinder-quobyte-f2435dcc-7e75-4719-8ce9-ef93b55618dd" released by "delete_volume" :: held 0.907s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:07 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-3086c5f3-9ead-43a3-bab7-9c73ccdd053d tempest-VolumesTransfersV357Test-1371605380 None] Created reservations ['f6fa7a91-2180-4f0e-b8df-1d713d5e56a9', '274c7685-8a28-4266-bf5c-97501c1086b2', '699a200d-075f-4b1c-aa25-ff0fa3d36a37', 'a00a55c1-6ecb-4b61-946a-6aa3e48c4f24'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:03:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3086c5f3-9ead-43a3-bab7-9c73ccdd053d tempest-VolumesTransfersV357Test-1371605380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3086c5f3-9ead-43a3-bab7-9c73ccdd053d tempest-VolumesTransfersV357Test-1371605380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:07 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3086c5f3-9ead-43a3-bab7-9c73ccdd053d tempest-VolumesTransfersV357Test-1371605380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:03:07 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3086c5f3-9ead-43a3-bab7-9c73ccdd053d tempest-VolumesTransfersV357Test-1371605380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:03:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3086c5f3-9ead-43a3-bab7-9c73ccdd053d tempest-VolumesTransfersV357Test-1371605380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3086c5f3-9ead-43a3-bab7-9c73ccdd053d tempest-VolumesTransfersV357Test-1371605380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:07 devstack sudo[100644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:03:07 devstack sudo[100644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:07 devstack sudo[100644]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3086c5f3-9ead-43a3-bab7-9c73ccdd053d tempest-VolumesTransfersV357Test-1371605380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.337s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:07 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-3086c5f3-9ead-43a3-bab7-9c73ccdd053d tempest-VolumesTransfersV357Test-1371605380 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:03:07 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-3086c5f3-9ead-43a3-bab7-9c73ccdd053d tempest-VolumesTransfersV357Test-1371605380 None] Deleted volume successfully. Sep 28 15:03:07 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3086c5f3-9ead-43a3-bab7-9c73ccdd053d tempest-VolumesTransfersV357Test-1371605380 None] Lock "cinder-f2435dcc-7e75-4719-8ce9-ef93b55618dd-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:09 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:DELETE=16,cinder:SELECT=132,cinder:INSERT=51,cinder:UPDATE=186 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:03:09 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:UPDATE=189,cinder:DELETE=16,cinder:INSERT=49,cinder:SELECT=135 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:03:09 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-be514078-a9ef-40c7-938f-7e91e0733319 tempest-VolumesTransfersV357Test-807036277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:03:09 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-be514078-a9ef-40c7-938f-7e91e0733319 tempest-VolumesTransfersV357Test-807036277 None] Flow 'volume_create_manager' (e0ae758e-850f-42e7-b523-051b80357751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:09 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-be514078-a9ef-40c7-938f-7e91e0733319 tempest-VolumesTransfersV357Test-807036277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bfead01-0a92-4711-b45a-b6e43e7dfa5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:09 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-be514078-a9ef-40c7-938f-7e91e0733319 tempest-VolumesTransfersV357Test-807036277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bfead01-0a92-4711-b45a-b6e43e7dfa5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-513532168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff3aa6da-05d0-4413-98f9-dac48f434182,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f3cb4b323c34baca55278f165285fed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:09Z,use_quota=True,user_id='c1c67c92369d4ac5a55f7a39a0d6dc18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:09 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-be514078-a9ef-40c7-938f-7e91e0733319 tempest-VolumesTransfersV357Test-807036277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f743acc-391c-49d2-8ffb-8d12c97fa76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:09 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-be514078-a9ef-40c7-938f-7e91e0733319 tempest-VolumesTransfersV357Test-807036277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f743acc-391c-49d2-8ffb-8d12c97fa76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:09 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-be514078-a9ef-40c7-938f-7e91e0733319 tempest-VolumesTransfersV357Test-807036277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f85c2fd-ec96-4ff7-a762-70ba3aeefa2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:09 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-be514078-a9ef-40c7-938f-7e91e0733319 tempest-VolumesTransfersV357Test-807036277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f85c2fd-ec96-4ff7-a762-70ba3aeefa2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff3aa6da-05d0-4413-98f9-dac48f434182', 'volume_name': 'volume-ff3aa6da-05d0-4413-98f9-dac48f434182', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:09 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-be514078-a9ef-40c7-938f-7e91e0733319 tempest-VolumesTransfersV357Test-807036277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81fa3953-f805-4a45-8291-7810ce076491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:09 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-be514078-a9ef-40c7-938f-7e91e0733319 tempest-VolumesTransfersV357Test-807036277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81fa3953-f805-4a45-8291-7810ce076491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:09 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-be514078-a9ef-40c7-938f-7e91e0733319 tempest-VolumesTransfersV357Test-807036277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cc02604-255f-44e0-a1e2-e6a000b24380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:09 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-be514078-a9ef-40c7-938f-7e91e0733319 tempest-VolumesTransfersV357Test-807036277 None] Volume ff3aa6da-05d0-4413-98f9-dac48f434182: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff3aa6da-05d0-4413-98f9-dac48f434182', 'volume_size': 1} Sep 28 15:03:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-be514078-a9ef-40c7-938f-7e91e0733319 tempest-VolumesTransfersV357Test-807036277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-be514078-a9ef-40c7-938f-7e91e0733319 tempest-VolumesTransfersV357Test-807036277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:09 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-be514078-a9ef-40c7-938f-7e91e0733319 tempest-VolumesTransfersV357Test-807036277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-513532168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff3aa6da-05d0-4413-98f9-dac48f434182,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f3cb4b323c34baca55278f165285fed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:09Z,use_quota=True,user_id='c1c67c92369d4ac5a55f7a39a0d6dc18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:03:09 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-be514078-a9ef-40c7-938f-7e91e0733319 tempest-VolumesTransfersV357Test-807036277 None] Creating volume ff3aa6da-05d0-4413-98f9-dac48f434182 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:03:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-be514078-a9ef-40c7-938f-7e91e0733319 tempest-VolumesTransfersV357Test-807036277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-be514078-a9ef-40c7-938f-7e91e0733319 tempest-VolumesTransfersV357Test-807036277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:09 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-be514078-a9ef-40c7-938f-7e91e0733319 tempest-VolumesTransfersV357Test-807036277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:03:09 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-be514078-a9ef-40c7-938f-7e91e0733319 tempest-VolumesTransfersV357Test-807036277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:03:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-be514078-a9ef-40c7-938f-7e91e0733319 tempest-VolumesTransfersV357Test-807036277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:09 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-be514078-a9ef-40c7-938f-7e91e0733319 tempest-VolumesTransfersV357Test-807036277 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:03:09 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-be514078-a9ef-40c7-938f-7e91e0733319 tempest-VolumesTransfersV357Test-807036277 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:03:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-be514078-a9ef-40c7-938f-7e91e0733319 tempest-VolumesTransfersV357Test-807036277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ff3aa6da-05d0-4413-98f9-dac48f434182 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:09 devstack sudo[100647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ff3aa6da-05d0-4413-98f9-dac48f434182 1073741824 Sep 28 15:03:09 devstack sudo[100647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:10 devstack sudo[100647]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-be514078-a9ef-40c7-938f-7e91e0733319 tempest-VolumesTransfersV357Test-807036277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ff3aa6da-05d0-4413-98f9-dac48f434182 1073741824" returned: 0 in 0.759s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-be514078-a9ef-40c7-938f-7e91e0733319 tempest-VolumesTransfersV357Test-807036277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ff3aa6da-05d0-4413-98f9-dac48f434182 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:10 devstack sudo[100653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ff3aa6da-05d0-4413-98f9-dac48f434182 Sep 28 15:03:10 devstack sudo[100653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:10 devstack sudo[100653]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-be514078-a9ef-40c7-938f-7e91e0733319 tempest-VolumesTransfersV357Test-807036277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ff3aa6da-05d0-4413-98f9-dac48f434182" returned: 0 in 0.396s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:10 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-be514078-a9ef-40c7-938f-7e91e0733319 tempest-VolumesTransfersV357Test-807036277 None] <== create_volume: return (1228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:03:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-be514078-a9ef-40c7-938f-7e91e0733319 tempest-VolumesTransfersV357Test-807036277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.231s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-be514078-a9ef-40c7-938f-7e91e0733319 tempest-VolumesTransfersV357Test-807036277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cc02604-255f-44e0-a1e2-e6a000b24380) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff3aa6da-05d0-4413-98f9-dac48f434182', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-be514078-a9ef-40c7-938f-7e91e0733319 tempest-VolumesTransfersV357Test-807036277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbc1ac6e-d042-41f1-becc-81ec1c6dcca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:10 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-be514078-a9ef-40c7-938f-7e91e0733319 tempest-VolumesTransfersV357Test-807036277 None] Volume volume-ff3aa6da-05d0-4413-98f9-dac48f434182 (ff3aa6da-05d0-4413-98f9-dac48f434182): created successfully Sep 28 15:03:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-be514078-a9ef-40c7-938f-7e91e0733319 tempest-VolumesTransfersV357Test-807036277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbc1ac6e-d042-41f1-becc-81ec1c6dcca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-be514078-a9ef-40c7-938f-7e91e0733319 tempest-VolumesTransfersV357Test-807036277 None] Flow 'volume_create_manager' (e0ae758e-850f-42e7-b523-051b80357751) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:10 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-be514078-a9ef-40c7-938f-7e91e0733319 tempest-VolumesTransfersV357Test-807036277 None] Created volume successfully. Sep 28 15:03:11 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-97e4d6b2-33f5-4a70-9660-94ded62e0de2 tempest-VolumesTransfersV357Test-1371605380 None] Acquiring lock "cinder-ff3aa6da-05d0-4413-98f9-dac48f434182-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:11 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-97e4d6b2-33f5-4a70-9660-94ded62e0de2 tempest-VolumesTransfersV357Test-1371605380 None] Lock "cinder-ff3aa6da-05d0-4413-98f9-dac48f434182-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:11 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-97e4d6b2-33f5-4a70-9660-94ded62e0de2 tempest-VolumesTransfersV357Test-1371605380 None] Acquiring lock "cinder-quobyte-ff3aa6da-05d0-4413-98f9-dac48f434182" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:11 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-97e4d6b2-33f5-4a70-9660-94ded62e0de2 tempest-VolumesTransfersV357Test-1371605380 None] Lock "cinder-quobyte-ff3aa6da-05d0-4413-98f9-dac48f434182" acquired by "delete_volume" :: waited 0.020s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:12 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe85d72-9002-4e5b-9660-2da891ee48bb]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-97e4d6b2-33f5-4a70-9660-94ded62e0de2 tempest-VolumesTransfersV357Test-1371605380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ff3aa6da-05d0-4413-98f9-dac48f434182 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:12 devstack sudo[100657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ff3aa6da-05d0-4413-98f9-dac48f434182 Sep 28 15:03:12 devstack sudo[100657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:12 devstack sudo[100657]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-97e4d6b2-33f5-4a70-9660-94ded62e0de2 tempest-VolumesTransfersV357Test-1371605380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ff3aa6da-05d0-4413-98f9-dac48f434182" returned: 0 in 0.475s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-97e4d6b2-33f5-4a70-9660-94ded62e0de2 tempest-VolumesTransfersV357Test-1371605380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ff3aa6da-05d0-4413-98f9-dac48f434182 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:12 devstack sudo[100662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ff3aa6da-05d0-4413-98f9-dac48f434182 Sep 28 15:03:12 devstack sudo[100662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:12 devstack sudo[100662]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-97e4d6b2-33f5-4a70-9660-94ded62e0de2 tempest-VolumesTransfersV357Test-1371605380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ff3aa6da-05d0-4413-98f9-dac48f434182" returned: 0 in 0.362s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:12 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-97e4d6b2-33f5-4a70-9660-94ded62e0de2 tempest-VolumesTransfersV357Test-1371605380 None] Lock "cinder-quobyte-ff3aa6da-05d0-4413-98f9-dac48f434182" released by "delete_volume" :: held 0.901s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:12 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-97e4d6b2-33f5-4a70-9660-94ded62e0de2 tempest-VolumesTransfersV357Test-1371605380 None] Created reservations ['34dcec32-e6ef-4b93-8245-7fdae3746f82', '350b5fa4-5a9b-46cb-8e6a-a9413d08021d', '5fff1deb-ddfd-4352-aa5c-1ea29b8b808a', 'e1f921f0-b929-4696-8747-a03fd3c7a35b'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:03:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-97e4d6b2-33f5-4a70-9660-94ded62e0de2 tempest-VolumesTransfersV357Test-1371605380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-97e4d6b2-33f5-4a70-9660-94ded62e0de2 tempest-VolumesTransfersV357Test-1371605380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:13 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-97e4d6b2-33f5-4a70-9660-94ded62e0de2 tempest-VolumesTransfersV357Test-1371605380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:03:13 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-97e4d6b2-33f5-4a70-9660-94ded62e0de2 tempest-VolumesTransfersV357Test-1371605380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:03:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-97e4d6b2-33f5-4a70-9660-94ded62e0de2 tempest-VolumesTransfersV357Test-1371605380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-97e4d6b2-33f5-4a70-9660-94ded62e0de2 tempest-VolumesTransfersV357Test-1371605380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:13 devstack sudo[100665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:03:13 devstack sudo[100665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:13 devstack sudo[100665]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-97e4d6b2-33f5-4a70-9660-94ded62e0de2 tempest-VolumesTransfersV357Test-1371605380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.492s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:13 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-97e4d6b2-33f5-4a70-9660-94ded62e0de2 tempest-VolumesTransfersV357Test-1371605380 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:03:13 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-97e4d6b2-33f5-4a70-9660-94ded62e0de2 tempest-VolumesTransfersV357Test-1371605380 None] Deleted volume successfully. Sep 28 15:03:13 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-97e4d6b2-33f5-4a70-9660-94ded62e0de2 tempest-VolumesTransfersV357Test-1371605380 None] Lock "cinder-ff3aa6da-05d0-4413-98f9-dac48f434182-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:14 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d79026b-09c0-4d91-8cee-d3ddc5315936 tempest-VolumesTestJSON-1834510752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:03:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2d79026b-09c0-4d91-8cee-d3ddc5315936 tempest-VolumesTestJSON-1834510752 None] Flow 'volume_create_manager' (29eb6077-6cb4-438d-8718-c4ed5ce48d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2d79026b-09c0-4d91-8cee-d3ddc5315936 tempest-VolumesTestJSON-1834510752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (848aa6e0-5fea-4494-acce-befd8331df17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2d79026b-09c0-4d91-8cee-d3ddc5315936 tempest-VolumesTestJSON-1834510752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (848aa6e0-5fea-4494-acce-befd8331df17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1472015686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f401933f-765b-40bf-9d20-74844a99a2cf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5bcfaaa8bc934b519e82ffdc6287027a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:14Z,use_quota=True,user_id='65398da98a90428fb426f494ff68535e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2d79026b-09c0-4d91-8cee-d3ddc5315936 tempest-VolumesTestJSON-1834510752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f333a82-3803-4d06-8881-dc1fd74ff1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2d79026b-09c0-4d91-8cee-d3ddc5315936 tempest-VolumesTestJSON-1834510752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f333a82-3803-4d06-8881-dc1fd74ff1d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2d79026b-09c0-4d91-8cee-d3ddc5315936 tempest-VolumesTestJSON-1834510752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d3b3147-3e14-4c03-bace-c4303dd7a7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2d79026b-09c0-4d91-8cee-d3ddc5315936 tempest-VolumesTestJSON-1834510752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d3b3147-3e14-4c03-bace-c4303dd7a7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f401933f-765b-40bf-9d20-74844a99a2cf', 'volume_name': 'volume-f401933f-765b-40bf-9d20-74844a99a2cf', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2d79026b-09c0-4d91-8cee-d3ddc5315936 tempest-VolumesTestJSON-1834510752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2430d51-3e99-44aa-b93d-dd3c790aec55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2d79026b-09c0-4d91-8cee-d3ddc5315936 tempest-VolumesTestJSON-1834510752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2430d51-3e99-44aa-b93d-dd3c790aec55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2d79026b-09c0-4d91-8cee-d3ddc5315936 tempest-VolumesTestJSON-1834510752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fb18047-76dd-4661-a259-99fc7a487082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:14 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-2d79026b-09c0-4d91-8cee-d3ddc5315936 tempest-VolumesTestJSON-1834510752 None] Volume f401933f-765b-40bf-9d20-74844a99a2cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f401933f-765b-40bf-9d20-74844a99a2cf', 'volume_size': 1} Sep 28 15:03:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2d79026b-09c0-4d91-8cee-d3ddc5315936 tempest-VolumesTestJSON-1834510752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2d79026b-09c0-4d91-8cee-d3ddc5315936 tempest-VolumesTestJSON-1834510752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:14 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2d79026b-09c0-4d91-8cee-d3ddc5315936 tempest-VolumesTestJSON-1834510752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1472015686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f401933f-765b-40bf-9d20-74844a99a2cf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5bcfaaa8bc934b519e82ffdc6287027a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:14Z,use_quota=True,user_id='65398da98a90428fb426f494ff68535e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:03:14 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-2d79026b-09c0-4d91-8cee-d3ddc5315936 tempest-VolumesTestJSON-1834510752 None] Creating volume f401933f-765b-40bf-9d20-74844a99a2cf {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:03:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2d79026b-09c0-4d91-8cee-d3ddc5315936 tempest-VolumesTestJSON-1834510752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2d79026b-09c0-4d91-8cee-d3ddc5315936 tempest-VolumesTestJSON-1834510752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:14 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2d79026b-09c0-4d91-8cee-d3ddc5315936 tempest-VolumesTestJSON-1834510752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:03:14 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2d79026b-09c0-4d91-8cee-d3ddc5315936 tempest-VolumesTestJSON-1834510752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:03:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2d79026b-09c0-4d91-8cee-d3ddc5315936 tempest-VolumesTestJSON-1834510752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:14 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2d79026b-09c0-4d91-8cee-d3ddc5315936 tempest-VolumesTestJSON-1834510752 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:03:14 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-2d79026b-09c0-4d91-8cee-d3ddc5315936 tempest-VolumesTestJSON-1834510752 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:03:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2d79026b-09c0-4d91-8cee-d3ddc5315936 tempest-VolumesTestJSON-1834510752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f401933f-765b-40bf-9d20-74844a99a2cf 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:14 devstack sudo[100668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f401933f-765b-40bf-9d20-74844a99a2cf 1073741824 Sep 28 15:03:14 devstack sudo[100668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:14 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9a09311-2638-4374-82dd-e42df0402d97 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:03:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d9a09311-2638-4374-82dd-e42df0402d97 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Flow 'volume_create_manager' (75316b3a-19ff-4426-a23e-087a2fb97790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d9a09311-2638-4374-82dd-e42df0402d97 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75cb776f-1d71-4983-ba13-f682cc4d001c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d9a09311-2638-4374-82dd-e42df0402d97 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75cb776f-1d71-4983-ba13-f682cc4d001c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1263063117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e78dca69f994ab68085e3ce4ebfb87a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:14Z,use_quota=True,user_id='e5f2ea6f136e4075a95d62a6f27e473f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d9a09311-2638-4374-82dd-e42df0402d97 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9ba9b17-ef31-4048-a884-7be9dbe3f478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d9a09311-2638-4374-82dd-e42df0402d97 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9ba9b17-ef31-4048-a884-7be9dbe3f478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d9a09311-2638-4374-82dd-e42df0402d97 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41b408b3-8263-47fc-86d0-a7c1ccc384be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d9a09311-2638-4374-82dd-e42df0402d97 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41b408b3-8263-47fc-86d0-a7c1ccc384be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d', 'volume_name': 'volume-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d', 'volume_size': 2}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d9a09311-2638-4374-82dd-e42df0402d97 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ed156ae-c317-4020-b1e2-fe466931f20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d9a09311-2638-4374-82dd-e42df0402d97 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ed156ae-c317-4020-b1e2-fe466931f20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d9a09311-2638-4374-82dd-e42df0402d97 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1daf98d6-5e82-4e2f-a73b-1e4db6cb3bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:14 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-d9a09311-2638-4374-82dd-e42df0402d97 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Volume bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d', 'volume_size': 2} Sep 28 15:03:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d9a09311-2638-4374-82dd-e42df0402d97 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:15 devstack sudo[100668]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2d79026b-09c0-4d91-8cee-d3ddc5315936 tempest-VolumesTestJSON-1834510752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f401933f-765b-40bf-9d20-74844a99a2cf 1073741824" returned: 0 in 0.753s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2d79026b-09c0-4d91-8cee-d3ddc5315936 tempest-VolumesTestJSON-1834510752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f401933f-765b-40bf-9d20-74844a99a2cf {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:15 devstack sudo[100674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f401933f-765b-40bf-9d20-74844a99a2cf Sep 28 15:03:15 devstack sudo[100674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:15 devstack sudo[100674]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2d79026b-09c0-4d91-8cee-d3ddc5315936 tempest-VolumesTestJSON-1834510752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f401933f-765b-40bf-9d20-74844a99a2cf" returned: 0 in 0.313s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2d79026b-09c0-4d91-8cee-d3ddc5315936 tempest-VolumesTestJSON-1834510752 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:03:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2d79026b-09c0-4d91-8cee-d3ddc5315936 tempest-VolumesTestJSON-1834510752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d9a09311-2638-4374-82dd-e42df0402d97 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.950s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d9a09311-2638-4374-82dd-e42df0402d97 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1263063117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e78dca69f994ab68085e3ce4ebfb87a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:14Z,use_quota=True,user_id='e5f2ea6f136e4075a95d62a6f27e473f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:03:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-d9a09311-2638-4374-82dd-e42df0402d97 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Creating volume bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:03:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d9a09311-2638-4374-82dd-e42df0402d97 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d9a09311-2638-4374-82dd-e42df0402d97 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d9a09311-2638-4374-82dd-e42df0402d97 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:03:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d9a09311-2638-4374-82dd-e42df0402d97 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:03:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d9a09311-2638-4374-82dd-e42df0402d97 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d9a09311-2638-4374-82dd-e42df0402d97 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:03:15 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-d9a09311-2638-4374-82dd-e42df0402d97 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:03:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d9a09311-2638-4374-82dd-e42df0402d97 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d 2147483648 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2d79026b-09c0-4d91-8cee-d3ddc5315936 tempest-VolumesTestJSON-1834510752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fb18047-76dd-4661-a259-99fc7a487082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f401933f-765b-40bf-9d20-74844a99a2cf', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2d79026b-09c0-4d91-8cee-d3ddc5315936 tempest-VolumesTestJSON-1834510752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (069d78f5-9398-4cf3-b470-cf998ff964cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:15 devstack sudo[100677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d 2147483648 Sep 28 15:03:15 devstack sudo[100677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:15 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-2d79026b-09c0-4d91-8cee-d3ddc5315936 tempest-VolumesTestJSON-1834510752 None] Volume volume-f401933f-765b-40bf-9d20-74844a99a2cf (f401933f-765b-40bf-9d20-74844a99a2cf): created successfully Sep 28 15:03:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2d79026b-09c0-4d91-8cee-d3ddc5315936 tempest-VolumesTestJSON-1834510752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (069d78f5-9398-4cf3-b470-cf998ff964cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2d79026b-09c0-4d91-8cee-d3ddc5315936 tempest-VolumesTestJSON-1834510752 None] Flow 'volume_create_manager' (29eb6077-6cb4-438d-8718-c4ed5ce48d66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:15 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-2d79026b-09c0-4d91-8cee-d3ddc5315936 tempest-VolumesTestJSON-1834510752 None] Created volume successfully. Sep 28 15:03:16 devstack sudo[100677]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d9a09311-2638-4374-82dd-e42df0402d97 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d 2147483648" returned: 0 in 0.965s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d9a09311-2638-4374-82dd-e42df0402d97 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:16 devstack sudo[100683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d Sep 28 15:03:16 devstack sudo[100683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:16 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:03:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:16 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:03:16 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:03:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:17 devstack sudo[100686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:03:17 devstack sudo[100686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:17 devstack sudo[100683]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d9a09311-2638-4374-82dd-e42df0402d97 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d" returned: 0 in 0.570s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d9a09311-2638-4374-82dd-e42df0402d97 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] <== create_volume: return (1609ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:03:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d9a09311-2638-4374-82dd-e42df0402d97 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.614s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d9a09311-2638-4374-82dd-e42df0402d97 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1daf98d6-5e82-4e2f-a73b-1e4db6cb3bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d', 'volume_size': 2}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d9a09311-2638-4374-82dd-e42df0402d97 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad54f9b7-78e7-4d39-b4fc-83a97343b54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:17 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-37ebd66c-4e04-48f7-9753-dfaeac1c20aa tempest-VolumesTestJSON-1834510752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:03:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-37ebd66c-4e04-48f7-9753-dfaeac1c20aa tempest-VolumesTestJSON-1834510752 None] Flow 'volume_create_manager' (02b01a41-88be-4479-942f-3c2996686a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-37ebd66c-4e04-48f7-9753-dfaeac1c20aa tempest-VolumesTestJSON-1834510752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e75a8645-1a28-4fdf-a85b-163d8222e21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:17 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-d9a09311-2638-4374-82dd-e42df0402d97 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Volume volume-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d (bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d): created successfully Sep 28 15:03:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d9a09311-2638-4374-82dd-e42df0402d97 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad54f9b7-78e7-4d39-b4fc-83a97343b54a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d9a09311-2638-4374-82dd-e42df0402d97 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Flow 'volume_create_manager' (75316b3a-19ff-4426-a23e-087a2fb97790) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-37ebd66c-4e04-48f7-9753-dfaeac1c20aa tempest-VolumesTestJSON-1834510752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e75a8645-1a28-4fdf-a85b-163d8222e21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-345708741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=096e5137-3c93-42c5-9d6b-04af9c4a00f0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5bcfaaa8bc934b519e82ffdc6287027a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:17Z,use_quota=True,user_id='65398da98a90428fb426f494ff68535e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-37ebd66c-4e04-48f7-9753-dfaeac1c20aa tempest-VolumesTestJSON-1834510752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f0c7701-db3e-46e6-8f71-e82ecc1aa497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-37ebd66c-4e04-48f7-9753-dfaeac1c20aa tempest-VolumesTestJSON-1834510752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f0c7701-db3e-46e6-8f71-e82ecc1aa497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-37ebd66c-4e04-48f7-9753-dfaeac1c20aa tempest-VolumesTestJSON-1834510752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e765cfc3-bade-4b99-adc2-b38061b7dcd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-37ebd66c-4e04-48f7-9753-dfaeac1c20aa tempest-VolumesTestJSON-1834510752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e765cfc3-bade-4b99-adc2-b38061b7dcd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '096e5137-3c93-42c5-9d6b-04af9c4a00f0', 'volume_name': 'volume-096e5137-3c93-42c5-9d6b-04af9c4a00f0', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-37ebd66c-4e04-48f7-9753-dfaeac1c20aa tempest-VolumesTestJSON-1834510752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e41763d-7186-4174-907c-6a2fb5bee901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-37ebd66c-4e04-48f7-9753-dfaeac1c20aa tempest-VolumesTestJSON-1834510752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e41763d-7186-4174-907c-6a2fb5bee901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-37ebd66c-4e04-48f7-9753-dfaeac1c20aa tempest-VolumesTestJSON-1834510752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (949e3d60-ce17-4d14-8a1b-da33978be35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:17 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-37ebd66c-4e04-48f7-9753-dfaeac1c20aa tempest-VolumesTestJSON-1834510752 None] Volume 096e5137-3c93-42c5-9d6b-04af9c4a00f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-096e5137-3c93-42c5-9d6b-04af9c4a00f0', 'volume_size': 1} Sep 28 15:03:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-37ebd66c-4e04-48f7-9753-dfaeac1c20aa tempest-VolumesTestJSON-1834510752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-37ebd66c-4e04-48f7-9753-dfaeac1c20aa tempest-VolumesTestJSON-1834510752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-37ebd66c-4e04-48f7-9753-dfaeac1c20aa tempest-VolumesTestJSON-1834510752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-345708741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=096e5137-3c93-42c5-9d6b-04af9c4a00f0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5bcfaaa8bc934b519e82ffdc6287027a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:17Z,use_quota=True,user_id='65398da98a90428fb426f494ff68535e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:03:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-37ebd66c-4e04-48f7-9753-dfaeac1c20aa tempest-VolumesTestJSON-1834510752 None] Creating volume 096e5137-3c93-42c5-9d6b-04af9c4a00f0 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:03:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-37ebd66c-4e04-48f7-9753-dfaeac1c20aa tempest-VolumesTestJSON-1834510752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-37ebd66c-4e04-48f7-9753-dfaeac1c20aa tempest-VolumesTestJSON-1834510752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-37ebd66c-4e04-48f7-9753-dfaeac1c20aa tempest-VolumesTestJSON-1834510752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:03:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-37ebd66c-4e04-48f7-9753-dfaeac1c20aa tempest-VolumesTestJSON-1834510752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:03:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-37ebd66c-4e04-48f7-9753-dfaeac1c20aa tempest-VolumesTestJSON-1834510752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-37ebd66c-4e04-48f7-9753-dfaeac1c20aa tempest-VolumesTestJSON-1834510752 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:03:17 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-37ebd66c-4e04-48f7-9753-dfaeac1c20aa tempest-VolumesTestJSON-1834510752 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:03:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-37ebd66c-4e04-48f7-9753-dfaeac1c20aa tempest-VolumesTestJSON-1834510752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-096e5137-3c93-42c5-9d6b-04af9c4a00f0 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:17 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-d9a09311-2638-4374-82dd-e42df0402d97 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Created volume successfully. Sep 28 15:03:17 devstack sudo[100689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-096e5137-3c93-42c5-9d6b-04af9c4a00f0 1073741824 Sep 28 15:03:17 devstack sudo[100689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:17 devstack sudo[100686]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.489s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:17 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:03:17 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running periodic task VolumeManager._thread_info {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:03:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] thread count: 28 {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:03:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] thread info: [<_MainThread(MainThread, started 135146735652992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:03:18 devstack sudo[100689]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-37ebd66c-4e04-48f7-9753-dfaeac1c20aa tempest-VolumesTestJSON-1834510752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-096e5137-3c93-42c5-9d6b-04af9c4a00f0 1073741824" returned: 0 in 0.681s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-37ebd66c-4e04-48f7-9753-dfaeac1c20aa tempest-VolumesTestJSON-1834510752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-096e5137-3c93-42c5-9d6b-04af9c4a00f0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:18 devstack sudo[100696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-096e5137-3c93-42c5-9d6b-04af9c4a00f0 Sep 28 15:03:18 devstack sudo[100696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:18 devstack sudo[100696]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-37ebd66c-4e04-48f7-9753-dfaeac1c20aa tempest-VolumesTestJSON-1834510752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-096e5137-3c93-42c5-9d6b-04af9c4a00f0" returned: 0 in 0.374s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-37ebd66c-4e04-48f7-9753-dfaeac1c20aa tempest-VolumesTestJSON-1834510752 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:03:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-37ebd66c-4e04-48f7-9753-dfaeac1c20aa tempest-VolumesTestJSON-1834510752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-37ebd66c-4e04-48f7-9753-dfaeac1c20aa tempest-VolumesTestJSON-1834510752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (949e3d60-ce17-4d14-8a1b-da33978be35f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-096e5137-3c93-42c5-9d6b-04af9c4a00f0', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-37ebd66c-4e04-48f7-9753-dfaeac1c20aa tempest-VolumesTestJSON-1834510752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da765e83-6d54-490e-ba06-3cd28300c554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:18 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-37ebd66c-4e04-48f7-9753-dfaeac1c20aa tempest-VolumesTestJSON-1834510752 None] Volume volume-096e5137-3c93-42c5-9d6b-04af9c4a00f0 (096e5137-3c93-42c5-9d6b-04af9c4a00f0): created successfully Sep 28 15:03:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-37ebd66c-4e04-48f7-9753-dfaeac1c20aa tempest-VolumesTestJSON-1834510752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da765e83-6d54-490e-ba06-3cd28300c554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-37ebd66c-4e04-48f7-9753-dfaeac1c20aa tempest-VolumesTestJSON-1834510752 None] Flow 'volume_create_manager' (02b01a41-88be-4479-942f-3c2996686a40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:18 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-37ebd66c-4e04-48f7-9753-dfaeac1c20aa tempest-VolumesTestJSON-1834510752 None] Created volume successfully. Sep 28 15:03:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-75eec009-3976-40d3-a970-549e5f461a14 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-75eec009-3976-40d3-a970-549e5f461a14 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-75eec009-3976-40d3-a970-549e5f461a14 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Creating offline snapshot 010eeef1-2e6f-45a7-9ee8-9456714a2634 of volume bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:03:18 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e78391-000e-40a1-8ad7-877646a49226]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-75eec009-3976-40d3-a970-549e5f461a14 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:18 devstack sudo[100699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d Sep 28 15:03:19 devstack sudo[100699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:19 devstack sudo[100699]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-75eec009-3976-40d3-a970-549e5f461a14 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d" returned: 0 in 0.581s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-75eec009-3976-40d3-a970-549e5f461a14 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d.010eeef1-2e6f-45a7-9ee8-9456714a2634 2G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:19 devstack sudo[100704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d.010eeef1-2e6f-45a7-9ee8-9456714a2634 2G Sep 28 15:03:19 devstack sudo[100704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:20 devstack sudo[100704]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-75eec009-3976-40d3-a970-549e5f461a14 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d.010eeef1-2e6f-45a7-9ee8-9456714a2634 2G" returned: 0 in 0.838s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-75eec009-3976-40d3-a970-549e5f461a14 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d.010eeef1-2e6f-45a7-9ee8-9456714a2634 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:20 devstack sudo[100710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d.010eeef1-2e6f-45a7-9ee8-9456714a2634 Sep 28 15:03:20 devstack sudo[100710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:20 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-94296115-7a52-4b1d-853d-4e2309242ff6 tempest-VolumesTestJSON-1834510752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:03:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-94296115-7a52-4b1d-853d-4e2309242ff6 tempest-VolumesTestJSON-1834510752 None] Flow 'volume_create_manager' (042a41fd-a60b-45e4-81be-7ba9ca27c619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-94296115-7a52-4b1d-853d-4e2309242ff6 tempest-VolumesTestJSON-1834510752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b75e89a-e46c-45c2-8f83-9ff302dbacb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-94296115-7a52-4b1d-853d-4e2309242ff6 tempest-VolumesTestJSON-1834510752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b75e89a-e46c-45c2-8f83-9ff302dbacb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1525081962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=711693c1-8be7-4000-b663-870b77ac5a97,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5bcfaaa8bc934b519e82ffdc6287027a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:20Z,use_quota=True,user_id='65398da98a90428fb426f494ff68535e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-94296115-7a52-4b1d-853d-4e2309242ff6 tempest-VolumesTestJSON-1834510752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36aa73ac-e8d9-4d94-b76c-95279b7349bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-94296115-7a52-4b1d-853d-4e2309242ff6 tempest-VolumesTestJSON-1834510752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36aa73ac-e8d9-4d94-b76c-95279b7349bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-94296115-7a52-4b1d-853d-4e2309242ff6 tempest-VolumesTestJSON-1834510752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87b657e4-e6ee-42ac-8661-d6d010663d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-94296115-7a52-4b1d-853d-4e2309242ff6 tempest-VolumesTestJSON-1834510752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87b657e4-e6ee-42ac-8661-d6d010663d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '711693c1-8be7-4000-b663-870b77ac5a97', 'volume_name': 'volume-711693c1-8be7-4000-b663-870b77ac5a97', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-94296115-7a52-4b1d-853d-4e2309242ff6 tempest-VolumesTestJSON-1834510752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d120628-5548-4f73-9bbe-f7a4993ce7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-94296115-7a52-4b1d-853d-4e2309242ff6 tempest-VolumesTestJSON-1834510752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d120628-5548-4f73-9bbe-f7a4993ce7c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-94296115-7a52-4b1d-853d-4e2309242ff6 tempest-VolumesTestJSON-1834510752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2934a576-0820-4632-92b4-1473fb8e5402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:20 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-94296115-7a52-4b1d-853d-4e2309242ff6 tempest-VolumesTestJSON-1834510752 None] Volume 711693c1-8be7-4000-b663-870b77ac5a97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-711693c1-8be7-4000-b663-870b77ac5a97', 'volume_size': 1} Sep 28 15:03:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-94296115-7a52-4b1d-853d-4e2309242ff6 tempest-VolumesTestJSON-1834510752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:20 devstack sudo[100710]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-75eec009-3976-40d3-a970-549e5f461a14 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d.010eeef1-2e6f-45a7-9ee8-9456714a2634" returned: 0 in 0.466s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:20 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-75eec009-3976-40d3-a970-549e5f461a14 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d.010eeef1-2e6f-45a7-9ee8-9456714a2634 is being set with open permissions: ugo+rw Sep 28 15:03:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-75eec009-3976-40d3-a970-549e5f461a14 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d.010eeef1-2e6f-45a7-9ee8-9456714a2634 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:20 devstack sudo[100717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d.010eeef1-2e6f-45a7-9ee8-9456714a2634 Sep 28 15:03:20 devstack sudo[100717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:21 devstack sudo[100717]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-75eec009-3976-40d3-a970-549e5f461a14 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d.010eeef1-2e6f-45a7-9ee8-9456714a2634" returned: 0 in 0.371s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-75eec009-3976-40d3-a970-549e5f461a14 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:21 devstack sudo[100720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d.info Sep 28 15:03:21 devstack sudo[100720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:21 devstack sudo[100720]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-75eec009-3976-40d3-a970-549e5f461a14 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d.info" returned: 0 in 0.471s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:21 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-75eec009-3976-40d3-a970-549e5f461a14 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d.info is being set with open permissions: ugo+rw Sep 28 15:03:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-75eec009-3976-40d3-a970-549e5f461a14 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:21 devstack sudo[100723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d.info Sep 28 15:03:21 devstack sudo[100723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:21 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-40ba780c-2ce2-493d-bdbe-2303cd2fd48f tempest-VolumesListTestJSON-1183749680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:03:21 devstack sudo[100723]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:21 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-40ba780c-2ce2-493d-bdbe-2303cd2fd48f tempest-VolumesListTestJSON-1183749680 None] Flow 'volume_create_manager' (443a7640-8331-45e8-8621-7af43455d9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:21 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-40ba780c-2ce2-493d-bdbe-2303cd2fd48f tempest-VolumesListTestJSON-1183749680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baa50b22-5f65-4d5f-98d7-16ddeeb93ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-75eec009-3976-40d3-a970-549e5f461a14 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d.info" returned: 0 in 0.353s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-75eec009-3976-40d3-a970-549e5f461a14 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.240s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-94296115-7a52-4b1d-853d-4e2309242ff6 tempest-VolumesTestJSON-1834510752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.509s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:22 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-94296115-7a52-4b1d-853d-4e2309242ff6 tempest-VolumesTestJSON-1834510752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1525081962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=711693c1-8be7-4000-b663-870b77ac5a97,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5bcfaaa8bc934b519e82ffdc6287027a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:20Z,use_quota=True,user_id='65398da98a90428fb426f494ff68535e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:03:22 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-94296115-7a52-4b1d-853d-4e2309242ff6 tempest-VolumesTestJSON-1834510752 None] Creating volume 711693c1-8be7-4000-b663-870b77ac5a97 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:03:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-94296115-7a52-4b1d-853d-4e2309242ff6 tempest-VolumesTestJSON-1834510752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-94296115-7a52-4b1d-853d-4e2309242ff6 tempest-VolumesTestJSON-1834510752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:22 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-94296115-7a52-4b1d-853d-4e2309242ff6 tempest-VolumesTestJSON-1834510752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:03:22 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-94296115-7a52-4b1d-853d-4e2309242ff6 tempest-VolumesTestJSON-1834510752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:03:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-94296115-7a52-4b1d-853d-4e2309242ff6 tempest-VolumesTestJSON-1834510752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:22 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-94296115-7a52-4b1d-853d-4e2309242ff6 tempest-VolumesTestJSON-1834510752 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:03:22 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-94296115-7a52-4b1d-853d-4e2309242ff6 tempest-VolumesTestJSON-1834510752 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:03:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-94296115-7a52-4b1d-853d-4e2309242ff6 tempest-VolumesTestJSON-1834510752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-711693c1-8be7-4000-b663-870b77ac5a97 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-40ba780c-2ce2-493d-bdbe-2303cd2fd48f tempest-VolumesListTestJSON-1183749680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baa50b22-5f65-4d5f-98d7-16ddeeb93ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-63341799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5790a342-b9ef-4399-802e-cff1160db060,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0a033d8d2de14832a4b942be6805c65d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:22Z,use_quota=True,user_id='530fce79903c42d8a5a88bc2c0913885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:22 devstack sudo[100726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-711693c1-8be7-4000-b663-870b77ac5a97 1073741824 Sep 28 15:03:22 devstack sudo[100726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-40ba780c-2ce2-493d-bdbe-2303cd2fd48f tempest-VolumesListTestJSON-1183749680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e56aabf-aa7a-461a-8f20-03eecebedcd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-40ba780c-2ce2-493d-bdbe-2303cd2fd48f tempest-VolumesListTestJSON-1183749680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e56aabf-aa7a-461a-8f20-03eecebedcd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-40ba780c-2ce2-493d-bdbe-2303cd2fd48f tempest-VolumesListTestJSON-1183749680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca671232-921b-4959-b2a6-c8d076206dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-40ba780c-2ce2-493d-bdbe-2303cd2fd48f tempest-VolumesListTestJSON-1183749680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca671232-921b-4959-b2a6-c8d076206dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5790a342-b9ef-4399-802e-cff1160db060', 'volume_name': 'volume-5790a342-b9ef-4399-802e-cff1160db060', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-40ba780c-2ce2-493d-bdbe-2303cd2fd48f tempest-VolumesListTestJSON-1183749680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e106c09c-c6dd-41e9-ba2e-c4cb9cc833f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-40ba780c-2ce2-493d-bdbe-2303cd2fd48f tempest-VolumesListTestJSON-1183749680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e106c09c-c6dd-41e9-ba2e-c4cb9cc833f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-40ba780c-2ce2-493d-bdbe-2303cd2fd48f tempest-VolumesListTestJSON-1183749680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47ba4187-ddd9-4da1-9c28-b358daf10645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:22 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-40ba780c-2ce2-493d-bdbe-2303cd2fd48f tempest-VolumesListTestJSON-1183749680 None] Volume 5790a342-b9ef-4399-802e-cff1160db060: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5790a342-b9ef-4399-802e-cff1160db060', 'volume_size': 1} Sep 28 15:03:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-40ba780c-2ce2-493d-bdbe-2303cd2fd48f tempest-VolumesListTestJSON-1183749680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:22 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-75eec009-3976-40d3-a970-549e5f461a14 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Create snapshot completed successfully Sep 28 15:03:22 devstack sudo[100726]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-94296115-7a52-4b1d-853d-4e2309242ff6 tempest-VolumesTestJSON-1834510752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-711693c1-8be7-4000-b663-870b77ac5a97 1073741824" returned: 0 in 0.608s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-94296115-7a52-4b1d-853d-4e2309242ff6 tempest-VolumesTestJSON-1834510752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-711693c1-8be7-4000-b663-870b77ac5a97 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:22 devstack sudo[100732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-711693c1-8be7-4000-b663-870b77ac5a97 Sep 28 15:03:22 devstack sudo[100732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:22 devstack sudo[100732]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-94296115-7a52-4b1d-853d-4e2309242ff6 tempest-VolumesTestJSON-1834510752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-711693c1-8be7-4000-b663-870b77ac5a97" returned: 0 in 0.289s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:22 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-94296115-7a52-4b1d-853d-4e2309242ff6 tempest-VolumesTestJSON-1834510752 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:03:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-94296115-7a52-4b1d-853d-4e2309242ff6 tempest-VolumesTestJSON-1834510752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-40ba780c-2ce2-493d-bdbe-2303cd2fd48f tempest-VolumesListTestJSON-1183749680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.861s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:22 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-40ba780c-2ce2-493d-bdbe-2303cd2fd48f tempest-VolumesListTestJSON-1183749680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-63341799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5790a342-b9ef-4399-802e-cff1160db060,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0a033d8d2de14832a4b942be6805c65d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:22Z,use_quota=True,user_id='530fce79903c42d8a5a88bc2c0913885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:03:22 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-40ba780c-2ce2-493d-bdbe-2303cd2fd48f tempest-VolumesListTestJSON-1183749680 None] Creating volume 5790a342-b9ef-4399-802e-cff1160db060 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:03:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-40ba780c-2ce2-493d-bdbe-2303cd2fd48f tempest-VolumesListTestJSON-1183749680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-40ba780c-2ce2-493d-bdbe-2303cd2fd48f tempest-VolumesListTestJSON-1183749680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:22 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-40ba780c-2ce2-493d-bdbe-2303cd2fd48f tempest-VolumesListTestJSON-1183749680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:03:23 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-40ba780c-2ce2-493d-bdbe-2303cd2fd48f tempest-VolumesListTestJSON-1183749680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:03:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-40ba780c-2ce2-493d-bdbe-2303cd2fd48f tempest-VolumesListTestJSON-1183749680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:23 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-40ba780c-2ce2-493d-bdbe-2303cd2fd48f tempest-VolumesListTestJSON-1183749680 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:03:23 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-40ba780c-2ce2-493d-bdbe-2303cd2fd48f tempest-VolumesListTestJSON-1183749680 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:03:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-40ba780c-2ce2-493d-bdbe-2303cd2fd48f tempest-VolumesListTestJSON-1183749680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5790a342-b9ef-4399-802e-cff1160db060 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-94296115-7a52-4b1d-853d-4e2309242ff6 tempest-VolumesTestJSON-1834510752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2934a576-0820-4632-92b4-1473fb8e5402) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-711693c1-8be7-4000-b663-870b77ac5a97', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-94296115-7a52-4b1d-853d-4e2309242ff6 tempest-VolumesTestJSON-1834510752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a443e09-1f6d-44fe-9e12-31f5832e8fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:23 devstack sudo[100735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5790a342-b9ef-4399-802e-cff1160db060 1073741824 Sep 28 15:03:23 devstack sudo[100735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:23 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-94296115-7a52-4b1d-853d-4e2309242ff6 tempest-VolumesTestJSON-1834510752 None] Volume volume-711693c1-8be7-4000-b663-870b77ac5a97 (711693c1-8be7-4000-b663-870b77ac5a97): created successfully Sep 28 15:03:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-94296115-7a52-4b1d-853d-4e2309242ff6 tempest-VolumesTestJSON-1834510752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a443e09-1f6d-44fe-9e12-31f5832e8fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-94296115-7a52-4b1d-853d-4e2309242ff6 tempest-VolumesTestJSON-1834510752 None] Flow 'volume_create_manager' (042a41fd-a60b-45e4-81be-7ba9ca27c619) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:23 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-94296115-7a52-4b1d-853d-4e2309242ff6 tempest-VolumesTestJSON-1834510752 None] Created volume successfully. Sep 28 15:03:23 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8489c5d9-3933-4256-8464-8daf8ad9c266 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Acquiring lock "cinder-010eeef1-2e6f-45a7-9ee8-9456714a2634-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:23 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8489c5d9-3933-4256-8464-8daf8ad9c266 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Lock "cinder-010eeef1-2e6f-45a7-9ee8-9456714a2634-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:23 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8489c5d9-3933-4256-8464-8daf8ad9c266 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Acquiring lock "cinder-quobyte-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:23 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8489c5d9-3933-4256-8464-8daf8ad9c266 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Lock "cinder-quobyte-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:23 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8489c5d9-3933-4256-8464-8daf8ad9c266 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Acquiring lock "cinder-quobyte-010eeef1-2e6f-45a7-9ee8-9456714a2634" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:23 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8489c5d9-3933-4256-8464-8daf8ad9c266 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Lock "cinder-quobyte-010eeef1-2e6f-45a7-9ee8-9456714a2634" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:23 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-8489c5d9-3933-4256-8464-8daf8ad9c266 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Deleting offline snapshot 010eeef1-2e6f-45a7-9ee8-9456714a2634 of volume bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:03:23 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-8489c5d9-3933-4256-8464-8daf8ad9c266 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] snapshot_file for this snap is: volume-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d.010eeef1-2e6f-45a7-9ee8-9456714a2634 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:03:23 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ec0db8-abe9-41e4-9da7-f57883793eec]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8489c5d9-3933-4256-8464-8daf8ad9c266 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d.010eeef1-2e6f-45a7-9ee8-9456714a2634 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:23 devstack sudo[100737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d.010eeef1-2e6f-45a7-9ee8-9456714a2634 Sep 28 15:03:23 devstack sudo[100737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:23 devstack sudo[100735]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-40ba780c-2ce2-493d-bdbe-2303cd2fd48f tempest-VolumesListTestJSON-1183749680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5790a342-b9ef-4399-802e-cff1160db060 1073741824" returned: 0 in 0.781s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:23 devstack sudo[100737]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8489c5d9-3933-4256-8464-8daf8ad9c266 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d.010eeef1-2e6f-45a7-9ee8-9456714a2634" returned: 0 in 0.562s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:23 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-8489c5d9-3933-4256-8464-8daf8ad9c266 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:03:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-40ba780c-2ce2-493d-bdbe-2303cd2fd48f tempest-VolumesListTestJSON-1183749680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5790a342-b9ef-4399-802e-cff1160db060 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:23 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d5439b-aee0-41f9-93fb-5aa00933f649]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8489c5d9-3933-4256-8464-8daf8ad9c266 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:23 devstack sudo[100746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5790a342-b9ef-4399-802e-cff1160db060 Sep 28 15:03:23 devstack sudo[100746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:23 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-715e960d-5401-40e5-9fa9-bf91a848b648 tempest-VolumesSnapshotListTestJSON-297471525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:03:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-715e960d-5401-40e5-9fa9-bf91a848b648 tempest-VolumesSnapshotListTestJSON-297471525 None] Flow 'volume_create_manager' (3b271a5d-ea93-4d1f-b5c1-959fbd420cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-715e960d-5401-40e5-9fa9-bf91a848b648 tempest-VolumesSnapshotListTestJSON-297471525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8967dad-748d-42f9-8542-f37e664a70b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-715e960d-5401-40e5-9fa9-bf91a848b648 tempest-VolumesSnapshotListTestJSON-297471525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8967dad-748d-42f9-8542-f37e664a70b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-149980682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8955b18-37ec-4299-a9ec-27ce792a85e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbc2af02249e4038a097d428d386a863',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:24Z,use_quota=True,user_id='a443f77e85e94d038a75c4542ba7a721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-715e960d-5401-40e5-9fa9-bf91a848b648 tempest-VolumesSnapshotListTestJSON-297471525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52f9c3f6-bba2-4790-9fc9-ddee62e28d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:24 devstack sudo[100748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d Sep 28 15:03:24 devstack sudo[100748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-715e960d-5401-40e5-9fa9-bf91a848b648 tempest-VolumesSnapshotListTestJSON-297471525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52f9c3f6-bba2-4790-9fc9-ddee62e28d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-715e960d-5401-40e5-9fa9-bf91a848b648 tempest-VolumesSnapshotListTestJSON-297471525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a96ccdbe-2e89-43cd-962c-5b859b4a01af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-715e960d-5401-40e5-9fa9-bf91a848b648 tempest-VolumesSnapshotListTestJSON-297471525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a96ccdbe-2e89-43cd-962c-5b859b4a01af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8955b18-37ec-4299-a9ec-27ce792a85e5', 'volume_name': 'volume-f8955b18-37ec-4299-a9ec-27ce792a85e5', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-715e960d-5401-40e5-9fa9-bf91a848b648 tempest-VolumesSnapshotListTestJSON-297471525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23db28a1-aca4-472c-b78d-53932a2456ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-715e960d-5401-40e5-9fa9-bf91a848b648 tempest-VolumesSnapshotListTestJSON-297471525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23db28a1-aca4-472c-b78d-53932a2456ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-715e960d-5401-40e5-9fa9-bf91a848b648 tempest-VolumesSnapshotListTestJSON-297471525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53ac52b8-6b00-4bbf-b619-526e450cab3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:24 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-715e960d-5401-40e5-9fa9-bf91a848b648 tempest-VolumesSnapshotListTestJSON-297471525 None] Volume f8955b18-37ec-4299-a9ec-27ce792a85e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8955b18-37ec-4299-a9ec-27ce792a85e5', 'volume_size': 1} Sep 28 15:03:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-715e960d-5401-40e5-9fa9-bf91a848b648 tempest-VolumesSnapshotListTestJSON-297471525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:24 devstack sudo[100746]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-40ba780c-2ce2-493d-bdbe-2303cd2fd48f tempest-VolumesListTestJSON-1183749680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5790a342-b9ef-4399-802e-cff1160db060" returned: 0 in 0.308s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:24 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-40ba780c-2ce2-493d-bdbe-2303cd2fd48f tempest-VolumesListTestJSON-1183749680 None] <== create_volume: return (1210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:03:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-40ba780c-2ce2-493d-bdbe-2303cd2fd48f tempest-VolumesListTestJSON-1183749680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-715e960d-5401-40e5-9fa9-bf91a848b648 tempest-VolumesSnapshotListTestJSON-297471525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.089s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:24 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-715e960d-5401-40e5-9fa9-bf91a848b648 tempest-VolumesSnapshotListTestJSON-297471525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-149980682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8955b18-37ec-4299-a9ec-27ce792a85e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbc2af02249e4038a097d428d386a863',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:24Z,use_quota=True,user_id='a443f77e85e94d038a75c4542ba7a721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:03:24 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-715e960d-5401-40e5-9fa9-bf91a848b648 tempest-VolumesSnapshotListTestJSON-297471525 None] Creating volume f8955b18-37ec-4299-a9ec-27ce792a85e5 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:03:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-715e960d-5401-40e5-9fa9-bf91a848b648 tempest-VolumesSnapshotListTestJSON-297471525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-715e960d-5401-40e5-9fa9-bf91a848b648 tempest-VolumesSnapshotListTestJSON-297471525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:24 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-715e960d-5401-40e5-9fa9-bf91a848b648 tempest-VolumesSnapshotListTestJSON-297471525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:03:24 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-715e960d-5401-40e5-9fa9-bf91a848b648 tempest-VolumesSnapshotListTestJSON-297471525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:03:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-715e960d-5401-40e5-9fa9-bf91a848b648 tempest-VolumesSnapshotListTestJSON-297471525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:24 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-715e960d-5401-40e5-9fa9-bf91a848b648 tempest-VolumesSnapshotListTestJSON-297471525 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:03:24 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-715e960d-5401-40e5-9fa9-bf91a848b648 tempest-VolumesSnapshotListTestJSON-297471525 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:03:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-715e960d-5401-40e5-9fa9-bf91a848b648 tempest-VolumesSnapshotListTestJSON-297471525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-40ba780c-2ce2-493d-bdbe-2303cd2fd48f tempest-VolumesListTestJSON-1183749680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47ba4187-ddd9-4da1-9c28-b358daf10645) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5790a342-b9ef-4399-802e-cff1160db060', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-40ba780c-2ce2-493d-bdbe-2303cd2fd48f tempest-VolumesListTestJSON-1183749680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (065a7085-a950-4a02-b296-4b275867f3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:24 devstack sudo[100751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5 1073741824 Sep 28 15:03:24 devstack sudo[100751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:24 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-40ba780c-2ce2-493d-bdbe-2303cd2fd48f tempest-VolumesListTestJSON-1183749680 None] Volume volume-5790a342-b9ef-4399-802e-cff1160db060 (5790a342-b9ef-4399-802e-cff1160db060): created successfully Sep 28 15:03:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-40ba780c-2ce2-493d-bdbe-2303cd2fd48f tempest-VolumesListTestJSON-1183749680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (065a7085-a950-4a02-b296-4b275867f3b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-40ba780c-2ce2-493d-bdbe-2303cd2fd48f tempest-VolumesListTestJSON-1183749680 None] Flow 'volume_create_manager' (443a7640-8331-45e8-8621-7af43455d9be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:24 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-40ba780c-2ce2-493d-bdbe-2303cd2fd48f tempest-VolumesListTestJSON-1183749680 None] Created volume successfully. Sep 28 15:03:24 devstack sudo[100748]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8489c5d9-3933-4256-8464-8daf8ad9c266 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d" returned: 0 in 0.477s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8489c5d9-3933-4256-8464-8daf8ad9c266 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d.010eeef1-2e6f-45a7-9ee8-9456714a2634 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:24 devstack sudo[100756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d.010eeef1-2e6f-45a7-9ee8-9456714a2634 Sep 28 15:03:24 devstack sudo[100756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:24 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a420fc36-a6ab-483b-aa85-256cfbca8ec7 tempest-VolumesTestJSON-1834510752 None] Acquiring lock "cinder-711693c1-8be7-4000-b663-870b77ac5a97-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:24 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a420fc36-a6ab-483b-aa85-256cfbca8ec7 tempest-VolumesTestJSON-1834510752 None] Lock "cinder-711693c1-8be7-4000-b663-870b77ac5a97-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:24 devstack sudo[100756]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:24 devstack sudo[100751]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8489c5d9-3933-4256-8464-8daf8ad9c266 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d.010eeef1-2e6f-45a7-9ee8-9456714a2634" returned: 0 in 0.514s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:24 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a420fc36-a6ab-483b-aa85-256cfbca8ec7 tempest-VolumesTestJSON-1834510752 None] Acquiring lock "cinder-quobyte-711693c1-8be7-4000-b663-870b77ac5a97" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8489c5d9-3933-4256-8464-8daf8ad9c266 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d.010eeef1-2e6f-45a7-9ee8-9456714a2634 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-715e960d-5401-40e5-9fa9-bf91a848b648 tempest-VolumesSnapshotListTestJSON-297471525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5 1073741824" returned: 0 in 0.706s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:24 devstack sudo[100765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d.010eeef1-2e6f-45a7-9ee8-9456714a2634 Sep 28 15:03:24 devstack sudo[100765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:24 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a420fc36-a6ab-483b-aa85-256cfbca8ec7 tempest-VolumesTestJSON-1834510752 None] Lock "cinder-quobyte-711693c1-8be7-4000-b663-870b77ac5a97" acquired by "delete_volume" :: waited 0.050s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-715e960d-5401-40e5-9fa9-bf91a848b648 tempest-VolumesSnapshotListTestJSON-297471525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:25 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc469315-d276-424b-b44c-b0e2fc642c23]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a420fc36-a6ab-483b-aa85-256cfbca8ec7 tempest-VolumesTestJSON-1834510752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-711693c1-8be7-4000-b663-870b77ac5a97 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:25 devstack sudo[100767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5 Sep 28 15:03:25 devstack sudo[100767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:25 devstack sudo[100768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-711693c1-8be7-4000-b663-870b77ac5a97 Sep 28 15:03:25 devstack sudo[100768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:25 devstack sudo[100765]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8489c5d9-3933-4256-8464-8daf8ad9c266 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d.010eeef1-2e6f-45a7-9ee8-9456714a2634" returned: 0 in 0.352s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:25 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8489c5d9-3933-4256-8464-8daf8ad9c266 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Lock "cinder-quobyte-010eeef1-2e6f-45a7-9ee8-9456714a2634" released by "_delete_snapshot" :: held 2.117s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:25 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8489c5d9-3933-4256-8464-8daf8ad9c266 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Lock "cinder-quobyte-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d" released by "delete_snapshot" :: held 2.154s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:25 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-8489c5d9-3933-4256-8464-8daf8ad9c266 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Created reservations ['06383f32-3ab0-4b52-970f-fe90042bcece', 'eff9f077-4f20-494b-85da-3a3ce107f3b8', '96ecf0bc-b02d-471f-83b6-1cd8228fc242', '93da9d06-39e5-4a28-9cb7-8929bfe400d5'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:03:25 devstack sudo[100767]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-715e960d-5401-40e5-9fa9-bf91a848b648 tempest-VolumesSnapshotListTestJSON-297471525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5" returned: 0 in 0.524s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:25 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-715e960d-5401-40e5-9fa9-bf91a848b648 tempest-VolumesSnapshotListTestJSON-297471525 None] <== create_volume: return (1316ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:03:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-715e960d-5401-40e5-9fa9-bf91a848b648 tempest-VolumesSnapshotListTestJSON-297471525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.319s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-715e960d-5401-40e5-9fa9-bf91a848b648 tempest-VolumesSnapshotListTestJSON-297471525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53ac52b8-6b00-4bbf-b619-526e450cab3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8955b18-37ec-4299-a9ec-27ce792a85e5', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-715e960d-5401-40e5-9fa9-bf91a848b648 tempest-VolumesSnapshotListTestJSON-297471525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bc56620-41ef-44dc-8358-311c6754af09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:25 devstack sudo[100768]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a420fc36-a6ab-483b-aa85-256cfbca8ec7 tempest-VolumesTestJSON-1834510752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-711693c1-8be7-4000-b663-870b77ac5a97" returned: 0 in 0.609s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a420fc36-a6ab-483b-aa85-256cfbca8ec7 tempest-VolumesTestJSON-1834510752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-711693c1-8be7-4000-b663-870b77ac5a97 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:25 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-715e960d-5401-40e5-9fa9-bf91a848b648 tempest-VolumesSnapshotListTestJSON-297471525 None] Volume volume-f8955b18-37ec-4299-a9ec-27ce792a85e5 (f8955b18-37ec-4299-a9ec-27ce792a85e5): created successfully Sep 28 15:03:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-715e960d-5401-40e5-9fa9-bf91a848b648 tempest-VolumesSnapshotListTestJSON-297471525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bc56620-41ef-44dc-8358-311c6754af09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:25 devstack sudo[100777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-711693c1-8be7-4000-b663-870b77ac5a97 Sep 28 15:03:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-715e960d-5401-40e5-9fa9-bf91a848b648 tempest-VolumesSnapshotListTestJSON-297471525 None] Flow 'volume_create_manager' (3b271a5d-ea93-4d1f-b5c1-959fbd420cba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:25 devstack sudo[100777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:25 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-715e960d-5401-40e5-9fa9-bf91a848b648 tempest-VolumesSnapshotListTestJSON-297471525 None] Created volume successfully. Sep 28 15:03:25 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-8489c5d9-3933-4256-8464-8daf8ad9c266 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Delete snapshot completed successfully. Sep 28 15:03:25 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8489c5d9-3933-4256-8464-8daf8ad9c266 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Lock "cinder-010eeef1-2e6f-45a7-9ee8-9456714a2634-delete_snapshot" released by "delete_snapshot" :: held 2.523s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:25 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcdcb719-bba8-4702-8bbc-eb892f299a4e tempest-VolumesListTestJSON-1183749680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:03:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dcdcb719-bba8-4702-8bbc-eb892f299a4e tempest-VolumesListTestJSON-1183749680 None] Flow 'volume_create_manager' (c7b1d8a1-5e64-4ae2-943c-fac9dfdb0126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dcdcb719-bba8-4702-8bbc-eb892f299a4e tempest-VolumesListTestJSON-1183749680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7852af7f-d99e-4886-aff8-f0fa492b413c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dcdcb719-bba8-4702-8bbc-eb892f299a4e tempest-VolumesListTestJSON-1183749680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7852af7f-d99e-4886-aff8-f0fa492b413c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1137114507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04b82418-9cb4-4049-ac98-8510f80e4a47,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0a033d8d2de14832a4b942be6805c65d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:26Z,use_quota=True,user_id='530fce79903c42d8a5a88bc2c0913885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dcdcb719-bba8-4702-8bbc-eb892f299a4e tempest-VolumesListTestJSON-1183749680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fdfd11e-d88d-46d7-bce5-605d7ec18dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dcdcb719-bba8-4702-8bbc-eb892f299a4e tempest-VolumesListTestJSON-1183749680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fdfd11e-d88d-46d7-bce5-605d7ec18dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dcdcb719-bba8-4702-8bbc-eb892f299a4e tempest-VolumesListTestJSON-1183749680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0367d056-46ac-4a26-ac35-adc3ea543374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dcdcb719-bba8-4702-8bbc-eb892f299a4e tempest-VolumesListTestJSON-1183749680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0367d056-46ac-4a26-ac35-adc3ea543374) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04b82418-9cb4-4049-ac98-8510f80e4a47', 'volume_name': 'volume-04b82418-9cb4-4049-ac98-8510f80e4a47', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dcdcb719-bba8-4702-8bbc-eb892f299a4e tempest-VolumesListTestJSON-1183749680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a5ec8ad-c5f5-4ecd-9903-ab201865717f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dcdcb719-bba8-4702-8bbc-eb892f299a4e tempest-VolumesListTestJSON-1183749680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a5ec8ad-c5f5-4ecd-9903-ab201865717f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dcdcb719-bba8-4702-8bbc-eb892f299a4e tempest-VolumesListTestJSON-1183749680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c315c10-949b-4604-826d-7b1c1598188c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:25 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-dcdcb719-bba8-4702-8bbc-eb892f299a4e tempest-VolumesListTestJSON-1183749680 None] Volume 04b82418-9cb4-4049-ac98-8510f80e4a47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04b82418-9cb4-4049-ac98-8510f80e4a47', 'volume_size': 1} Sep 28 15:03:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dcdcb719-bba8-4702-8bbc-eb892f299a4e tempest-VolumesListTestJSON-1183749680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dcdcb719-bba8-4702-8bbc-eb892f299a4e tempest-VolumesListTestJSON-1183749680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:25 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-dcdcb719-bba8-4702-8bbc-eb892f299a4e tempest-VolumesListTestJSON-1183749680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1137114507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04b82418-9cb4-4049-ac98-8510f80e4a47,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0a033d8d2de14832a4b942be6805c65d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:26Z,use_quota=True,user_id='530fce79903c42d8a5a88bc2c0913885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:03:25 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-dcdcb719-bba8-4702-8bbc-eb892f299a4e tempest-VolumesListTestJSON-1183749680 None] Creating volume 04b82418-9cb4-4049-ac98-8510f80e4a47 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:03:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dcdcb719-bba8-4702-8bbc-eb892f299a4e tempest-VolumesListTestJSON-1183749680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dcdcb719-bba8-4702-8bbc-eb892f299a4e tempest-VolumesListTestJSON-1183749680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:25 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-dcdcb719-bba8-4702-8bbc-eb892f299a4e tempest-VolumesListTestJSON-1183749680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:03:25 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-dcdcb719-bba8-4702-8bbc-eb892f299a4e tempest-VolumesListTestJSON-1183749680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:03:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dcdcb719-bba8-4702-8bbc-eb892f299a4e tempest-VolumesListTestJSON-1183749680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:25 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-dcdcb719-bba8-4702-8bbc-eb892f299a4e tempest-VolumesListTestJSON-1183749680 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:03:25 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-dcdcb719-bba8-4702-8bbc-eb892f299a4e tempest-VolumesListTestJSON-1183749680 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:03:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dcdcb719-bba8-4702-8bbc-eb892f299a4e tempest-VolumesListTestJSON-1183749680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-04b82418-9cb4-4049-ac98-8510f80e4a47 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:25 devstack sudo[100779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-04b82418-9cb4-4049-ac98-8510f80e4a47 1073741824 Sep 28 15:03:25 devstack sudo[100779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:25 devstack sudo[100777]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a420fc36-a6ab-483b-aa85-256cfbca8ec7 tempest-VolumesTestJSON-1834510752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-711693c1-8be7-4000-b663-870b77ac5a97" returned: 0 in 0.378s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a420fc36-a6ab-483b-aa85-256cfbca8ec7 tempest-VolumesTestJSON-1834510752 None] Lock "cinder-quobyte-711693c1-8be7-4000-b663-870b77ac5a97" released by "delete_volume" :: held 1.063s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:26 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-a420fc36-a6ab-483b-aa85-256cfbca8ec7 tempest-VolumesTestJSON-1834510752 None] Created reservations ['3ce72c16-07c8-4785-9607-18c0839d8959', 'fd13daec-e6e9-4538-9d77-03678be4af88', '5e750071-a331-4435-ab0b-d78f1e1c6ba1', 'f1f8bcba-cf33-4334-bbaa-8593aa056781'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:03:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a420fc36-a6ab-483b-aa85-256cfbca8ec7 tempest-VolumesTestJSON-1834510752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a420fc36-a6ab-483b-aa85-256cfbca8ec7 tempest-VolumesTestJSON-1834510752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a420fc36-a6ab-483b-aa85-256cfbca8ec7 tempest-VolumesTestJSON-1834510752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:03:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a420fc36-a6ab-483b-aa85-256cfbca8ec7 tempest-VolumesTestJSON-1834510752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:03:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a420fc36-a6ab-483b-aa85-256cfbca8ec7 tempest-VolumesTestJSON-1834510752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a420fc36-a6ab-483b-aa85-256cfbca8ec7 tempest-VolumesTestJSON-1834510752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:26 devstack sudo[100785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:03:26 devstack sudo[100785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e8f0c91c-fd66-4759-8399-8d6cc36e04aa tempest-VolumesSnapshotListTestJSON-297471525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-275d9763-c33b-4604-8fff-c4834f5775d6 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Acquiring lock "cinder-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-275d9763-c33b-4604-8fff-c4834f5775d6 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Lock "cinder-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:26 devstack sudo[100779]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dcdcb719-bba8-4702-8bbc-eb892f299a4e tempest-VolumesListTestJSON-1183749680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-04b82418-9cb4-4049-ac98-8510f80e4a47 1073741824" returned: 0 in 0.705s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-275d9763-c33b-4604-8fff-c4834f5775d6 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Acquiring lock "cinder-quobyte-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:26 devstack sudo[100785]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a420fc36-a6ab-483b-aa85-256cfbca8ec7 tempest-VolumesTestJSON-1834510752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.391s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:26 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-a420fc36-a6ab-483b-aa85-256cfbca8ec7 tempest-VolumesTestJSON-1834510752 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:03:26 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-a420fc36-a6ab-483b-aa85-256cfbca8ec7 tempest-VolumesTestJSON-1834510752 None] Deleted volume successfully. Sep 28 15:03:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-275d9763-c33b-4604-8fff-c4834f5775d6 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Lock "cinder-quobyte-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d" acquired by "delete_volume" :: waited 0.033s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dcdcb719-bba8-4702-8bbc-eb892f299a4e tempest-VolumesListTestJSON-1183749680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-04b82418-9cb4-4049-ac98-8510f80e4a47 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:26 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[33375727-4acd-4d16-9223-5666c5c20264]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-275d9763-c33b-4604-8fff-c4834f5775d6 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:26 devstack sudo[100790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-04b82418-9cb4-4049-ac98-8510f80e4a47 Sep 28 15:03:26 devstack sudo[100790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a420fc36-a6ab-483b-aa85-256cfbca8ec7 tempest-VolumesTestJSON-1834510752 None] Lock "cinder-711693c1-8be7-4000-b663-870b77ac5a97-delete_volume" released by "delete_volume" :: held 1.955s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:26 devstack sudo[100791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d Sep 28 15:03:26 devstack sudo[100791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:26 devstack sudo[100790]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dcdcb719-bba8-4702-8bbc-eb892f299a4e tempest-VolumesListTestJSON-1183749680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-04b82418-9cb4-4049-ac98-8510f80e4a47" returned: 0 in 0.279s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-dcdcb719-bba8-4702-8bbc-eb892f299a4e tempest-VolumesListTestJSON-1183749680 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:03:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dcdcb719-bba8-4702-8bbc-eb892f299a4e tempest-VolumesListTestJSON-1183749680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e8f0c91c-fd66-4759-8399-8d6cc36e04aa tempest-VolumesSnapshotListTestJSON-297471525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.592s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dcdcb719-bba8-4702-8bbc-eb892f299a4e tempest-VolumesListTestJSON-1183749680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c315c10-949b-4604-826d-7b1c1598188c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04b82418-9cb4-4049-ac98-8510f80e4a47', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dcdcb719-bba8-4702-8bbc-eb892f299a4e tempest-VolumesListTestJSON-1183749680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeeb08fd-dcdb-4630-a60c-e7871e3d0e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:27 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-dcdcb719-bba8-4702-8bbc-eb892f299a4e tempest-VolumesListTestJSON-1183749680 None] Volume volume-04b82418-9cb4-4049-ac98-8510f80e4a47 (04b82418-9cb4-4049-ac98-8510f80e4a47): created successfully Sep 28 15:03:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dcdcb719-bba8-4702-8bbc-eb892f299a4e tempest-VolumesListTestJSON-1183749680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeeb08fd-dcdb-4630-a60c-e7871e3d0e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dcdcb719-bba8-4702-8bbc-eb892f299a4e tempest-VolumesListTestJSON-1183749680 None] Flow 'volume_create_manager' (c7b1d8a1-5e64-4ae2-943c-fac9dfdb0126) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-e8f0c91c-fd66-4759-8399-8d6cc36e04aa tempest-VolumesSnapshotListTestJSON-297471525 None] Creating offline snapshot a468afc1-dbb0-4caf-90e6-4d86ec5d58d5 of volume f8955b18-37ec-4299-a9ec-27ce792a85e5 {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:03:27 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-70f97d9c-0964-4bf9-aa3e-55f5cd0f77de tempest-VolumesTestJSON-1834510752 None] Acquiring lock "cinder-096e5137-3c93-42c5-9d6b-04af9c4a00f0-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:27 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-dcdcb719-bba8-4702-8bbc-eb892f299a4e tempest-VolumesListTestJSON-1183749680 None] Created volume successfully. Sep 28 15:03:27 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[1597984b-825e-4998-88da-d51b85e533ee]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e8f0c91c-fd66-4759-8399-8d6cc36e04aa tempest-VolumesSnapshotListTestJSON-297471525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:27 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-70f97d9c-0964-4bf9-aa3e-55f5cd0f77de tempest-VolumesTestJSON-1834510752 None] Lock "cinder-096e5137-3c93-42c5-9d6b-04af9c4a00f0-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:27 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-70f97d9c-0964-4bf9-aa3e-55f5cd0f77de tempest-VolumesTestJSON-1834510752 None] Acquiring lock "cinder-quobyte-096e5137-3c93-42c5-9d6b-04af9c4a00f0" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:27 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-70f97d9c-0964-4bf9-aa3e-55f5cd0f77de tempest-VolumesTestJSON-1834510752 None] Lock "cinder-quobyte-096e5137-3c93-42c5-9d6b-04af9c4a00f0" acquired by "delete_volume" :: waited 0.032s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:27 devstack sudo[100791]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-275d9763-c33b-4604-8fff-c4834f5775d6 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d" returned: 0 in 0.584s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-275d9763-c33b-4604-8fff-c4834f5775d6 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:27 devstack sudo[100795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5 Sep 28 15:03:27 devstack sudo[100795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:27 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec03a00d-805d-4eca-9e96-7e3c41f0b4cf]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-70f97d9c-0964-4bf9-aa3e-55f5cd0f77de tempest-VolumesTestJSON-1834510752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-096e5137-3c93-42c5-9d6b-04af9c4a00f0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:27 devstack sudo[100799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d Sep 28 15:03:27 devstack sudo[100799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:27 devstack sudo[100801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-096e5137-3c93-42c5-9d6b-04af9c4a00f0 Sep 28 15:03:27 devstack sudo[100801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:27 devstack sudo[100799]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:27 devstack sudo[100795]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-275d9763-c33b-4604-8fff-c4834f5775d6 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d" returned: 0 in 0.299s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e8f0c91c-fd66-4759-8399-8d6cc36e04aa tempest-VolumesSnapshotListTestJSON-297471525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5" returned: 0 in 0.504s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e8f0c91c-fd66-4759-8399-8d6cc36e04aa tempest-VolumesSnapshotListTestJSON-297471525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.a468afc1-dbb0-4caf-90e6-4d86ec5d58d5 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:27 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-275d9763-c33b-4604-8fff-c4834f5775d6 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Lock "cinder-quobyte-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d" released by "delete_volume" :: held 0.999s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:27 devstack sudo[100808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.a468afc1-dbb0-4caf-90e6-4d86ec5d58d5 1G Sep 28 15:03:27 devstack sudo[100808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:27 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-275d9763-c33b-4604-8fff-c4834f5775d6 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Created reservations ['f1df4617-2eb3-4acf-89fe-cda7c17fa6a1', 'd77b10ca-7af4-4fac-88e1-61a4c4748083', '8f0fc9af-4f64-4240-8a82-1001edc0530a', 'c7aa0478-f45b-4c82-95c7-e081f9aa547b'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:03:27 devstack sudo[100801]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-70f97d9c-0964-4bf9-aa3e-55f5cd0f77de tempest-VolumesTestJSON-1834510752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-096e5137-3c93-42c5-9d6b-04af9c4a00f0" returned: 0 in 0.464s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-70f97d9c-0964-4bf9-aa3e-55f5cd0f77de tempest-VolumesTestJSON-1834510752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-096e5137-3c93-42c5-9d6b-04af9c4a00f0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-275d9763-c33b-4604-8fff-c4834f5775d6 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:27 devstack sudo[100813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-096e5137-3c93-42c5-9d6b-04af9c4a00f0 Sep 28 15:03:27 devstack sudo[100813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-275d9763-c33b-4604-8fff-c4834f5775d6 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-275d9763-c33b-4604-8fff-c4834f5775d6 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:03:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-275d9763-c33b-4604-8fff-c4834f5775d6 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:03:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-275d9763-c33b-4604-8fff-c4834f5775d6 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-275d9763-c33b-4604-8fff-c4834f5775d6 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:27 devstack sudo[100815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:03:27 devstack sudo[100815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:28 devstack sudo[100813]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-70f97d9c-0964-4bf9-aa3e-55f5cd0f77de tempest-VolumesTestJSON-1834510752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-096e5137-3c93-42c5-9d6b-04af9c4a00f0" returned: 0 in 0.312s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:28 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-70f97d9c-0964-4bf9-aa3e-55f5cd0f77de tempest-VolumesTestJSON-1834510752 None] Lock "cinder-quobyte-096e5137-3c93-42c5-9d6b-04af9c4a00f0" released by "delete_volume" :: held 0.858s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:28 devstack sudo[100815]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-275d9763-c33b-4604-8fff-c4834f5775d6 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.367s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:28 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-275d9763-c33b-4604-8fff-c4834f5775d6 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:03:28 devstack sudo[100808]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:28 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-275d9763-c33b-4604-8fff-c4834f5775d6 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Deleted volume successfully. Sep 28 15:03:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e8f0c91c-fd66-4759-8399-8d6cc36e04aa tempest-VolumesSnapshotListTestJSON-297471525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.a468afc1-dbb0-4caf-90e6-4d86ec5d58d5 1G" returned: 0 in 0.598s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e8f0c91c-fd66-4759-8399-8d6cc36e04aa tempest-VolumesSnapshotListTestJSON-297471525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8955b18-37ec-4299-a9ec-27ce792a85e5 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.a468afc1-dbb0-4caf-90e6-4d86ec5d58d5 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:28 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-70f97d9c-0964-4bf9-aa3e-55f5cd0f77de tempest-VolumesTestJSON-1834510752 None] Created reservations ['23b91faf-0778-4aef-b445-57546a0f0dd2', 'a7e1c427-5e36-41bc-b971-9b45b908276f', 'bc1f5911-ddcb-4b8d-a1b0-9923fa92b787', 'e276a00a-b7f8-4e39-9a9e-ca9b8dbf47df'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:03:28 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-275d9763-c33b-4604-8fff-c4834f5775d6 tempest-VolumesSnapshotNegativeTestJSON-1579366898 None] Lock "cinder-bfcdde9f-bc2a-463f-b113-4e72b0a3ea0d-delete_volume" released by "delete_volume" :: held 1.733s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:28 devstack sudo[100823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8955b18-37ec-4299-a9ec-27ce792a85e5 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.a468afc1-dbb0-4caf-90e6-4d86ec5d58d5 Sep 28 15:03:28 devstack sudo[100823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-70f97d9c-0964-4bf9-aa3e-55f5cd0f77de tempest-VolumesTestJSON-1834510752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-70f97d9c-0964-4bf9-aa3e-55f5cd0f77de tempest-VolumesTestJSON-1834510752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:28 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-70f97d9c-0964-4bf9-aa3e-55f5cd0f77de tempest-VolumesTestJSON-1834510752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:03:28 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-70f97d9c-0964-4bf9-aa3e-55f5cd0f77de tempest-VolumesTestJSON-1834510752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:03:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-70f97d9c-0964-4bf9-aa3e-55f5cd0f77de tempest-VolumesTestJSON-1834510752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-70f97d9c-0964-4bf9-aa3e-55f5cd0f77de tempest-VolumesTestJSON-1834510752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:28 devstack sudo[100826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:03:28 devstack sudo[100826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:28 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2cecb93-3860-4405-8901-90744c982750 tempest-VolumesListTestJSON-1183749680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:03:28 devstack sudo[100823]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b2cecb93-3860-4405-8901-90744c982750 tempest-VolumesListTestJSON-1183749680 None] Flow 'volume_create_manager' (1162aea0-b858-4923-bdb2-ce1ec7b0b540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b2cecb93-3860-4405-8901-90744c982750 tempest-VolumesListTestJSON-1183749680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (279aa895-9c41-4796-966f-1a84acf05e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:28 devstack sudo[100826]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b2cecb93-3860-4405-8901-90744c982750 tempest-VolumesListTestJSON-1183749680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (279aa895-9c41-4796-966f-1a84acf05e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1617380389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5c60ef4-b81c-4d24-8f5b-e2f873b5a2e9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0a033d8d2de14832a4b942be6805c65d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:29Z,use_quota=True,user_id='530fce79903c42d8a5a88bc2c0913885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b2cecb93-3860-4405-8901-90744c982750 tempest-VolumesListTestJSON-1183749680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad60eb8c-4206-485e-97f9-2909cffd72ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b2cecb93-3860-4405-8901-90744c982750 tempest-VolumesListTestJSON-1183749680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad60eb8c-4206-485e-97f9-2909cffd72ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b2cecb93-3860-4405-8901-90744c982750 tempest-VolumesListTestJSON-1183749680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2eceb7c-e220-453f-b29c-f3f6bb3b833f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b2cecb93-3860-4405-8901-90744c982750 tempest-VolumesListTestJSON-1183749680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2eceb7c-e220-453f-b29c-f3f6bb3b833f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5c60ef4-b81c-4d24-8f5b-e2f873b5a2e9', 'volume_name': 'volume-e5c60ef4-b81c-4d24-8f5b-e2f873b5a2e9', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b2cecb93-3860-4405-8901-90744c982750 tempest-VolumesListTestJSON-1183749680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2baf6a9-b487-49b6-b339-05797f831207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b2cecb93-3860-4405-8901-90744c982750 tempest-VolumesListTestJSON-1183749680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2baf6a9-b487-49b6-b339-05797f831207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b2cecb93-3860-4405-8901-90744c982750 tempest-VolumesListTestJSON-1183749680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c564c05-6dc3-4f79-8b90-63f13a3a6ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:28 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-b2cecb93-3860-4405-8901-90744c982750 tempest-VolumesListTestJSON-1183749680 None] Volume e5c60ef4-b81c-4d24-8f5b-e2f873b5a2e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5c60ef4-b81c-4d24-8f5b-e2f873b5a2e9', 'volume_size': 1} Sep 28 15:03:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b2cecb93-3860-4405-8901-90744c982750 tempest-VolumesListTestJSON-1183749680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e8f0c91c-fd66-4759-8399-8d6cc36e04aa tempest-VolumesSnapshotListTestJSON-297471525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8955b18-37ec-4299-a9ec-27ce792a85e5 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.a468afc1-dbb0-4caf-90e6-4d86ec5d58d5" returned: 0 in 0.551s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:28 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-e8f0c91c-fd66-4759-8399-8d6cc36e04aa tempest-VolumesSnapshotListTestJSON-297471525 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.a468afc1-dbb0-4caf-90e6-4d86ec5d58d5 is being set with open permissions: ugo+rw Sep 28 15:03:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e8f0c91c-fd66-4759-8399-8d6cc36e04aa tempest-VolumesSnapshotListTestJSON-297471525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.a468afc1-dbb0-4caf-90e6-4d86ec5d58d5 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-70f97d9c-0964-4bf9-aa3e-55f5cd0f77de tempest-VolumesTestJSON-1834510752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.397s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:28 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-70f97d9c-0964-4bf9-aa3e-55f5cd0f77de tempest-VolumesTestJSON-1834510752 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:03:28 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-70f97d9c-0964-4bf9-aa3e-55f5cd0f77de tempest-VolumesTestJSON-1834510752 None] Deleted volume successfully. Sep 28 15:03:28 devstack sudo[100832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.a468afc1-dbb0-4caf-90e6-4d86ec5d58d5 Sep 28 15:03:28 devstack sudo[100832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:28 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-70f97d9c-0964-4bf9-aa3e-55f5cd0f77de tempest-VolumesTestJSON-1834510752 None] Lock "cinder-096e5137-3c93-42c5-9d6b-04af9c4a00f0-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:29 devstack sudo[100832]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e8f0c91c-fd66-4759-8399-8d6cc36e04aa tempest-VolumesSnapshotListTestJSON-297471525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.a468afc1-dbb0-4caf-90e6-4d86ec5d58d5" returned: 0 in 0.326s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e8f0c91c-fd66-4759-8399-8d6cc36e04aa tempest-VolumesSnapshotListTestJSON-297471525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:29 devstack sudo[100835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.info Sep 28 15:03:29 devstack sudo[100835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:29 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-af64e3d6-559f-474f-a843-878b8e265ea3 tempest-VolumesTestJSON-1834510752 None] Acquiring lock "cinder-f401933f-765b-40bf-9d20-74844a99a2cf-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:29 devstack sudo[100835]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e8f0c91c-fd66-4759-8399-8d6cc36e04aa tempest-VolumesSnapshotListTestJSON-297471525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.info" returned: 0 in 0.348s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:29 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-e8f0c91c-fd66-4759-8399-8d6cc36e04aa tempest-VolumesSnapshotListTestJSON-297471525 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.info is being set with open permissions: ugo+rw Sep 28 15:03:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e8f0c91c-fd66-4759-8399-8d6cc36e04aa tempest-VolumesSnapshotListTestJSON-297471525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:29 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-af64e3d6-559f-474f-a843-878b8e265ea3 tempest-VolumesTestJSON-1834510752 None] Lock "cinder-f401933f-765b-40bf-9d20-74844a99a2cf-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:29 devstack sudo[100838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.info Sep 28 15:03:29 devstack sudo[100838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:29 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-af64e3d6-559f-474f-a843-878b8e265ea3 tempest-VolumesTestJSON-1834510752 None] Acquiring lock "cinder-quobyte-f401933f-765b-40bf-9d20-74844a99a2cf" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:29 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-af64e3d6-559f-474f-a843-878b8e265ea3 tempest-VolumesTestJSON-1834510752 None] Lock "cinder-quobyte-f401933f-765b-40bf-9d20-74844a99a2cf" acquired by "delete_volume" :: waited 0.018s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:29 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[b241b042-6f5f-4076-9d70-ea3da6eb79c2]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-af64e3d6-559f-474f-a843-878b8e265ea3 tempest-VolumesTestJSON-1834510752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f401933f-765b-40bf-9d20-74844a99a2cf {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:29 devstack sudo[100840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f401933f-765b-40bf-9d20-74844a99a2cf Sep 28 15:03:29 devstack sudo[100840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:29 devstack sudo[100838]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e8f0c91c-fd66-4759-8399-8d6cc36e04aa tempest-VolumesSnapshotListTestJSON-297471525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.info" returned: 0 in 0.395s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e8f0c91c-fd66-4759-8399-8d6cc36e04aa tempest-VolumesSnapshotListTestJSON-297471525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.927s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b2cecb93-3860-4405-8901-90744c982750 tempest-VolumesListTestJSON-1183749680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.147s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:29 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b2cecb93-3860-4405-8901-90744c982750 tempest-VolumesListTestJSON-1183749680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1617380389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5c60ef4-b81c-4d24-8f5b-e2f873b5a2e9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0a033d8d2de14832a4b942be6805c65d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:29Z,use_quota=True,user_id='530fce79903c42d8a5a88bc2c0913885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:03:29 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-b2cecb93-3860-4405-8901-90744c982750 tempest-VolumesListTestJSON-1183749680 None] Creating volume e5c60ef4-b81c-4d24-8f5b-e2f873b5a2e9 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:03:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b2cecb93-3860-4405-8901-90744c982750 tempest-VolumesListTestJSON-1183749680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b2cecb93-3860-4405-8901-90744c982750 tempest-VolumesListTestJSON-1183749680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:29 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b2cecb93-3860-4405-8901-90744c982750 tempest-VolumesListTestJSON-1183749680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:03:29 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b2cecb93-3860-4405-8901-90744c982750 tempest-VolumesListTestJSON-1183749680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:03:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b2cecb93-3860-4405-8901-90744c982750 tempest-VolumesListTestJSON-1183749680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:29 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b2cecb93-3860-4405-8901-90744c982750 tempest-VolumesListTestJSON-1183749680 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:03:29 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-b2cecb93-3860-4405-8901-90744c982750 tempest-VolumesListTestJSON-1183749680 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:03:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b2cecb93-3860-4405-8901-90744c982750 tempest-VolumesListTestJSON-1183749680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e5c60ef4-b81c-4d24-8f5b-e2f873b5a2e9 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:29 devstack sudo[100843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e5c60ef4-b81c-4d24-8f5b-e2f873b5a2e9 1073741824 Sep 28 15:03:29 devstack sudo[100843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:29 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-e8f0c91c-fd66-4759-8399-8d6cc36e04aa tempest-VolumesSnapshotListTestJSON-297471525 None] Create snapshot completed successfully Sep 28 15:03:30 devstack sudo[100840]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-af64e3d6-559f-474f-a843-878b8e265ea3 tempest-VolumesTestJSON-1834510752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f401933f-765b-40bf-9d20-74844a99a2cf" returned: 0 in 0.524s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-af64e3d6-559f-474f-a843-878b8e265ea3 tempest-VolumesTestJSON-1834510752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f401933f-765b-40bf-9d20-74844a99a2cf {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:30 devstack sudo[100848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f401933f-765b-40bf-9d20-74844a99a2cf Sep 28 15:03:30 devstack sudo[100848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:30 devstack sudo[100848]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-af64e3d6-559f-474f-a843-878b8e265ea3 tempest-VolumesTestJSON-1834510752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f401933f-765b-40bf-9d20-74844a99a2cf" returned: 0 in 0.392s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-af64e3d6-559f-474f-a843-878b8e265ea3 tempest-VolumesTestJSON-1834510752 None] Lock "cinder-quobyte-f401933f-765b-40bf-9d20-74844a99a2cf" released by "delete_volume" :: held 1.002s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:30 devstack sudo[100843]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b2cecb93-3860-4405-8901-90744c982750 tempest-VolumesListTestJSON-1183749680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e5c60ef4-b81c-4d24-8f5b-e2f873b5a2e9 1073741824" returned: 0 in 0.678s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b2cecb93-3860-4405-8901-90744c982750 tempest-VolumesListTestJSON-1183749680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e5c60ef4-b81c-4d24-8f5b-e2f873b5a2e9 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:30 devstack sudo[100856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e5c60ef4-b81c-4d24-8f5b-e2f873b5a2e9 Sep 28 15:03:30 devstack sudo[100856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:30 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-af64e3d6-559f-474f-a843-878b8e265ea3 tempest-VolumesTestJSON-1834510752 None] Created reservations ['777344bd-4ed4-4d1a-9aed-6daac4cf1268', '895ef853-7b8f-476f-9a67-5f39456c1c4e', '8d7fa013-d1f6-41b2-b14f-911feeff2983', '13d2f137-5a54-4ff3-bba8-edc4e4158e24'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:03:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-af64e3d6-559f-474f-a843-878b8e265ea3 tempest-VolumesTestJSON-1834510752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-af64e3d6-559f-474f-a843-878b8e265ea3 tempest-VolumesTestJSON-1834510752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-af64e3d6-559f-474f-a843-878b8e265ea3 tempest-VolumesTestJSON-1834510752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:03:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-af64e3d6-559f-474f-a843-878b8e265ea3 tempest-VolumesTestJSON-1834510752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:03:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-af64e3d6-559f-474f-a843-878b8e265ea3 tempest-VolumesTestJSON-1834510752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-af64e3d6-559f-474f-a843-878b8e265ea3 tempest-VolumesTestJSON-1834510752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:30 devstack sudo[100859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:03:30 devstack sudo[100859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9d5ce622-c9e8-42a7-92c9-12f30e946d87 tempest-VolumesSnapshotListTestJSON-297471525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:31 devstack sudo[100856]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b2cecb93-3860-4405-8901-90744c982750 tempest-VolumesListTestJSON-1183749680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e5c60ef4-b81c-4d24-8f5b-e2f873b5a2e9" returned: 0 in 0.414s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:31 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b2cecb93-3860-4405-8901-90744c982750 tempest-VolumesListTestJSON-1183749680 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:03:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b2cecb93-3860-4405-8901-90744c982750 tempest-VolumesListTestJSON-1183749680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9d5ce622-c9e8-42a7-92c9-12f30e946d87 tempest-VolumesSnapshotListTestJSON-297471525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.083s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b2cecb93-3860-4405-8901-90744c982750 tempest-VolumesListTestJSON-1183749680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c564c05-6dc3-4f79-8b90-63f13a3a6ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5c60ef4-b81c-4d24-8f5b-e2f873b5a2e9', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b2cecb93-3860-4405-8901-90744c982750 tempest-VolumesListTestJSON-1183749680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e323ace4-a553-41de-9c45-1d0f16a7347c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:31 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-9d5ce622-c9e8-42a7-92c9-12f30e946d87 tempest-VolumesSnapshotListTestJSON-297471525 None] Creating offline snapshot 4b6703fd-3d07-46a7-9ae2-2611083908da of volume f8955b18-37ec-4299-a9ec-27ce792a85e5 {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:03:31 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-b2cecb93-3860-4405-8901-90744c982750 tempest-VolumesListTestJSON-1183749680 None] Volume volume-e5c60ef4-b81c-4d24-8f5b-e2f873b5a2e9 (e5c60ef4-b81c-4d24-8f5b-e2f873b5a2e9): created successfully Sep 28 15:03:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b2cecb93-3860-4405-8901-90744c982750 tempest-VolumesListTestJSON-1183749680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e323ace4-a553-41de-9c45-1d0f16a7347c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b2cecb93-3860-4405-8901-90744c982750 tempest-VolumesListTestJSON-1183749680 None] Flow 'volume_create_manager' (1162aea0-b858-4923-bdb2-ce1ec7b0b540) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:31 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c34e3c8-f8eb-4154-b9a9-02a17d3690f0]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9d5ce622-c9e8-42a7-92c9-12f30e946d87 tempest-VolumesSnapshotListTestJSON-297471525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.a468afc1-dbb0-4caf-90e6-4d86ec5d58d5 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:31 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-b2cecb93-3860-4405-8901-90744c982750 tempest-VolumesListTestJSON-1183749680 None] Created volume successfully. Sep 28 15:03:31 devstack sudo[100859]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-af64e3d6-559f-474f-a843-878b8e265ea3 tempest-VolumesTestJSON-1834510752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.391s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:31 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-af64e3d6-559f-474f-a843-878b8e265ea3 tempest-VolumesTestJSON-1834510752 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:03:31 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-af64e3d6-559f-474f-a843-878b8e265ea3 tempest-VolumesTestJSON-1834510752 None] Deleted volume successfully. Sep 28 15:03:31 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-af64e3d6-559f-474f-a843-878b8e265ea3 tempest-VolumesTestJSON-1834510752 None] Lock "cinder-f401933f-765b-40bf-9d20-74844a99a2cf-delete_volume" released by "delete_volume" :: held 1.868s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:31 devstack sudo[100872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.a468afc1-dbb0-4caf-90e6-4d86ec5d58d5 Sep 28 15:03:31 devstack sudo[100872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:31 devstack sudo[100872]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9d5ce622-c9e8-42a7-92c9-12f30e946d87 tempest-VolumesSnapshotListTestJSON-297471525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.a468afc1-dbb0-4caf-90e6-4d86ec5d58d5" returned: 0 in 0.522s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:31 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-9d5ce622-c9e8-42a7-92c9-12f30e946d87 tempest-VolumesSnapshotListTestJSON-297471525 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8955b18-37ec-4299-a9ec-27ce792a85e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:03:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9d5ce622-c9e8-42a7-92c9-12f30e946d87 tempest-VolumesSnapshotListTestJSON-297471525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.a468afc1-dbb0-4caf-90e6-4d86ec5d58d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.4b6703fd-3d07-46a7-9ae2-2611083908da 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:31 devstack sudo[100905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.a468afc1-dbb0-4caf-90e6-4d86ec5d58d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.4b6703fd-3d07-46a7-9ae2-2611083908da 1G Sep 28 15:03:31 devstack sudo[100905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:32 devstack sudo[100905]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9d5ce622-c9e8-42a7-92c9-12f30e946d87 tempest-VolumesSnapshotListTestJSON-297471525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.a468afc1-dbb0-4caf-90e6-4d86ec5d58d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.4b6703fd-3d07-46a7-9ae2-2611083908da 1G" returned: 0 in 0.680s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9d5ce622-c9e8-42a7-92c9-12f30e946d87 tempest-VolumesSnapshotListTestJSON-297471525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.a468afc1-dbb0-4caf-90e6-4d86ec5d58d5 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.4b6703fd-3d07-46a7-9ae2-2611083908da {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:32 devstack sudo[100917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.a468afc1-dbb0-4caf-90e6-4d86ec5d58d5 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.4b6703fd-3d07-46a7-9ae2-2611083908da Sep 28 15:03:32 devstack sudo[100917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:32 devstack sudo[100917]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9d5ce622-c9e8-42a7-92c9-12f30e946d87 tempest-VolumesSnapshotListTestJSON-297471525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.a468afc1-dbb0-4caf-90e6-4d86ec5d58d5 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.4b6703fd-3d07-46a7-9ae2-2611083908da" returned: 0 in 0.419s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:32 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-9d5ce622-c9e8-42a7-92c9-12f30e946d87 tempest-VolumesSnapshotListTestJSON-297471525 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.4b6703fd-3d07-46a7-9ae2-2611083908da is being set with open permissions: ugo+rw Sep 28 15:03:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9d5ce622-c9e8-42a7-92c9-12f30e946d87 tempest-VolumesSnapshotListTestJSON-297471525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.4b6703fd-3d07-46a7-9ae2-2611083908da {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:32 devstack sudo[100922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.4b6703fd-3d07-46a7-9ae2-2611083908da Sep 28 15:03:32 devstack sudo[100922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:33 devstack sudo[100922]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9d5ce622-c9e8-42a7-92c9-12f30e946d87 tempest-VolumesSnapshotListTestJSON-297471525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.4b6703fd-3d07-46a7-9ae2-2611083908da" returned: 0 in 0.495s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9d5ce622-c9e8-42a7-92c9-12f30e946d87 tempest-VolumesSnapshotListTestJSON-297471525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.349s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:33 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-9d5ce622-c9e8-42a7-92c9-12f30e946d87 tempest-VolumesSnapshotListTestJSON-297471525 None] Create snapshot completed successfully Sep 28 15:03:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9f86e870-3fcf-466b-a40f-b775931d8ad1 tempest-VolumesSnapshotListTestJSON-297471525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9f86e870-3fcf-466b-a40f-b775931d8ad1 tempest-VolumesSnapshotListTestJSON-297471525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:34 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-9f86e870-3fcf-466b-a40f-b775931d8ad1 tempest-VolumesSnapshotListTestJSON-297471525 None] Creating offline snapshot 4a506447-509d-4e58-8379-6f9b6f4894ea of volume f8955b18-37ec-4299-a9ec-27ce792a85e5 {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:03:35 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[194cc771-2931-4776-a24a-742d008f28c8]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9f86e870-3fcf-466b-a40f-b775931d8ad1 tempest-VolumesSnapshotListTestJSON-297471525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.4b6703fd-3d07-46a7-9ae2-2611083908da {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:35 devstack sudo[100925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.4b6703fd-3d07-46a7-9ae2-2611083908da Sep 28 15:03:35 devstack sudo[100925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:35 devstack sudo[100925]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9f86e870-3fcf-466b-a40f-b775931d8ad1 tempest-VolumesSnapshotListTestJSON-297471525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.4b6703fd-3d07-46a7-9ae2-2611083908da" returned: 0 in 0.522s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-9f86e870-3fcf-466b-a40f-b775931d8ad1 tempest-VolumesSnapshotListTestJSON-297471525 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8955b18-37ec-4299-a9ec-27ce792a85e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:03:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9f86e870-3fcf-466b-a40f-b775931d8ad1 tempest-VolumesSnapshotListTestJSON-297471525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.4b6703fd-3d07-46a7-9ae2-2611083908da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.4a506447-509d-4e58-8379-6f9b6f4894ea 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:35 devstack sudo[100930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.4b6703fd-3d07-46a7-9ae2-2611083908da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.4a506447-509d-4e58-8379-6f9b6f4894ea 1G Sep 28 15:03:35 devstack sudo[100930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:35 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-69ee7718-2327-4e47-9bda-53d6912b8890 tempest-VolumesListTestJSON-1183749680 None] Acquiring lock "cinder-e5c60ef4-b81c-4d24-8f5b-e2f873b5a2e9-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:35 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-69ee7718-2327-4e47-9bda-53d6912b8890 tempest-VolumesListTestJSON-1183749680 None] Lock "cinder-e5c60ef4-b81c-4d24-8f5b-e2f873b5a2e9-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:35 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-69ee7718-2327-4e47-9bda-53d6912b8890 tempest-VolumesListTestJSON-1183749680 None] Acquiring lock "cinder-quobyte-e5c60ef4-b81c-4d24-8f5b-e2f873b5a2e9" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:35 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-69ee7718-2327-4e47-9bda-53d6912b8890 tempest-VolumesListTestJSON-1183749680 None] Lock "cinder-quobyte-e5c60ef4-b81c-4d24-8f5b-e2f873b5a2e9" acquired by "delete_volume" :: waited 0.024s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:35 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32d8ddd-e4bb-4c34-8954-d0639bca682f]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-69ee7718-2327-4e47-9bda-53d6912b8890 tempest-VolumesListTestJSON-1183749680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e5c60ef4-b81c-4d24-8f5b-e2f873b5a2e9 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:36 devstack sudo[100934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e5c60ef4-b81c-4d24-8f5b-e2f873b5a2e9 Sep 28 15:03:36 devstack sudo[100934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:36 devstack sudo[100930]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9f86e870-3fcf-466b-a40f-b775931d8ad1 tempest-VolumesSnapshotListTestJSON-297471525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.4b6703fd-3d07-46a7-9ae2-2611083908da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.4a506447-509d-4e58-8379-6f9b6f4894ea 1G" returned: 0 in 0.740s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9f86e870-3fcf-466b-a40f-b775931d8ad1 tempest-VolumesSnapshotListTestJSON-297471525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.4b6703fd-3d07-46a7-9ae2-2611083908da -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.4a506447-509d-4e58-8379-6f9b6f4894ea {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:36 devstack sudo[100941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.4b6703fd-3d07-46a7-9ae2-2611083908da -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.4a506447-509d-4e58-8379-6f9b6f4894ea Sep 28 15:03:36 devstack sudo[100941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:36 devstack sudo[100934]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-69ee7718-2327-4e47-9bda-53d6912b8890 tempest-VolumesListTestJSON-1183749680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e5c60ef4-b81c-4d24-8f5b-e2f873b5a2e9" returned: 0 in 0.529s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-69ee7718-2327-4e47-9bda-53d6912b8890 tempest-VolumesListTestJSON-1183749680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e5c60ef4-b81c-4d24-8f5b-e2f873b5a2e9 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:36 devstack sudo[100944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e5c60ef4-b81c-4d24-8f5b-e2f873b5a2e9 Sep 28 15:03:36 devstack sudo[100944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:36 devstack sudo[100944]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-69ee7718-2327-4e47-9bda-53d6912b8890 tempest-VolumesListTestJSON-1183749680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e5c60ef4-b81c-4d24-8f5b-e2f873b5a2e9" returned: 0 in 0.393s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:36 devstack sudo[100941]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9f86e870-3fcf-466b-a40f-b775931d8ad1 tempest-VolumesSnapshotListTestJSON-297471525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.4b6703fd-3d07-46a7-9ae2-2611083908da -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.4a506447-509d-4e58-8379-6f9b6f4894ea" returned: 0 in 0.507s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:36 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-9f86e870-3fcf-466b-a40f-b775931d8ad1 tempest-VolumesSnapshotListTestJSON-297471525 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.4a506447-509d-4e58-8379-6f9b6f4894ea is being set with open permissions: ugo+rw Sep 28 15:03:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9f86e870-3fcf-466b-a40f-b775931d8ad1 tempest-VolumesSnapshotListTestJSON-297471525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.4a506447-509d-4e58-8379-6f9b6f4894ea {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:36 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-69ee7718-2327-4e47-9bda-53d6912b8890 tempest-VolumesListTestJSON-1183749680 None] Lock "cinder-quobyte-e5c60ef4-b81c-4d24-8f5b-e2f873b5a2e9" released by "delete_volume" :: held 1.016s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:36 devstack sudo[100954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.4a506447-509d-4e58-8379-6f9b6f4894ea Sep 28 15:03:36 devstack sudo[100954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:36 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-69ee7718-2327-4e47-9bda-53d6912b8890 tempest-VolumesListTestJSON-1183749680 None] Created reservations ['38662b92-a117-4ad2-9202-511e0b4e98b7', '1980ff64-aad6-49c0-acbe-a32f1191bb27', 'c79942f0-036d-4063-a2b9-d0c570590825', '7d08cac0-ebaf-485a-b6ff-b57e1eac6bed'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:03:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-69ee7718-2327-4e47-9bda-53d6912b8890 tempest-VolumesListTestJSON-1183749680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-69ee7718-2327-4e47-9bda-53d6912b8890 tempest-VolumesListTestJSON-1183749680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:36 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-69ee7718-2327-4e47-9bda-53d6912b8890 tempest-VolumesListTestJSON-1183749680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:03:37 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-69ee7718-2327-4e47-9bda-53d6912b8890 tempest-VolumesListTestJSON-1183749680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:03:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-69ee7718-2327-4e47-9bda-53d6912b8890 tempest-VolumesListTestJSON-1183749680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-69ee7718-2327-4e47-9bda-53d6912b8890 tempest-VolumesListTestJSON-1183749680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:37 devstack sudo[100956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:03:37 devstack sudo[100956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:37 devstack sudo[100954]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9f86e870-3fcf-466b-a40f-b775931d8ad1 tempest-VolumesSnapshotListTestJSON-297471525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.4a506447-509d-4e58-8379-6f9b6f4894ea" returned: 0 in 0.368s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9f86e870-3fcf-466b-a40f-b775931d8ad1 tempest-VolumesSnapshotListTestJSON-297471525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.337s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:37 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-9f86e870-3fcf-466b-a40f-b775931d8ad1 tempest-VolumesSnapshotListTestJSON-297471525 None] Create snapshot completed successfully Sep 28 15:03:37 devstack sudo[100956]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-69ee7718-2327-4e47-9bda-53d6912b8890 tempest-VolumesListTestJSON-1183749680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.377s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:37 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-69ee7718-2327-4e47-9bda-53d6912b8890 tempest-VolumesListTestJSON-1183749680 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:03:37 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-69ee7718-2327-4e47-9bda-53d6912b8890 tempest-VolumesListTestJSON-1183749680 None] Deleted volume successfully. Sep 28 15:03:37 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-69ee7718-2327-4e47-9bda-53d6912b8890 tempest-VolumesListTestJSON-1183749680 None] Lock "cinder-e5c60ef4-b81c-4d24-8f5b-e2f873b5a2e9-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f14f1b60-74db-4480-9725-358721946834 tempest-VolumesListTestJSON-1183749680 None] Acquiring lock "cinder-04b82418-9cb4-4049-ac98-8510f80e4a47-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f14f1b60-74db-4480-9725-358721946834 tempest-VolumesListTestJSON-1183749680 None] Lock "cinder-04b82418-9cb4-4049-ac98-8510f80e4a47-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f14f1b60-74db-4480-9725-358721946834 tempest-VolumesListTestJSON-1183749680 None] Acquiring lock "cinder-quobyte-04b82418-9cb4-4049-ac98-8510f80e4a47" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f14f1b60-74db-4480-9725-358721946834 tempest-VolumesListTestJSON-1183749680 None] Lock "cinder-quobyte-04b82418-9cb4-4049-ac98-8510f80e4a47" acquired by "delete_volume" :: waited 0.026s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:38 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e6728a-15cc-4737-a863-9f4d48dd9510]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f14f1b60-74db-4480-9725-358721946834 tempest-VolumesListTestJSON-1183749680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-04b82418-9cb4-4049-ac98-8510f80e4a47 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:38 devstack sudo[100960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-04b82418-9cb4-4049-ac98-8510f80e4a47 Sep 28 15:03:38 devstack sudo[100960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:38 devstack sudo[100960]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f14f1b60-74db-4480-9725-358721946834 tempest-VolumesListTestJSON-1183749680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-04b82418-9cb4-4049-ac98-8510f80e4a47" returned: 0 in 0.529s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f14f1b60-74db-4480-9725-358721946834 tempest-VolumesListTestJSON-1183749680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-04b82418-9cb4-4049-ac98-8510f80e4a47 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:38 devstack sudo[100965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-04b82418-9cb4-4049-ac98-8510f80e4a47 Sep 28 15:03:38 devstack sudo[100965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:39 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-d91d4754-86e0-47f8-bfbd-badba54d6f5e tempest-VolumeQuotasNegativeTestJSON-936232115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:03:39 devstack sudo[100965]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d91d4754-86e0-47f8-bfbd-badba54d6f5e tempest-VolumeQuotasNegativeTestJSON-936232115 None] Flow 'volume_create_manager' (594e9b63-b010-411e-99a5-09c7b9a72b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d91d4754-86e0-47f8-bfbd-badba54d6f5e tempest-VolumeQuotasNegativeTestJSON-936232115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (704a41b3-f122-4a18-ab89-2b74972438b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f14f1b60-74db-4480-9725-358721946834 tempest-VolumesListTestJSON-1183749680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-04b82418-9cb4-4049-ac98-8510f80e4a47" returned: 0 in 0.432s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:39 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f14f1b60-74db-4480-9725-358721946834 tempest-VolumesListTestJSON-1183749680 None] Lock "cinder-quobyte-04b82418-9cb4-4049-ac98-8510f80e4a47" released by "delete_volume" :: held 1.045s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d91d4754-86e0-47f8-bfbd-badba54d6f5e tempest-VolumeQuotasNegativeTestJSON-936232115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (704a41b3-f122-4a18-ab89-2b74972438b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1740812537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a809cdc8-1c49-49d6-ae13-3746d5743dca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d613aeea49fd4b989828fc2312783310',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:39Z,use_quota=True,user_id='29d1e12495e8409eb799bd9da209a3c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d91d4754-86e0-47f8-bfbd-badba54d6f5e tempest-VolumeQuotasNegativeTestJSON-936232115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5735b10-7955-445f-a5b1-e840ae517165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d91d4754-86e0-47f8-bfbd-badba54d6f5e tempest-VolumeQuotasNegativeTestJSON-936232115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5735b10-7955-445f-a5b1-e840ae517165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d91d4754-86e0-47f8-bfbd-badba54d6f5e tempest-VolumeQuotasNegativeTestJSON-936232115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fbdb743-5948-4e97-b4dd-3fdb18a545f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d91d4754-86e0-47f8-bfbd-badba54d6f5e tempest-VolumeQuotasNegativeTestJSON-936232115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fbdb743-5948-4e97-b4dd-3fdb18a545f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a809cdc8-1c49-49d6-ae13-3746d5743dca', 'volume_name': 'volume-a809cdc8-1c49-49d6-ae13-3746d5743dca', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d91d4754-86e0-47f8-bfbd-badba54d6f5e tempest-VolumeQuotasNegativeTestJSON-936232115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d19c7f08-6672-4a4d-8a2d-8c5eb6e51f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d91d4754-86e0-47f8-bfbd-badba54d6f5e tempest-VolumeQuotasNegativeTestJSON-936232115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d19c7f08-6672-4a4d-8a2d-8c5eb6e51f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d91d4754-86e0-47f8-bfbd-badba54d6f5e tempest-VolumeQuotasNegativeTestJSON-936232115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc9ff74a-785e-4d82-a4d9-99b1cb2f422b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:39 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-d91d4754-86e0-47f8-bfbd-badba54d6f5e tempest-VolumeQuotasNegativeTestJSON-936232115 None] Volume a809cdc8-1c49-49d6-ae13-3746d5743dca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a809cdc8-1c49-49d6-ae13-3746d5743dca', 'volume_size': 1} Sep 28 15:03:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d91d4754-86e0-47f8-bfbd-badba54d6f5e tempest-VolumeQuotasNegativeTestJSON-936232115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d91d4754-86e0-47f8-bfbd-badba54d6f5e tempest-VolumeQuotasNegativeTestJSON-936232115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d91d4754-86e0-47f8-bfbd-badba54d6f5e tempest-VolumeQuotasNegativeTestJSON-936232115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1740812537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a809cdc8-1c49-49d6-ae13-3746d5743dca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d613aeea49fd4b989828fc2312783310',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:39Z,use_quota=True,user_id='29d1e12495e8409eb799bd9da209a3c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:03:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-d91d4754-86e0-47f8-bfbd-badba54d6f5e tempest-VolumeQuotasNegativeTestJSON-936232115 None] Creating volume a809cdc8-1c49-49d6-ae13-3746d5743dca {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:03:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d91d4754-86e0-47f8-bfbd-badba54d6f5e tempest-VolumeQuotasNegativeTestJSON-936232115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d91d4754-86e0-47f8-bfbd-badba54d6f5e tempest-VolumeQuotasNegativeTestJSON-936232115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d91d4754-86e0-47f8-bfbd-badba54d6f5e tempest-VolumeQuotasNegativeTestJSON-936232115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:03:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d91d4754-86e0-47f8-bfbd-badba54d6f5e tempest-VolumeQuotasNegativeTestJSON-936232115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:03:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d91d4754-86e0-47f8-bfbd-badba54d6f5e tempest-VolumeQuotasNegativeTestJSON-936232115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d91d4754-86e0-47f8-bfbd-badba54d6f5e tempest-VolumeQuotasNegativeTestJSON-936232115 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:03:39 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-d91d4754-86e0-47f8-bfbd-badba54d6f5e tempest-VolumeQuotasNegativeTestJSON-936232115 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:03:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d91d4754-86e0-47f8-bfbd-badba54d6f5e tempest-VolumeQuotasNegativeTestJSON-936232115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a809cdc8-1c49-49d6-ae13-3746d5743dca 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:39 devstack sudo[100968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a809cdc8-1c49-49d6-ae13-3746d5743dca 1073741824 Sep 28 15:03:39 devstack sudo[100968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:39 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-f14f1b60-74db-4480-9725-358721946834 tempest-VolumesListTestJSON-1183749680 None] Created reservations ['a5c4e641-a760-4197-8b22-743f24a46f63', '4191b3ee-09e0-4f13-ba4d-844a31febe5d', 'dbcb1711-5ff6-4f8a-a5b9-240e2a1f3a2f', '44ba3ac5-4324-4643-bc84-ad94514ec748'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:03:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f14f1b60-74db-4480-9725-358721946834 tempest-VolumesListTestJSON-1183749680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f14f1b60-74db-4480-9725-358721946834 tempest-VolumesListTestJSON-1183749680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f14f1b60-74db-4480-9725-358721946834 tempest-VolumesListTestJSON-1183749680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:03:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f14f1b60-74db-4480-9725-358721946834 tempest-VolumesListTestJSON-1183749680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:03:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f14f1b60-74db-4480-9725-358721946834 tempest-VolumesListTestJSON-1183749680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f14f1b60-74db-4480-9725-358721946834 tempest-VolumesListTestJSON-1183749680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:39 devstack sudo[100970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:03:39 devstack sudo[100970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:39 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1e32977e-fa92-49aa-b7b4-26b51985fa06 tempest-VolumesSnapshotListTestJSON-297471525 None] Acquiring lock "cinder-4a506447-509d-4e58-8379-6f9b6f4894ea-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:39 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1e32977e-fa92-49aa-b7b4-26b51985fa06 tempest-VolumesSnapshotListTestJSON-297471525 None] Lock "cinder-4a506447-509d-4e58-8379-6f9b6f4894ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:39 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1e32977e-fa92-49aa-b7b4-26b51985fa06 tempest-VolumesSnapshotListTestJSON-297471525 None] Acquiring lock "cinder-quobyte-f8955b18-37ec-4299-a9ec-27ce792a85e5" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:39 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1e32977e-fa92-49aa-b7b4-26b51985fa06 tempest-VolumesSnapshotListTestJSON-297471525 None] Lock "cinder-quobyte-f8955b18-37ec-4299-a9ec-27ce792a85e5" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:39 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1e32977e-fa92-49aa-b7b4-26b51985fa06 tempest-VolumesSnapshotListTestJSON-297471525 None] Acquiring lock "cinder-quobyte-4a506447-509d-4e58-8379-6f9b6f4894ea" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:39 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1e32977e-fa92-49aa-b7b4-26b51985fa06 tempest-VolumesSnapshotListTestJSON-297471525 None] Lock "cinder-quobyte-4a506447-509d-4e58-8379-6f9b6f4894ea" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-1e32977e-fa92-49aa-b7b4-26b51985fa06 tempest-VolumesSnapshotListTestJSON-297471525 None] Deleting offline snapshot 4a506447-509d-4e58-8379-6f9b6f4894ea of volume f8955b18-37ec-4299-a9ec-27ce792a85e5 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:03:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-1e32977e-fa92-49aa-b7b4-26b51985fa06 tempest-VolumesSnapshotListTestJSON-297471525 None] snapshot_file for this snap is: volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.4a506447-509d-4e58-8379-6f9b6f4894ea {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:03:39 devstack sudo[100970]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f14f1b60-74db-4480-9725-358721946834 tempest-VolumesListTestJSON-1183749680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.437s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:39 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-f14f1b60-74db-4480-9725-358721946834 tempest-VolumesListTestJSON-1183749680 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:03:39 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-f14f1b60-74db-4480-9725-358721946834 tempest-VolumesListTestJSON-1183749680 None] Deleted volume successfully. Sep 28 15:03:40 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da24a00-9973-4c6f-85e8-d6f5cc024f7c]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:40 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f14f1b60-74db-4480-9725-358721946834 tempest-VolumesListTestJSON-1183749680 None] Lock "cinder-04b82418-9cb4-4049-ac98-8510f80e4a47-delete_volume" released by "delete_volume" :: held 1.926s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1e32977e-fa92-49aa-b7b4-26b51985fa06 tempest-VolumesSnapshotListTestJSON-297471525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.4a506447-509d-4e58-8379-6f9b6f4894ea {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:40 devstack sudo[100968]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d91d4754-86e0-47f8-bfbd-badba54d6f5e tempest-VolumeQuotasNegativeTestJSON-936232115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a809cdc8-1c49-49d6-ae13-3746d5743dca 1073741824" returned: 0 in 0.846s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:40 devstack sudo[100977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.4a506447-509d-4e58-8379-6f9b6f4894ea Sep 28 15:03:40 devstack sudo[100977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d91d4754-86e0-47f8-bfbd-badba54d6f5e tempest-VolumeQuotasNegativeTestJSON-936232115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a809cdc8-1c49-49d6-ae13-3746d5743dca {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:40 devstack sudo[100979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a809cdc8-1c49-49d6-ae13-3746d5743dca Sep 28 15:03:40 devstack sudo[100979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:40 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c27f1a75-4d6e-4489-996f-d8186ee29158 tempest-VolumesListTestJSON-1183749680 None] Acquiring lock "cinder-5790a342-b9ef-4399-802e-cff1160db060-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:40 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c27f1a75-4d6e-4489-996f-d8186ee29158 tempest-VolumesListTestJSON-1183749680 None] Lock "cinder-5790a342-b9ef-4399-802e-cff1160db060-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:40 devstack sudo[100979]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d91d4754-86e0-47f8-bfbd-badba54d6f5e tempest-VolumeQuotasNegativeTestJSON-936232115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a809cdc8-1c49-49d6-ae13-3746d5743dca" returned: 0 in 0.373s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:40 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d91d4754-86e0-47f8-bfbd-badba54d6f5e tempest-VolumeQuotasNegativeTestJSON-936232115 None] <== create_volume: return (1317ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:03:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d91d4754-86e0-47f8-bfbd-badba54d6f5e tempest-VolumeQuotasNegativeTestJSON-936232115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.324s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d91d4754-86e0-47f8-bfbd-badba54d6f5e tempest-VolumeQuotasNegativeTestJSON-936232115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc9ff74a-785e-4d82-a4d9-99b1cb2f422b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a809cdc8-1c49-49d6-ae13-3746d5743dca', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d91d4754-86e0-47f8-bfbd-badba54d6f5e tempest-VolumeQuotasNegativeTestJSON-936232115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c9ca3de-17dc-4774-99e4-200e6d503a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:40 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c27f1a75-4d6e-4489-996f-d8186ee29158 tempest-VolumesListTestJSON-1183749680 None] Acquiring lock "cinder-quobyte-5790a342-b9ef-4399-802e-cff1160db060" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:40 devstack sudo[100977]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1e32977e-fa92-49aa-b7b4-26b51985fa06 tempest-VolumesSnapshotListTestJSON-297471525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.4a506447-509d-4e58-8379-6f9b6f4894ea" returned: 0 in 0.706s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:40 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-1e32977e-fa92-49aa-b7b4-26b51985fa06 tempest-VolumesSnapshotListTestJSON-297471525 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8955b18-37ec-4299-a9ec-27ce792a85e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:03:40 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c27f1a75-4d6e-4489-996f-d8186ee29158 tempest-VolumesListTestJSON-1183749680 None] Lock "cinder-quobyte-5790a342-b9ef-4399-802e-cff1160db060" acquired by "delete_volume" :: waited 0.063s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:40 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-d91d4754-86e0-47f8-bfbd-badba54d6f5e tempest-VolumeQuotasNegativeTestJSON-936232115 None] Volume volume-a809cdc8-1c49-49d6-ae13-3746d5743dca (a809cdc8-1c49-49d6-ae13-3746d5743dca): created successfully Sep 28 15:03:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d91d4754-86e0-47f8-bfbd-badba54d6f5e tempest-VolumeQuotasNegativeTestJSON-936232115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c9ca3de-17dc-4774-99e4-200e6d503a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d91d4754-86e0-47f8-bfbd-badba54d6f5e tempest-VolumeQuotasNegativeTestJSON-936232115 None] Flow 'volume_create_manager' (594e9b63-b010-411e-99a5-09c7b9a72b8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:40 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d19c86-1f0f-4434-9c71-e3435536a6ae]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1e32977e-fa92-49aa-b7b4-26b51985fa06 tempest-VolumesSnapshotListTestJSON-297471525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.4b6703fd-3d07-46a7-9ae2-2611083908da {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:40 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d1e413-82cb-4ebc-bbac-63247a7db497]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c27f1a75-4d6e-4489-996f-d8186ee29158 tempest-VolumesListTestJSON-1183749680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5790a342-b9ef-4399-802e-cff1160db060 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:40 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-d91d4754-86e0-47f8-bfbd-badba54d6f5e tempest-VolumeQuotasNegativeTestJSON-936232115 None] Created volume successfully. Sep 28 15:03:40 devstack sudo[100986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.4b6703fd-3d07-46a7-9ae2-2611083908da Sep 28 15:03:40 devstack sudo[100986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:40 devstack sudo[100987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5790a342-b9ef-4399-802e-cff1160db060 Sep 28 15:03:40 devstack sudo[100987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:41 devstack sudo[100986]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1e32977e-fa92-49aa-b7b4-26b51985fa06 tempest-VolumesSnapshotListTestJSON-297471525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.4b6703fd-3d07-46a7-9ae2-2611083908da" returned: 0 in 0.480s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:41 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-1e32977e-fa92-49aa-b7b4-26b51985fa06 tempest-VolumesSnapshotListTestJSON-297471525 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8955b18-37ec-4299-a9ec-27ce792a85e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:03:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1e32977e-fa92-49aa-b7b4-26b51985fa06 tempest-VolumesSnapshotListTestJSON-297471525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.4a506447-509d-4e58-8379-6f9b6f4894ea {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:41 devstack sudo[100987]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c27f1a75-4d6e-4489-996f-d8186ee29158 tempest-VolumesListTestJSON-1183749680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5790a342-b9ef-4399-802e-cff1160db060" returned: 0 in 0.493s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c27f1a75-4d6e-4489-996f-d8186ee29158 tempest-VolumesListTestJSON-1183749680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5790a342-b9ef-4399-802e-cff1160db060 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:41 devstack sudo[100997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.4a506447-509d-4e58-8379-6f9b6f4894ea Sep 28 15:03:41 devstack sudo[100997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:41 devstack sudo[100998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5790a342-b9ef-4399-802e-cff1160db060 Sep 28 15:03:41 devstack sudo[100998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:41 devstack sudo[100998]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c27f1a75-4d6e-4489-996f-d8186ee29158 tempest-VolumesListTestJSON-1183749680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5790a342-b9ef-4399-802e-cff1160db060" returned: 0 in 0.346s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c27f1a75-4d6e-4489-996f-d8186ee29158 tempest-VolumesListTestJSON-1183749680 None] Lock "cinder-quobyte-5790a342-b9ef-4399-802e-cff1160db060" released by "delete_volume" :: held 0.932s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:41 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-c27f1a75-4d6e-4489-996f-d8186ee29158 tempest-VolumesListTestJSON-1183749680 None] Created reservations ['780a62fb-a211-4777-952a-8b08e4898521', '7e39c556-46f5-4113-80b2-f4b42db05a2f', 'a251626b-0d0c-4c74-b6cf-887d81bf18f3', '88a9fd9f-6f4c-4b06-85e0-54a237b65546'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:03:41 devstack sudo[100997]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1e32977e-fa92-49aa-b7b4-26b51985fa06 tempest-VolumesSnapshotListTestJSON-297471525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.4a506447-509d-4e58-8379-6f9b6f4894ea" returned: 0 in 0.643s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1e32977e-fa92-49aa-b7b4-26b51985fa06 tempest-VolumesSnapshotListTestJSON-297471525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.4a506447-509d-4e58-8379-6f9b6f4894ea {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c27f1a75-4d6e-4489-996f-d8186ee29158 tempest-VolumesListTestJSON-1183749680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c27f1a75-4d6e-4489-996f-d8186ee29158 tempest-VolumesListTestJSON-1183749680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:41 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c27f1a75-4d6e-4489-996f-d8186ee29158 tempest-VolumesListTestJSON-1183749680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:03:41 devstack sudo[101005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.4a506447-509d-4e58-8379-6f9b6f4894ea Sep 28 15:03:41 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c27f1a75-4d6e-4489-996f-d8186ee29158 tempest-VolumesListTestJSON-1183749680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:03:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c27f1a75-4d6e-4489-996f-d8186ee29158 tempest-VolumesListTestJSON-1183749680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:41 devstack sudo[101005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c27f1a75-4d6e-4489-996f-d8186ee29158 tempest-VolumesListTestJSON-1183749680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:42 devstack sudo[101007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:03:42 devstack sudo[101007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:42 devstack sudo[101005]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1e32977e-fa92-49aa-b7b4-26b51985fa06 tempest-VolumesSnapshotListTestJSON-297471525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.4a506447-509d-4e58-8379-6f9b6f4894ea" returned: 0 in 0.366s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:42 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1e32977e-fa92-49aa-b7b4-26b51985fa06 tempest-VolumesSnapshotListTestJSON-297471525 None] Lock "cinder-quobyte-4a506447-509d-4e58-8379-6f9b6f4894ea" released by "_delete_snapshot" :: held 2.455s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:42 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1e32977e-fa92-49aa-b7b4-26b51985fa06 tempest-VolumesSnapshotListTestJSON-297471525 None] Lock "cinder-quobyte-f8955b18-37ec-4299-a9ec-27ce792a85e5" released by "delete_snapshot" :: held 2.514s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:42 devstack sudo[101007]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c27f1a75-4d6e-4489-996f-d8186ee29158 tempest-VolumesListTestJSON-1183749680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.437s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:42 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-c27f1a75-4d6e-4489-996f-d8186ee29158 tempest-VolumesListTestJSON-1183749680 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:03:42 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-c27f1a75-4d6e-4489-996f-d8186ee29158 tempest-VolumesListTestJSON-1183749680 None] Deleted volume successfully. Sep 28 15:03:42 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c27f1a75-4d6e-4489-996f-d8186ee29158 tempest-VolumesListTestJSON-1183749680 None] Lock "cinder-5790a342-b9ef-4399-802e-cff1160db060-delete_volume" released by "delete_volume" :: held 1.860s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:42 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-1e32977e-fa92-49aa-b7b4-26b51985fa06 tempest-VolumesSnapshotListTestJSON-297471525 None] Created reservations ['3575a23c-69f4-433d-bc06-13d61c73157d', 'adafe4e2-1214-4a39-ab1c-addc9229fc05', '37a5082e-8652-49bf-b4ad-c492abc0897b', '059f75b3-d057-444f-9fbb-53f3e3f4ddc5'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:03:42 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-1e32977e-fa92-49aa-b7b4-26b51985fa06 tempest-VolumesSnapshotListTestJSON-297471525 None] Delete snapshot completed successfully. Sep 28 15:03:42 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1e32977e-fa92-49aa-b7b4-26b51985fa06 tempest-VolumesSnapshotListTestJSON-297471525 None] Lock "cinder-4a506447-509d-4e58-8379-6f9b6f4894ea-delete_snapshot" released by "delete_snapshot" :: held 2.766s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:42 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e6f67714-544e-494b-a0af-5530a62b13f9 tempest-VolumeQuotasNegativeTestJSON-936232115 None] Acquiring lock "cinder-a809cdc8-1c49-49d6-ae13-3746d5743dca-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:42 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e6f67714-544e-494b-a0af-5530a62b13f9 tempest-VolumeQuotasNegativeTestJSON-936232115 None] Lock "cinder-a809cdc8-1c49-49d6-ae13-3746d5743dca-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:42 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e6f67714-544e-494b-a0af-5530a62b13f9 tempest-VolumeQuotasNegativeTestJSON-936232115 None] Acquiring lock "cinder-quobyte-a809cdc8-1c49-49d6-ae13-3746d5743dca" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:42 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e6f67714-544e-494b-a0af-5530a62b13f9 tempest-VolumeQuotasNegativeTestJSON-936232115 None] Lock "cinder-quobyte-a809cdc8-1c49-49d6-ae13-3746d5743dca" acquired by "delete_volume" :: waited 0.038s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:43 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97a9f0e-16d3-4922-9d11-f3d246fe4543]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e6f67714-544e-494b-a0af-5530a62b13f9 tempest-VolumeQuotasNegativeTestJSON-936232115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a809cdc8-1c49-49d6-ae13-3746d5743dca {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-807d6c6e-6bd1-44b3-9c41-18c55d08285f tempest-VolumesSnapshotListTestJSON-297471525 None] Acquiring lock "cinder-4b6703fd-3d07-46a7-9ae2-2611083908da-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-807d6c6e-6bd1-44b3-9c41-18c55d08285f tempest-VolumesSnapshotListTestJSON-297471525 None] Lock "cinder-4b6703fd-3d07-46a7-9ae2-2611083908da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-807d6c6e-6bd1-44b3-9c41-18c55d08285f tempest-VolumesSnapshotListTestJSON-297471525 None] Acquiring lock "cinder-quobyte-f8955b18-37ec-4299-a9ec-27ce792a85e5" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-807d6c6e-6bd1-44b3-9c41-18c55d08285f tempest-VolumesSnapshotListTestJSON-297471525 None] Lock "cinder-quobyte-f8955b18-37ec-4299-a9ec-27ce792a85e5" acquired by "delete_snapshot" :: waited 0.061s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-807d6c6e-6bd1-44b3-9c41-18c55d08285f tempest-VolumesSnapshotListTestJSON-297471525 None] Acquiring lock "cinder-quobyte-4b6703fd-3d07-46a7-9ae2-2611083908da" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:43 devstack sudo[101011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a809cdc8-1c49-49d6-ae13-3746d5743dca Sep 28 15:03:43 devstack sudo[101011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-807d6c6e-6bd1-44b3-9c41-18c55d08285f tempest-VolumesSnapshotListTestJSON-297471525 None] Lock "cinder-quobyte-4b6703fd-3d07-46a7-9ae2-2611083908da" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:43 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-807d6c6e-6bd1-44b3-9c41-18c55d08285f tempest-VolumesSnapshotListTestJSON-297471525 None] Deleting offline snapshot 4b6703fd-3d07-46a7-9ae2-2611083908da of volume f8955b18-37ec-4299-a9ec-27ce792a85e5 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:03:43 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-807d6c6e-6bd1-44b3-9c41-18c55d08285f tempest-VolumesSnapshotListTestJSON-297471525 None] snapshot_file for this snap is: volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.4b6703fd-3d07-46a7-9ae2-2611083908da {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:03:43 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecffb9dd-2709-4fbf-81bd-655c53b24b4b]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-807d6c6e-6bd1-44b3-9c41-18c55d08285f tempest-VolumesSnapshotListTestJSON-297471525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.4b6703fd-3d07-46a7-9ae2-2611083908da {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:43 devstack sudo[101013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.4b6703fd-3d07-46a7-9ae2-2611083908da Sep 28 15:03:43 devstack sudo[101013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:43 devstack sudo[101011]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e6f67714-544e-494b-a0af-5530a62b13f9 tempest-VolumeQuotasNegativeTestJSON-936232115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a809cdc8-1c49-49d6-ae13-3746d5743dca" returned: 0 in 0.601s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e6f67714-544e-494b-a0af-5530a62b13f9 tempest-VolumeQuotasNegativeTestJSON-936232115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a809cdc8-1c49-49d6-ae13-3746d5743dca {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:43 devstack sudo[101018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a809cdc8-1c49-49d6-ae13-3746d5743dca Sep 28 15:03:43 devstack sudo[101018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:43 devstack sudo[101013]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-807d6c6e-6bd1-44b3-9c41-18c55d08285f tempest-VolumesSnapshotListTestJSON-297471525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.4b6703fd-3d07-46a7-9ae2-2611083908da" returned: 0 in 0.559s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:43 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-807d6c6e-6bd1-44b3-9c41-18c55d08285f tempest-VolumesSnapshotListTestJSON-297471525 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8955b18-37ec-4299-a9ec-27ce792a85e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:03:43 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[307128ae-215a-48a1-bde3-517c3015e2b7]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-807d6c6e-6bd1-44b3-9c41-18c55d08285f tempest-VolumesSnapshotListTestJSON-297471525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.a468afc1-dbb0-4caf-90e6-4d86ec5d58d5 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:43 devstack sudo[101018]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e6f67714-544e-494b-a0af-5530a62b13f9 tempest-VolumeQuotasNegativeTestJSON-936232115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a809cdc8-1c49-49d6-ae13-3746d5743dca" returned: 0 in 0.389s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:44 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e6f67714-544e-494b-a0af-5530a62b13f9 tempest-VolumeQuotasNegativeTestJSON-936232115 None] Lock "cinder-quobyte-a809cdc8-1c49-49d6-ae13-3746d5743dca" released by "delete_volume" :: held 1.064s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:44 devstack sudo[101026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.a468afc1-dbb0-4caf-90e6-4d86ec5d58d5 Sep 28 15:03:44 devstack sudo[101026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:44 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-e6f67714-544e-494b-a0af-5530a62b13f9 tempest-VolumeQuotasNegativeTestJSON-936232115 None] Created reservations ['039166b2-5fd6-4c5e-962d-6945b955f0cb', 'a791c483-299e-455b-b060-4ef08e3f8085', '4304c47c-b7a7-404e-8054-f6e4389a853f', 'c1fc62d6-8eae-413f-adac-9ada5a83b2cc'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:03:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e6f67714-544e-494b-a0af-5530a62b13f9 tempest-VolumeQuotasNegativeTestJSON-936232115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e6f67714-544e-494b-a0af-5530a62b13f9 tempest-VolumeQuotasNegativeTestJSON-936232115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:44 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e6f67714-544e-494b-a0af-5530a62b13f9 tempest-VolumeQuotasNegativeTestJSON-936232115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:03:44 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e6f67714-544e-494b-a0af-5530a62b13f9 tempest-VolumeQuotasNegativeTestJSON-936232115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:03:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e6f67714-544e-494b-a0af-5530a62b13f9 tempest-VolumeQuotasNegativeTestJSON-936232115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e6f67714-544e-494b-a0af-5530a62b13f9 tempest-VolumeQuotasNegativeTestJSON-936232115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:44 devstack sudo[101028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:03:44 devstack sudo[101028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:44 devstack sudo[101026]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-807d6c6e-6bd1-44b3-9c41-18c55d08285f tempest-VolumesSnapshotListTestJSON-297471525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.a468afc1-dbb0-4caf-90e6-4d86ec5d58d5" returned: 0 in 0.621s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:44 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-807d6c6e-6bd1-44b3-9c41-18c55d08285f tempest-VolumesSnapshotListTestJSON-297471525 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8955b18-37ec-4299-a9ec-27ce792a85e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:03:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-807d6c6e-6bd1-44b3-9c41-18c55d08285f tempest-VolumesSnapshotListTestJSON-297471525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.4b6703fd-3d07-46a7-9ae2-2611083908da {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:44 devstack sudo[101034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.4b6703fd-3d07-46a7-9ae2-2611083908da Sep 28 15:03:44 devstack sudo[101034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:44 devstack sudo[101028]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e6f67714-544e-494b-a0af-5530a62b13f9 tempest-VolumeQuotasNegativeTestJSON-936232115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.391s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:44 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-e6f67714-544e-494b-a0af-5530a62b13f9 tempest-VolumeQuotasNegativeTestJSON-936232115 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:03:44 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-e6f67714-544e-494b-a0af-5530a62b13f9 tempest-VolumeQuotasNegativeTestJSON-936232115 None] Deleted volume successfully. Sep 28 15:03:44 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e6f67714-544e-494b-a0af-5530a62b13f9 tempest-VolumeQuotasNegativeTestJSON-936232115 None] Lock "cinder-a809cdc8-1c49-49d6-ae13-3746d5743dca-delete_volume" released by "delete_volume" :: held 1.859s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:45 devstack sudo[101034]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-807d6c6e-6bd1-44b3-9c41-18c55d08285f tempest-VolumesSnapshotListTestJSON-297471525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.4b6703fd-3d07-46a7-9ae2-2611083908da" returned: 0 in 0.617s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-807d6c6e-6bd1-44b3-9c41-18c55d08285f tempest-VolumesSnapshotListTestJSON-297471525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.4b6703fd-3d07-46a7-9ae2-2611083908da {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:45 devstack sudo[101041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.4b6703fd-3d07-46a7-9ae2-2611083908da Sep 28 15:03:45 devstack sudo[101041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:45 devstack sudo[101041]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-807d6c6e-6bd1-44b3-9c41-18c55d08285f tempest-VolumesSnapshotListTestJSON-297471525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.4b6703fd-3d07-46a7-9ae2-2611083908da" returned: 0 in 0.446s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-807d6c6e-6bd1-44b3-9c41-18c55d08285f tempest-VolumesSnapshotListTestJSON-297471525 None] Lock "cinder-quobyte-4b6703fd-3d07-46a7-9ae2-2611083908da" released by "_delete_snapshot" :: held 2.447s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-807d6c6e-6bd1-44b3-9c41-18c55d08285f tempest-VolumesSnapshotListTestJSON-297471525 None] Lock "cinder-quobyte-f8955b18-37ec-4299-a9ec-27ce792a85e5" released by "delete_snapshot" :: held 2.491s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:45 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-807d6c6e-6bd1-44b3-9c41-18c55d08285f tempest-VolumesSnapshotListTestJSON-297471525 None] Created reservations ['c6e31f01-ab75-410e-97bb-bbe5d904694b', '9d12e4ab-4441-4586-838a-19e19ea667cd', '964f2753-bcb9-425d-b95b-3333942b87d0', '79d01ecc-0f11-4d4c-bb33-4b26212108df'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:03:45 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-807d6c6e-6bd1-44b3-9c41-18c55d08285f tempest-VolumesSnapshotListTestJSON-297471525 None] Delete snapshot completed successfully. Sep 28 15:03:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-807d6c6e-6bd1-44b3-9c41-18c55d08285f tempest-VolumesSnapshotListTestJSON-297471525 None] Lock "cinder-4b6703fd-3d07-46a7-9ae2-2611083908da-delete_snapshot" released by "delete_snapshot" :: held 2.744s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5ba5d150-422e-4d2f-a583-22e617b46706 tempest-VolumesSnapshotListTestJSON-297471525 None] Acquiring lock "cinder-a468afc1-dbb0-4caf-90e6-4d86ec5d58d5-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5ba5d150-422e-4d2f-a583-22e617b46706 tempest-VolumesSnapshotListTestJSON-297471525 None] Lock "cinder-a468afc1-dbb0-4caf-90e6-4d86ec5d58d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5ba5d150-422e-4d2f-a583-22e617b46706 tempest-VolumesSnapshotListTestJSON-297471525 None] Acquiring lock "cinder-quobyte-f8955b18-37ec-4299-a9ec-27ce792a85e5" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5ba5d150-422e-4d2f-a583-22e617b46706 tempest-VolumesSnapshotListTestJSON-297471525 None] Lock "cinder-quobyte-f8955b18-37ec-4299-a9ec-27ce792a85e5" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5ba5d150-422e-4d2f-a583-22e617b46706 tempest-VolumesSnapshotListTestJSON-297471525 None] Acquiring lock "cinder-quobyte-a468afc1-dbb0-4caf-90e6-4d86ec5d58d5" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5ba5d150-422e-4d2f-a583-22e617b46706 tempest-VolumesSnapshotListTestJSON-297471525 None] Lock "cinder-quobyte-a468afc1-dbb0-4caf-90e6-4d86ec5d58d5" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:46 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-5ba5d150-422e-4d2f-a583-22e617b46706 tempest-VolumesSnapshotListTestJSON-297471525 None] Deleting offline snapshot a468afc1-dbb0-4caf-90e6-4d86ec5d58d5 of volume f8955b18-37ec-4299-a9ec-27ce792a85e5 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:03:46 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-5ba5d150-422e-4d2f-a583-22e617b46706 tempest-VolumesSnapshotListTestJSON-297471525 None] snapshot_file for this snap is: volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.a468afc1-dbb0-4caf-90e6-4d86ec5d58d5 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:03:46 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2798482-b93d-4d8b-8b04-9c38675d95af]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5ba5d150-422e-4d2f-a583-22e617b46706 tempest-VolumesSnapshotListTestJSON-297471525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.a468afc1-dbb0-4caf-90e6-4d86ec5d58d5 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:46 devstack sudo[101045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.a468afc1-dbb0-4caf-90e6-4d86ec5d58d5 Sep 28 15:03:46 devstack sudo[101045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:47 devstack sudo[101045]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5ba5d150-422e-4d2f-a583-22e617b46706 tempest-VolumesSnapshotListTestJSON-297471525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.a468afc1-dbb0-4caf-90e6-4d86ec5d58d5" returned: 0 in 0.560s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:47 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-5ba5d150-422e-4d2f-a583-22e617b46706 tempest-VolumesSnapshotListTestJSON-297471525 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8955b18-37ec-4299-a9ec-27ce792a85e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:03:47 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[51842353-fe5f-4d47-86bc-750c86136da6]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5ba5d150-422e-4d2f-a583-22e617b46706 tempest-VolumesSnapshotListTestJSON-297471525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:47 devstack sudo[101050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5 Sep 28 15:03:47 devstack sudo[101050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:47 devstack sudo[101050]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5ba5d150-422e-4d2f-a583-22e617b46706 tempest-VolumesSnapshotListTestJSON-297471525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5" returned: 0 in 0.620s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5ba5d150-422e-4d2f-a583-22e617b46706 tempest-VolumesSnapshotListTestJSON-297471525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.a468afc1-dbb0-4caf-90e6-4d86ec5d58d5 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:47 devstack sudo[101056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.a468afc1-dbb0-4caf-90e6-4d86ec5d58d5 Sep 28 15:03:47 devstack sudo[101056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:48 devstack sudo[101056]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5ba5d150-422e-4d2f-a583-22e617b46706 tempest-VolumesSnapshotListTestJSON-297471525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.a468afc1-dbb0-4caf-90e6-4d86ec5d58d5" returned: 0 in 0.601s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5ba5d150-422e-4d2f-a583-22e617b46706 tempest-VolumesSnapshotListTestJSON-297471525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.a468afc1-dbb0-4caf-90e6-4d86ec5d58d5 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:48 devstack sudo[101061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.a468afc1-dbb0-4caf-90e6-4d86ec5d58d5 Sep 28 15:03:48 devstack sudo[101061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:48 devstack sudo[101061]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5ba5d150-422e-4d2f-a583-22e617b46706 tempest-VolumesSnapshotListTestJSON-297471525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5.a468afc1-dbb0-4caf-90e6-4d86ec5d58d5" returned: 0 in 0.397s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:48 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5ba5d150-422e-4d2f-a583-22e617b46706 tempest-VolumesSnapshotListTestJSON-297471525 None] Lock "cinder-quobyte-a468afc1-dbb0-4caf-90e6-4d86ec5d58d5" released by "_delete_snapshot" :: held 2.407s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:48 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5ba5d150-422e-4d2f-a583-22e617b46706 tempest-VolumesSnapshotListTestJSON-297471525 None] Lock "cinder-quobyte-f8955b18-37ec-4299-a9ec-27ce792a85e5" released by "delete_snapshot" :: held 2.458s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:49 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-5ba5d150-422e-4d2f-a583-22e617b46706 tempest-VolumesSnapshotListTestJSON-297471525 None] Created reservations ['cea2d206-8c01-435a-8044-cbe1d9d8d409', 'b7656e12-331f-4af1-bb33-80b6a9c1e19a', 'e8483c74-0d0d-4ac4-9a74-daf8bccf3b8c', 'b809c3e6-0080-486a-a769-7a66e933c610'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:03:49 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-5ba5d150-422e-4d2f-a583-22e617b46706 tempest-VolumesSnapshotListTestJSON-297471525 None] Delete snapshot completed successfully. Sep 28 15:03:49 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5ba5d150-422e-4d2f-a583-22e617b46706 tempest-VolumesSnapshotListTestJSON-297471525 None] Lock "cinder-a468afc1-dbb0-4caf-90e6-4d86ec5d58d5-delete_snapshot" released by "delete_snapshot" :: held 2.876s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:49 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc7be4d7-9754-4ee1-8b68-33614cf31a66 tempest-VolumesNegativeTest-1861125460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:03:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dc7be4d7-9754-4ee1-8b68-33614cf31a66 tempest-VolumesNegativeTest-1861125460 None] Flow 'volume_create_manager' (acded6aa-dc92-4dc8-b55c-734e6f00a15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dc7be4d7-9754-4ee1-8b68-33614cf31a66 tempest-VolumesNegativeTest-1861125460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfcdca9c-4346-47fb-8bc6-4bb988d45b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dc7be4d7-9754-4ee1-8b68-33614cf31a66 tempest-VolumesNegativeTest-1861125460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfcdca9c-4346-47fb-8bc6-4bb988d45b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-298584543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6202ecd-e794-47fd-98ac-c21723304c7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='154ca08c3edb4f3da82143a92d5db7e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:49Z,use_quota=True,user_id='07f00249f4824c518ddcdf62640cca7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dc7be4d7-9754-4ee1-8b68-33614cf31a66 tempest-VolumesNegativeTest-1861125460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce7fd7ec-7952-4933-8f6d-0a62754f0dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dc7be4d7-9754-4ee1-8b68-33614cf31a66 tempest-VolumesNegativeTest-1861125460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce7fd7ec-7952-4933-8f6d-0a62754f0dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dc7be4d7-9754-4ee1-8b68-33614cf31a66 tempest-VolumesNegativeTest-1861125460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97ca19ae-eba6-44fb-9a0f-6316bac86d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dc7be4d7-9754-4ee1-8b68-33614cf31a66 tempest-VolumesNegativeTest-1861125460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97ca19ae-eba6-44fb-9a0f-6316bac86d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6202ecd-e794-47fd-98ac-c21723304c7f', 'volume_name': 'volume-a6202ecd-e794-47fd-98ac-c21723304c7f', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dc7be4d7-9754-4ee1-8b68-33614cf31a66 tempest-VolumesNegativeTest-1861125460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (976c9c4c-ba23-4c2e-8732-4e9940cdc3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dc7be4d7-9754-4ee1-8b68-33614cf31a66 tempest-VolumesNegativeTest-1861125460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (976c9c4c-ba23-4c2e-8732-4e9940cdc3af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dc7be4d7-9754-4ee1-8b68-33614cf31a66 tempest-VolumesNegativeTest-1861125460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faeb0ffc-dfd0-4bbc-bb6d-f89faf20c85e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:49 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-dc7be4d7-9754-4ee1-8b68-33614cf31a66 tempest-VolumesNegativeTest-1861125460 None] Volume a6202ecd-e794-47fd-98ac-c21723304c7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6202ecd-e794-47fd-98ac-c21723304c7f', 'volume_size': 1} Sep 28 15:03:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dc7be4d7-9754-4ee1-8b68-33614cf31a66 tempest-VolumesNegativeTest-1861125460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dc7be4d7-9754-4ee1-8b68-33614cf31a66 tempest-VolumesNegativeTest-1861125460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-dc7be4d7-9754-4ee1-8b68-33614cf31a66 tempest-VolumesNegativeTest-1861125460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-298584543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6202ecd-e794-47fd-98ac-c21723304c7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='154ca08c3edb4f3da82143a92d5db7e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:49Z,use_quota=True,user_id='07f00249f4824c518ddcdf62640cca7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:03:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-dc7be4d7-9754-4ee1-8b68-33614cf31a66 tempest-VolumesNegativeTest-1861125460 None] Creating volume a6202ecd-e794-47fd-98ac-c21723304c7f {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:03:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dc7be4d7-9754-4ee1-8b68-33614cf31a66 tempest-VolumesNegativeTest-1861125460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dc7be4d7-9754-4ee1-8b68-33614cf31a66 tempest-VolumesNegativeTest-1861125460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-dc7be4d7-9754-4ee1-8b68-33614cf31a66 tempest-VolumesNegativeTest-1861125460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:03:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-dc7be4d7-9754-4ee1-8b68-33614cf31a66 tempest-VolumesNegativeTest-1861125460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:03:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dc7be4d7-9754-4ee1-8b68-33614cf31a66 tempest-VolumesNegativeTest-1861125460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-dc7be4d7-9754-4ee1-8b68-33614cf31a66 tempest-VolumesNegativeTest-1861125460 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:03:49 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-dc7be4d7-9754-4ee1-8b68-33614cf31a66 tempest-VolumesNegativeTest-1861125460 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:03:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dc7be4d7-9754-4ee1-8b68-33614cf31a66 tempest-VolumesNegativeTest-1861125460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a6202ecd-e794-47fd-98ac-c21723304c7f 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:49 devstack sudo[101064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a6202ecd-e794-47fd-98ac-c21723304c7f 1073741824 Sep 28 15:03:49 devstack sudo[101064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:49 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-35a2dace-b55c-41f3-becc-554c4b2996f2 tempest-VolumesSnapshotListTestJSON-297471525 None] Acquiring lock "cinder-f8955b18-37ec-4299-a9ec-27ce792a85e5-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:50 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-35a2dace-b55c-41f3-becc-554c4b2996f2 tempest-VolumesSnapshotListTestJSON-297471525 None] Lock "cinder-f8955b18-37ec-4299-a9ec-27ce792a85e5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:50 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-35a2dace-b55c-41f3-becc-554c4b2996f2 tempest-VolumesSnapshotListTestJSON-297471525 None] Acquiring lock "cinder-quobyte-f8955b18-37ec-4299-a9ec-27ce792a85e5" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:50 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-35a2dace-b55c-41f3-becc-554c4b2996f2 tempest-VolumesSnapshotListTestJSON-297471525 None] Lock "cinder-quobyte-f8955b18-37ec-4299-a9ec-27ce792a85e5" acquired by "delete_volume" :: waited 0.033s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:50 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0df23e-e3e0-4b29-a254-d3763998d125]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-35a2dace-b55c-41f3-becc-554c4b2996f2 tempest-VolumesSnapshotListTestJSON-297471525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:50 devstack sudo[101070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5 Sep 28 15:03:50 devstack sudo[101070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:50 devstack sudo[101064]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dc7be4d7-9754-4ee1-8b68-33614cf31a66 tempest-VolumesNegativeTest-1861125460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a6202ecd-e794-47fd-98ac-c21723304c7f 1073741824" returned: 0 in 0.892s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dc7be4d7-9754-4ee1-8b68-33614cf31a66 tempest-VolumesNegativeTest-1861125460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a6202ecd-e794-47fd-98ac-c21723304c7f {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:50 devstack sudo[101072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a6202ecd-e794-47fd-98ac-c21723304c7f Sep 28 15:03:50 devstack sudo[101072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:50 devstack sudo[101070]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-35a2dace-b55c-41f3-becc-554c4b2996f2 tempest-VolumesSnapshotListTestJSON-297471525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5" returned: 0 in 0.677s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-35a2dace-b55c-41f3-becc-554c4b2996f2 tempest-VolumesSnapshotListTestJSON-297471525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:50 devstack sudo[101078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5 Sep 28 15:03:50 devstack sudo[101078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:51 devstack sudo[101072]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dc7be4d7-9754-4ee1-8b68-33614cf31a66 tempest-VolumesNegativeTest-1861125460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a6202ecd-e794-47fd-98ac-c21723304c7f" returned: 0 in 0.444s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:51 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-dc7be4d7-9754-4ee1-8b68-33614cf31a66 tempest-VolumesNegativeTest-1861125460 None] <== create_volume: return (1412ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:03:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dc7be4d7-9754-4ee1-8b68-33614cf31a66 tempest-VolumesNegativeTest-1861125460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.415s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dc7be4d7-9754-4ee1-8b68-33614cf31a66 tempest-VolumesNegativeTest-1861125460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faeb0ffc-dfd0-4bbc-bb6d-f89faf20c85e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6202ecd-e794-47fd-98ac-c21723304c7f', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dc7be4d7-9754-4ee1-8b68-33614cf31a66 tempest-VolumesNegativeTest-1861125460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f4068dd-2d55-4db0-9962-02249b647494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:51 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-dc7be4d7-9754-4ee1-8b68-33614cf31a66 tempest-VolumesNegativeTest-1861125460 None] Volume volume-a6202ecd-e794-47fd-98ac-c21723304c7f (a6202ecd-e794-47fd-98ac-c21723304c7f): created successfully Sep 28 15:03:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dc7be4d7-9754-4ee1-8b68-33614cf31a66 tempest-VolumesNegativeTest-1861125460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f4068dd-2d55-4db0-9962-02249b647494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dc7be4d7-9754-4ee1-8b68-33614cf31a66 tempest-VolumesNegativeTest-1861125460 None] Flow 'volume_create_manager' (acded6aa-dc92-4dc8-b55c-734e6f00a15f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:51 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-dc7be4d7-9754-4ee1-8b68-33614cf31a66 tempest-VolumesNegativeTest-1861125460 None] Created volume successfully. Sep 28 15:03:51 devstack sudo[101078]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-35a2dace-b55c-41f3-becc-554c4b2996f2 tempest-VolumesSnapshotListTestJSON-297471525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f8955b18-37ec-4299-a9ec-27ce792a85e5" returned: 0 in 0.384s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:51 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-35a2dace-b55c-41f3-becc-554c4b2996f2 tempest-VolumesSnapshotListTestJSON-297471525 None] Lock "cinder-quobyte-f8955b18-37ec-4299-a9ec-27ce792a85e5" released by "delete_volume" :: held 1.172s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:51 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-35a2dace-b55c-41f3-becc-554c4b2996f2 tempest-VolumesSnapshotListTestJSON-297471525 None] Created reservations ['d4a70c88-f55a-4c0d-abbd-1cc312a0df97', 'cdc14c60-49f8-4c48-b5d7-a68a89957aab', '36306b1d-38ec-41f8-9e7b-e4a10018cd89', '07ede6f6-2871-45ac-8fb3-8bd868c5bdee'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:03:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-35a2dace-b55c-41f3-becc-554c4b2996f2 tempest-VolumesSnapshotListTestJSON-297471525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-35a2dace-b55c-41f3-becc-554c4b2996f2 tempest-VolumesSnapshotListTestJSON-297471525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:51 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-35a2dace-b55c-41f3-becc-554c4b2996f2 tempest-VolumesSnapshotListTestJSON-297471525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:03:51 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-35a2dace-b55c-41f3-becc-554c4b2996f2 tempest-VolumesSnapshotListTestJSON-297471525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:03:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-35a2dace-b55c-41f3-becc-554c4b2996f2 tempest-VolumesSnapshotListTestJSON-297471525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-35a2dace-b55c-41f3-becc-554c4b2996f2 tempest-VolumesSnapshotListTestJSON-297471525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:51 devstack sudo[101082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:03:51 devstack sudo[101082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:51 devstack sudo[101082]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-35a2dace-b55c-41f3-becc-554c4b2996f2 tempest-VolumesSnapshotListTestJSON-297471525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.347s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:51 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-35a2dace-b55c-41f3-becc-554c4b2996f2 tempest-VolumesSnapshotListTestJSON-297471525 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:03:51 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-35a2dace-b55c-41f3-becc-554c4b2996f2 tempest-VolumesSnapshotListTestJSON-297471525 None] Deleted volume successfully. Sep 28 15:03:51 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-35a2dace-b55c-41f3-becc-554c4b2996f2 tempest-VolumesSnapshotListTestJSON-297471525 None] Lock "cinder-f8955b18-37ec-4299-a9ec-27ce792a85e5-delete_volume" released by "delete_volume" :: held 1.865s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:56 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-c99d925b-f6c3-4037-9e62-cf03cf9a429c tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:03:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c99d925b-f6c3-4037-9e62-cf03cf9a429c tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] Flow 'volume_create_manager' (ffe765ec-5c1a-4c3f-8b31-afca8be34945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c99d925b-f6c3-4037-9e62-cf03cf9a429c tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01aabafd-b830-4852-a0ae-c76ce78de892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c99d925b-f6c3-4037-9e62-cf03cf9a429c tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01aabafd-b830-4852-a0ae-c76ce78de892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-409218398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d47c329-06d1-4ba2-ade8-570c908b3a1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9285372bd84d4845a95a005292c74161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:56Z,use_quota=True,user_id='0a4aef58ba754fc0ade401ecc5d740dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6ca49b5-9ea6-4d73-a35f-f6ec8df61c38),volume_type_id=f6ca49b5-9ea6-4d73-a35f-f6ec8df61c38)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c99d925b-f6c3-4037-9e62-cf03cf9a429c tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f96c6da-e9d8-4d6d-bf00-fdace13f4343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c99d925b-f6c3-4037-9e62-cf03cf9a429c tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f96c6da-e9d8-4d6d-bf00-fdace13f4343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c99d925b-f6c3-4037-9e62-cf03cf9a429c tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd0c5430-c0b6-4c79-bc88-89e173f1ce31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c99d925b-f6c3-4037-9e62-cf03cf9a429c tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd0c5430-c0b6-4c79-bc88-89e173f1ce31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d47c329-06d1-4ba2-ade8-570c908b3a1d', 'volume_name': 'volume-7d47c329-06d1-4ba2-ade8-570c908b3a1d', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c99d925b-f6c3-4037-9e62-cf03cf9a429c tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecde94b9-d6a5-4081-a336-9f0bc3e880d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c99d925b-f6c3-4037-9e62-cf03cf9a429c tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecde94b9-d6a5-4081-a336-9f0bc3e880d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c99d925b-f6c3-4037-9e62-cf03cf9a429c tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8e042a6-9fd9-4765-8807-f3abd7d78d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:56 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-c99d925b-f6c3-4037-9e62-cf03cf9a429c tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] Volume 7d47c329-06d1-4ba2-ade8-570c908b3a1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d47c329-06d1-4ba2-ade8-570c908b3a1d', 'volume_size': 1} Sep 28 15:03:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c99d925b-f6c3-4037-9e62-cf03cf9a429c tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c99d925b-f6c3-4037-9e62-cf03cf9a429c tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:56 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c99d925b-f6c3-4037-9e62-cf03cf9a429c tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-409218398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d47c329-06d1-4ba2-ade8-570c908b3a1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9285372bd84d4845a95a005292c74161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:56Z,use_quota=True,user_id='0a4aef58ba754fc0ade401ecc5d740dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6ca49b5-9ea6-4d73-a35f-f6ec8df61c38),volume_type_id=f6ca49b5-9ea6-4d73-a35f-f6ec8df61c38)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:03:56 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-c99d925b-f6c3-4037-9e62-cf03cf9a429c tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] Creating volume 7d47c329-06d1-4ba2-ade8-570c908b3a1d {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:03:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c99d925b-f6c3-4037-9e62-cf03cf9a429c tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c99d925b-f6c3-4037-9e62-cf03cf9a429c tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:56 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c99d925b-f6c3-4037-9e62-cf03cf9a429c tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:03:56 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c99d925b-f6c3-4037-9e62-cf03cf9a429c tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:03:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c99d925b-f6c3-4037-9e62-cf03cf9a429c tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:56 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c99d925b-f6c3-4037-9e62-cf03cf9a429c tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:03:56 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-c99d925b-f6c3-4037-9e62-cf03cf9a429c tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:03:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c99d925b-f6c3-4037-9e62-cf03cf9a429c tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7d47c329-06d1-4ba2-ade8-570c908b3a1d 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:56 devstack sudo[101105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7d47c329-06d1-4ba2-ade8-570c908b3a1d 1073741824 Sep 28 15:03:56 devstack sudo[101105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:57 devstack sudo[101105]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c99d925b-f6c3-4037-9e62-cf03cf9a429c tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7d47c329-06d1-4ba2-ade8-570c908b3a1d 1073741824" returned: 0 in 0.749s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c99d925b-f6c3-4037-9e62-cf03cf9a429c tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7d47c329-06d1-4ba2-ade8-570c908b3a1d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:57 devstack sudo[101111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7d47c329-06d1-4ba2-ade8-570c908b3a1d Sep 28 15:03:57 devstack sudo[101111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:57 devstack sudo[101111]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c99d925b-f6c3-4037-9e62-cf03cf9a429c tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7d47c329-06d1-4ba2-ade8-570c908b3a1d" returned: 0 in 0.373s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c99d925b-f6c3-4037-9e62-cf03cf9a429c tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] <== create_volume: return (1228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:03:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c99d925b-f6c3-4037-9e62-cf03cf9a429c tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.232s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c99d925b-f6c3-4037-9e62-cf03cf9a429c tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8e042a6-9fd9-4765-8807-f3abd7d78d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d47c329-06d1-4ba2-ade8-570c908b3a1d', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c99d925b-f6c3-4037-9e62-cf03cf9a429c tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efc9a024-01f9-47a7-99dd-d81f81f91e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:57 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-c99d925b-f6c3-4037-9e62-cf03cf9a429c tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] Volume volume-7d47c329-06d1-4ba2-ade8-570c908b3a1d (7d47c329-06d1-4ba2-ade8-570c908b3a1d): created successfully Sep 28 15:03:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c99d925b-f6c3-4037-9e62-cf03cf9a429c tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efc9a024-01f9-47a7-99dd-d81f81f91e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c99d925b-f6c3-4037-9e62-cf03cf9a429c tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] Flow 'volume_create_manager' (ffe765ec-5c1a-4c3f-8b31-afca8be34945) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:57 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-c99d925b-f6c3-4037-9e62-cf03cf9a429c tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] Created volume successfully. Sep 28 15:03:57 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7b6cae3-6021-4702-8e89-25cb81b049aa tempest-CinderUnicodeTest-1711760089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:03:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f7b6cae3-6021-4702-8e89-25cb81b049aa tempest-CinderUnicodeTest-1711760089 None] Flow 'volume_create_manager' (5ced592a-6a08-47d1-b833-0f0c7cf55f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f7b6cae3-6021-4702-8e89-25cb81b049aa tempest-CinderUnicodeTest-1711760089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8137b8a-a15b-4fab-8d3d-cead069ab8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f7b6cae3-6021-4702-8e89-25cb81b049aa tempest-CinderUnicodeTest-1711760089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8137b8a-a15b-4fab-8d3d-cead069ab8f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:58Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcf106ef-7d83-4cd1-94ea-c62477f4974b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d469a6cfdf1408997113b5e2d2a7169',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:58Z,use_quota=True,user_id='91c32ca5ce1547a6bdfdb9d53630e5af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f7b6cae3-6021-4702-8e89-25cb81b049aa tempest-CinderUnicodeTest-1711760089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4d12f3d-e0da-4041-ab29-c942db980f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f7b6cae3-6021-4702-8e89-25cb81b049aa tempest-CinderUnicodeTest-1711760089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4d12f3d-e0da-4041-ab29-c942db980f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f7b6cae3-6021-4702-8e89-25cb81b049aa tempest-CinderUnicodeTest-1711760089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee632550-d115-4834-af02-293498cc0d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f7b6cae3-6021-4702-8e89-25cb81b049aa tempest-CinderUnicodeTest-1711760089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee632550-d115-4834-af02-293498cc0d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcf106ef-7d83-4cd1-94ea-c62477f4974b', 'volume_name': 'volume-fcf106ef-7d83-4cd1-94ea-c62477f4974b', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f7b6cae3-6021-4702-8e89-25cb81b049aa tempest-CinderUnicodeTest-1711760089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b47629b3-6240-4b68-b35b-b1ee5f79b150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f7b6cae3-6021-4702-8e89-25cb81b049aa tempest-CinderUnicodeTest-1711760089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b47629b3-6240-4b68-b35b-b1ee5f79b150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f7b6cae3-6021-4702-8e89-25cb81b049aa tempest-CinderUnicodeTest-1711760089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ec0bdec-f92a-450b-a65a-da3dd9618347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:58 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-f7b6cae3-6021-4702-8e89-25cb81b049aa tempest-CinderUnicodeTest-1711760089 None] Volume fcf106ef-7d83-4cd1-94ea-c62477f4974b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcf106ef-7d83-4cd1-94ea-c62477f4974b', 'volume_size': 1} Sep 28 15:03:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f7b6cae3-6021-4702-8e89-25cb81b049aa tempest-CinderUnicodeTest-1711760089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f7b6cae3-6021-4702-8e89-25cb81b049aa tempest-CinderUnicodeTest-1711760089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f7b6cae3-6021-4702-8e89-25cb81b049aa tempest-CinderUnicodeTest-1711760089 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:58Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcf106ef-7d83-4cd1-94ea-c62477f4974b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d469a6cfdf1408997113b5e2d2a7169',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:58Z,use_quota=True,user_id='91c32ca5ce1547a6bdfdb9d53630e5af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:03:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-f7b6cae3-6021-4702-8e89-25cb81b049aa tempest-CinderUnicodeTest-1711760089 None] Creating volume fcf106ef-7d83-4cd1-94ea-c62477f4974b {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:03:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f7b6cae3-6021-4702-8e89-25cb81b049aa tempest-CinderUnicodeTest-1711760089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f7b6cae3-6021-4702-8e89-25cb81b049aa tempest-CinderUnicodeTest-1711760089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f7b6cae3-6021-4702-8e89-25cb81b049aa tempest-CinderUnicodeTest-1711760089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:03:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f7b6cae3-6021-4702-8e89-25cb81b049aa tempest-CinderUnicodeTest-1711760089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:03:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f7b6cae3-6021-4702-8e89-25cb81b049aa tempest-CinderUnicodeTest-1711760089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f7b6cae3-6021-4702-8e89-25cb81b049aa tempest-CinderUnicodeTest-1711760089 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:03:58 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-f7b6cae3-6021-4702-8e89-25cb81b049aa tempest-CinderUnicodeTest-1711760089 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:03:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f7b6cae3-6021-4702-8e89-25cb81b049aa tempest-CinderUnicodeTest-1711760089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-fcf106ef-7d83-4cd1-94ea-c62477f4974b 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:58 devstack sudo[101114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-fcf106ef-7d83-4cd1-94ea-c62477f4974b 1073741824 Sep 28 15:03:58 devstack sudo[101114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:58 devstack sudo[101114]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f7b6cae3-6021-4702-8e89-25cb81b049aa tempest-CinderUnicodeTest-1711760089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-fcf106ef-7d83-4cd1-94ea-c62477f4974b 1073741824" returned: 0 in 0.660s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f7b6cae3-6021-4702-8e89-25cb81b049aa tempest-CinderUnicodeTest-1711760089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-fcf106ef-7d83-4cd1-94ea-c62477f4974b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-670a55b1-fc8a-4ee6-b2e9-982a249d8f67 tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-670a55b1-fc8a-4ee6-b2e9-982a249d8f67 tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-670a55b1-fc8a-4ee6-b2e9-982a249d8f67 tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:03:58 devstack sudo[101120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-fcf106ef-7d83-4cd1-94ea-c62477f4974b Sep 28 15:03:58 devstack sudo[101120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-670a55b1-fc8a-4ee6-b2e9-982a249d8f67 tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:03:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-670a55b1-fc8a-4ee6-b2e9-982a249d8f67 tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-670a55b1-fc8a-4ee6-b2e9-982a249d8f67 tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:58 devstack sudo[101122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:03:58 devstack sudo[101122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:59 devstack sudo[101120]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f7b6cae3-6021-4702-8e89-25cb81b049aa tempest-CinderUnicodeTest-1711760089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-fcf106ef-7d83-4cd1-94ea-c62477f4974b" returned: 0 in 0.561s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f7b6cae3-6021-4702-8e89-25cb81b049aa tempest-CinderUnicodeTest-1711760089 None] <== create_volume: return (1313ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:03:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f7b6cae3-6021-4702-8e89-25cb81b049aa tempest-CinderUnicodeTest-1711760089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.318s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:59 devstack sudo[101122]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-670a55b1-fc8a-4ee6-b2e9-982a249d8f67 tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.529s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:59 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-670a55b1-fc8a-4ee6-b2e9-982a249d8f67 tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:03:59 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-670a55b1-fc8a-4ee6-b2e9-982a249d8f67 tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] Retype volume completed successfully. Sep 28 15:03:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f7b6cae3-6021-4702-8e89-25cb81b049aa tempest-CinderUnicodeTest-1711760089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ec0bdec-f92a-450b-a65a-da3dd9618347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcf106ef-7d83-4cd1-94ea-c62477f4974b', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f7b6cae3-6021-4702-8e89-25cb81b049aa tempest-CinderUnicodeTest-1711760089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98b3a964-1e12-4da9-a1c8-96767d978672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:59 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-f7b6cae3-6021-4702-8e89-25cb81b049aa tempest-CinderUnicodeTest-1711760089 None] Volume volume-fcf106ef-7d83-4cd1-94ea-c62477f4974b (fcf106ef-7d83-4cd1-94ea-c62477f4974b): created successfully Sep 28 15:03:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f7b6cae3-6021-4702-8e89-25cb81b049aa tempest-CinderUnicodeTest-1711760089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98b3a964-1e12-4da9-a1c8-96767d978672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f7b6cae3-6021-4702-8e89-25cb81b049aa tempest-CinderUnicodeTest-1711760089 None] Flow 'volume_create_manager' (5ced592a-6a08-47d1-b833-0f0c7cf55f15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:59 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-f7b6cae3-6021-4702-8e89-25cb81b049aa tempest-CinderUnicodeTest-1711760089 None] Created volume successfully. Sep 28 15:04:00 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-faa33c22-066b-40d2-a0e5-783d236dda89 tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] Acquiring lock "cinder-7d47c329-06d1-4ba2-ade8-570c908b3a1d-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:00 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-faa33c22-066b-40d2-a0e5-783d236dda89 tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] Lock "cinder-7d47c329-06d1-4ba2-ade8-570c908b3a1d-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:00 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-faa33c22-066b-40d2-a0e5-783d236dda89 tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] Acquiring lock "cinder-quobyte-7d47c329-06d1-4ba2-ade8-570c908b3a1d" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:00 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-faa33c22-066b-40d2-a0e5-783d236dda89 tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] Lock "cinder-quobyte-7d47c329-06d1-4ba2-ade8-570c908b3a1d" acquired by "delete_volume" :: waited 0.034s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:00 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[d516f622-f516-445d-9f48-3ec3348b1c99]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-faa33c22-066b-40d2-a0e5-783d236dda89 tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7d47c329-06d1-4ba2-ade8-570c908b3a1d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:00 devstack sudo[101126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7d47c329-06d1-4ba2-ade8-570c908b3a1d Sep 28 15:04:00 devstack sudo[101126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:00 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a579a93-b462-4fc7-9097-2dc06f072e50 tempest-CinderUnicodeTest-1711760089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:04:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4a579a93-b462-4fc7-9097-2dc06f072e50 tempest-CinderUnicodeTest-1711760089 None] Flow 'volume_create_manager' (eb8b6019-e626-4f13-9a18-3ca37ca331a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:04:00 devstack sudo[101126]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4a579a93-b462-4fc7-9097-2dc06f072e50 tempest-CinderUnicodeTest-1711760089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (926e1b34-c87e-4a57-b8bd-4496bceb1e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-faa33c22-066b-40d2-a0e5-783d236dda89 tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7d47c329-06d1-4ba2-ade8-570c908b3a1d" returned: 0 in 0.658s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-faa33c22-066b-40d2-a0e5-783d236dda89 tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7d47c329-06d1-4ba2-ade8-570c908b3a1d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4a579a93-b462-4fc7-9097-2dc06f072e50 tempest-CinderUnicodeTest-1711760089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (926e1b34-c87e-4a57-b8bd-4496bceb1e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:04:00Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2090486437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f633e33-d975-47ba-b830-1f3b06f7dfb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d469a6cfdf1408997113b5e2d2a7169',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:04:01Z,use_quota=True,user_id='91c32ca5ce1547a6bdfdb9d53630e5af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4a579a93-b462-4fc7-9097-2dc06f072e50 tempest-CinderUnicodeTest-1711760089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5370d0ef-b691-4980-b42a-bea91612be54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:00 devstack sudo[101134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7d47c329-06d1-4ba2-ade8-570c908b3a1d Sep 28 15:04:00 devstack sudo[101134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4a579a93-b462-4fc7-9097-2dc06f072e50 tempest-CinderUnicodeTest-1711760089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5370d0ef-b691-4980-b42a-bea91612be54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4a579a93-b462-4fc7-9097-2dc06f072e50 tempest-CinderUnicodeTest-1711760089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (312d5de0-b257-4167-966a-03aa01caeb95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4a579a93-b462-4fc7-9097-2dc06f072e50 tempest-CinderUnicodeTest-1711760089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (312d5de0-b257-4167-966a-03aa01caeb95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f633e33-d975-47ba-b830-1f3b06f7dfb9', 'volume_name': 'volume-9f633e33-d975-47ba-b830-1f3b06f7dfb9', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4a579a93-b462-4fc7-9097-2dc06f072e50 tempest-CinderUnicodeTest-1711760089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92dbfe0b-4c98-4bf0-9a5e-bcea362c01ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4a579a93-b462-4fc7-9097-2dc06f072e50 tempest-CinderUnicodeTest-1711760089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92dbfe0b-4c98-4bf0-9a5e-bcea362c01ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4a579a93-b462-4fc7-9097-2dc06f072e50 tempest-CinderUnicodeTest-1711760089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc2ed8af-1ea6-42f5-adff-c0432efa45d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:01 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-4a579a93-b462-4fc7-9097-2dc06f072e50 tempest-CinderUnicodeTest-1711760089 None] Volume 9f633e33-d975-47ba-b830-1f3b06f7dfb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f633e33-d975-47ba-b830-1f3b06f7dfb9', 'volume_size': 1} Sep 28 15:04:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4a579a93-b462-4fc7-9097-2dc06f072e50 tempest-CinderUnicodeTest-1711760089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4a579a93-b462-4fc7-9097-2dc06f072e50 tempest-CinderUnicodeTest-1711760089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4a579a93-b462-4fc7-9097-2dc06f072e50 tempest-CinderUnicodeTest-1711760089 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:04:00Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2090486437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f633e33-d975-47ba-b830-1f3b06f7dfb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d469a6cfdf1408997113b5e2d2a7169',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:04:01Z,use_quota=True,user_id='91c32ca5ce1547a6bdfdb9d53630e5af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:04:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-4a579a93-b462-4fc7-9097-2dc06f072e50 tempest-CinderUnicodeTest-1711760089 None] Creating volume 9f633e33-d975-47ba-b830-1f3b06f7dfb9 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:04:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4a579a93-b462-4fc7-9097-2dc06f072e50 tempest-CinderUnicodeTest-1711760089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4a579a93-b462-4fc7-9097-2dc06f072e50 tempest-CinderUnicodeTest-1711760089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4a579a93-b462-4fc7-9097-2dc06f072e50 tempest-CinderUnicodeTest-1711760089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:04:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4a579a93-b462-4fc7-9097-2dc06f072e50 tempest-CinderUnicodeTest-1711760089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:04:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4a579a93-b462-4fc7-9097-2dc06f072e50 tempest-CinderUnicodeTest-1711760089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4a579a93-b462-4fc7-9097-2dc06f072e50 tempest-CinderUnicodeTest-1711760089 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:04:01 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-4a579a93-b462-4fc7-9097-2dc06f072e50 tempest-CinderUnicodeTest-1711760089 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:04:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4a579a93-b462-4fc7-9097-2dc06f072e50 tempest-CinderUnicodeTest-1711760089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9f633e33-d975-47ba-b830-1f3b06f7dfb9 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:01 devstack sudo[101136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9f633e33-d975-47ba-b830-1f3b06f7dfb9 1073741824 Sep 28 15:04:01 devstack sudo[101136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:01 devstack sudo[101134]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-faa33c22-066b-40d2-a0e5-783d236dda89 tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7d47c329-06d1-4ba2-ade8-570c908b3a1d" returned: 0 in 0.403s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:01 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-faa33c22-066b-40d2-a0e5-783d236dda89 tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] Lock "cinder-quobyte-7d47c329-06d1-4ba2-ade8-570c908b3a1d" released by "delete_volume" :: held 1.144s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:01 devstack cinder-volume[87116]: WARNING cinder.quota [None req-faa33c22-066b-40d2-a0e5-783d236dda89 tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:04:01 devstack cinder-volume[87116]: WARNING cinder.quota [None req-faa33c22-066b-40d2-a0e5-783d236dda89 tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:04:01 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-faa33c22-066b-40d2-a0e5-783d236dda89 tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] Created reservations ['63848f28-6cdf-4d0f-9729-74a140563437', 'a83c3741-ee4c-4b7e-8b75-8cc5329c78f5', '7ef0a58e-d2d6-48c3-854c-922feed0eaf8', '0d872290-1c8f-4d78-87c7-e5330925eca8'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:04:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-faa33c22-066b-40d2-a0e5-783d236dda89 tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-faa33c22-066b-40d2-a0e5-783d236dda89 tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-faa33c22-066b-40d2-a0e5-783d236dda89 tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:04:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-faa33c22-066b-40d2-a0e5-783d236dda89 tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:04:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-faa33c22-066b-40d2-a0e5-783d236dda89 tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-faa33c22-066b-40d2-a0e5-783d236dda89 tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:01 devstack sudo[101142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:04:01 devstack sudo[101142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:01 devstack sudo[101136]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4a579a93-b462-4fc7-9097-2dc06f072e50 tempest-CinderUnicodeTest-1711760089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9f633e33-d975-47ba-b830-1f3b06f7dfb9 1073741824" returned: 0 in 0.836s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4a579a93-b462-4fc7-9097-2dc06f072e50 tempest-CinderUnicodeTest-1711760089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9f633e33-d975-47ba-b830-1f3b06f7dfb9 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:02 devstack sudo[101142]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-faa33c22-066b-40d2-a0e5-783d236dda89 tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.621s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:02 devstack sudo[101158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9f633e33-d975-47ba-b830-1f3b06f7dfb9 Sep 28 15:04:02 devstack sudo[101158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:02 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-faa33c22-066b-40d2-a0e5-783d236dda89 tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:04:02 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-faa33c22-066b-40d2-a0e5-783d236dda89 tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] Deleted volume successfully. Sep 28 15:04:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-faa33c22-066b-40d2-a0e5-783d236dda89 tempest-VolumeRetypeWithoutMigrationTest-1884940820 None] Lock "cinder-7d47c329-06d1-4ba2-ade8-570c908b3a1d-delete_volume" released by "delete_volume" :: held 2.175s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:02 devstack sudo[101158]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4a579a93-b462-4fc7-9097-2dc06f072e50 tempest-CinderUnicodeTest-1711760089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9f633e33-d975-47ba-b830-1f3b06f7dfb9" returned: 0 in 0.684s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4a579a93-b462-4fc7-9097-2dc06f072e50 tempest-CinderUnicodeTest-1711760089 None] <== create_volume: return (1770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:04:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4a579a93-b462-4fc7-9097-2dc06f072e50 tempest-CinderUnicodeTest-1711760089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.782s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4a579a93-b462-4fc7-9097-2dc06f072e50 tempest-CinderUnicodeTest-1711760089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc2ed8af-1ea6-42f5-adff-c0432efa45d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f633e33-d975-47ba-b830-1f3b06f7dfb9', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4a579a93-b462-4fc7-9097-2dc06f072e50 tempest-CinderUnicodeTest-1711760089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b7621dd-2e24-43b9-ab28-542c4f5a8f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:02 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-4a579a93-b462-4fc7-9097-2dc06f072e50 tempest-CinderUnicodeTest-1711760089 None] Volume volume-9f633e33-d975-47ba-b830-1f3b06f7dfb9 (9f633e33-d975-47ba-b830-1f3b06f7dfb9): created successfully Sep 28 15:04:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4a579a93-b462-4fc7-9097-2dc06f072e50 tempest-CinderUnicodeTest-1711760089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b7621dd-2e24-43b9-ab28-542c4f5a8f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4a579a93-b462-4fc7-9097-2dc06f072e50 tempest-CinderUnicodeTest-1711760089 None] Flow 'volume_create_manager' (eb8b6019-e626-4f13-9a18-3ca37ca331a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:04:03 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-4a579a93-b462-4fc7-9097-2dc06f072e50 tempest-CinderUnicodeTest-1711760089 None] Created volume successfully. Sep 28 15:04:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5d5b108c-9b88-4d7a-a02f-8aca32b4178c tempest-CinderUnicodeTest-1711760089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5d5b108c-9b88-4d7a-a02f-8aca32b4178c tempest-CinderUnicodeTest-1711760089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-5d5b108c-9b88-4d7a-a02f-8aca32b4178c tempest-CinderUnicodeTest-1711760089 None] Creating offline snapshot bbefcaae-b9e5-4fc3-8264-1dc97b4d4d5c of volume 9f633e33-d975-47ba-b830-1f3b06f7dfb9 {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:04:03 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[8532b989-87d4-4a76-b523-a3193f563808]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5d5b108c-9b88-4d7a-a02f-8aca32b4178c tempest-CinderUnicodeTest-1711760089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9f633e33-d975-47ba-b830-1f3b06f7dfb9 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:04 devstack sudo[101213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9f633e33-d975-47ba-b830-1f3b06f7dfb9 Sep 28 15:04:04 devstack sudo[101213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:04 devstack sudo[101213]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5d5b108c-9b88-4d7a-a02f-8aca32b4178c tempest-CinderUnicodeTest-1711760089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9f633e33-d975-47ba-b830-1f3b06f7dfb9" returned: 0 in 0.976s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5d5b108c-9b88-4d7a-a02f-8aca32b4178c tempest-CinderUnicodeTest-1711760089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9f633e33-d975-47ba-b830-1f3b06f7dfb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9f633e33-d975-47ba-b830-1f3b06f7dfb9.bbefcaae-b9e5-4fc3-8264-1dc97b4d4d5c 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:04 devstack sudo[101233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9f633e33-d975-47ba-b830-1f3b06f7dfb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9f633e33-d975-47ba-b830-1f3b06f7dfb9.bbefcaae-b9e5-4fc3-8264-1dc97b4d4d5c 1G Sep 28 15:04:04 devstack sudo[101233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:05 devstack sudo[101233]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5d5b108c-9b88-4d7a-a02f-8aca32b4178c tempest-CinderUnicodeTest-1711760089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9f633e33-d975-47ba-b830-1f3b06f7dfb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9f633e33-d975-47ba-b830-1f3b06f7dfb9.bbefcaae-b9e5-4fc3-8264-1dc97b4d4d5c 1G" returned: 0 in 0.945s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5d5b108c-9b88-4d7a-a02f-8aca32b4178c tempest-CinderUnicodeTest-1711760089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f633e33-d975-47ba-b830-1f3b06f7dfb9 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9f633e33-d975-47ba-b830-1f3b06f7dfb9.bbefcaae-b9e5-4fc3-8264-1dc97b4d4d5c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:05 devstack sudo[101241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f633e33-d975-47ba-b830-1f3b06f7dfb9 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9f633e33-d975-47ba-b830-1f3b06f7dfb9.bbefcaae-b9e5-4fc3-8264-1dc97b4d4d5c Sep 28 15:04:05 devstack sudo[101241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:06 devstack sudo[101241]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5d5b108c-9b88-4d7a-a02f-8aca32b4178c tempest-CinderUnicodeTest-1711760089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f633e33-d975-47ba-b830-1f3b06f7dfb9 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9f633e33-d975-47ba-b830-1f3b06f7dfb9.bbefcaae-b9e5-4fc3-8264-1dc97b4d4d5c" returned: 0 in 0.786s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:06 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-5d5b108c-9b88-4d7a-a02f-8aca32b4178c tempest-CinderUnicodeTest-1711760089 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9f633e33-d975-47ba-b830-1f3b06f7dfb9.bbefcaae-b9e5-4fc3-8264-1dc97b4d4d5c is being set with open permissions: ugo+rw Sep 28 15:04:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5d5b108c-9b88-4d7a-a02f-8aca32b4178c tempest-CinderUnicodeTest-1711760089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9f633e33-d975-47ba-b830-1f3b06f7dfb9.bbefcaae-b9e5-4fc3-8264-1dc97b4d4d5c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:06 devstack sudo[101247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9f633e33-d975-47ba-b830-1f3b06f7dfb9.bbefcaae-b9e5-4fc3-8264-1dc97b4d4d5c Sep 28 15:04:06 devstack sudo[101247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:06 devstack sudo[101247]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5d5b108c-9b88-4d7a-a02f-8aca32b4178c tempest-CinderUnicodeTest-1711760089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9f633e33-d975-47ba-b830-1f3b06f7dfb9.bbefcaae-b9e5-4fc3-8264-1dc97b4d4d5c" returned: 0 in 0.439s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5d5b108c-9b88-4d7a-a02f-8aca32b4178c tempest-CinderUnicodeTest-1711760089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9f633e33-d975-47ba-b830-1f3b06f7dfb9.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:07 devstack sudo[101250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9f633e33-d975-47ba-b830-1f3b06f7dfb9.info Sep 28 15:04:07 devstack sudo[101250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:07 devstack sudo[101250]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5d5b108c-9b88-4d7a-a02f-8aca32b4178c tempest-CinderUnicodeTest-1711760089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9f633e33-d975-47ba-b830-1f3b06f7dfb9.info" returned: 0 in 0.504s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:07 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-5d5b108c-9b88-4d7a-a02f-8aca32b4178c tempest-CinderUnicodeTest-1711760089 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9f633e33-d975-47ba-b830-1f3b06f7dfb9.info is being set with open permissions: ugo+rw Sep 28 15:04:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5d5b108c-9b88-4d7a-a02f-8aca32b4178c tempest-CinderUnicodeTest-1711760089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9f633e33-d975-47ba-b830-1f3b06f7dfb9.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:07 devstack sudo[101253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9f633e33-d975-47ba-b830-1f3b06f7dfb9.info Sep 28 15:04:07 devstack sudo[101253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:08 devstack sudo[101253]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5d5b108c-9b88-4d7a-a02f-8aca32b4178c tempest-CinderUnicodeTest-1711760089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9f633e33-d975-47ba-b830-1f3b06f7dfb9.info" returned: 0 in 0.684s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5d5b108c-9b88-4d7a-a02f-8aca32b4178c tempest-CinderUnicodeTest-1711760089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.536s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:08 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-5d5b108c-9b88-4d7a-a02f-8aca32b4178c tempest-CinderUnicodeTest-1711760089 None] Create snapshot completed successfully Sep 28 15:04:09 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-171c427e-38fc-4a11-9ce5-04015ec71d2a tempest-CinderUnicodeTest-1711760089 None] Acquiring lock "cinder-bbefcaae-b9e5-4fc3-8264-1dc97b4d4d5c-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:09 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-171c427e-38fc-4a11-9ce5-04015ec71d2a tempest-CinderUnicodeTest-1711760089 None] Lock "cinder-bbefcaae-b9e5-4fc3-8264-1dc97b4d4d5c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:09 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-171c427e-38fc-4a11-9ce5-04015ec71d2a tempest-CinderUnicodeTest-1711760089 None] Acquiring lock "cinder-quobyte-9f633e33-d975-47ba-b830-1f3b06f7dfb9" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:09 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-171c427e-38fc-4a11-9ce5-04015ec71d2a tempest-CinderUnicodeTest-1711760089 None] Lock "cinder-quobyte-9f633e33-d975-47ba-b830-1f3b06f7dfb9" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:09 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-171c427e-38fc-4a11-9ce5-04015ec71d2a tempest-CinderUnicodeTest-1711760089 None] Acquiring lock "cinder-quobyte-bbefcaae-b9e5-4fc3-8264-1dc97b4d4d5c" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:09 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-171c427e-38fc-4a11-9ce5-04015ec71d2a tempest-CinderUnicodeTest-1711760089 None] Lock "cinder-quobyte-bbefcaae-b9e5-4fc3-8264-1dc97b4d4d5c" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:09 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-171c427e-38fc-4a11-9ce5-04015ec71d2a tempest-CinderUnicodeTest-1711760089 None] Deleting offline snapshot bbefcaae-b9e5-4fc3-8264-1dc97b4d4d5c of volume 9f633e33-d975-47ba-b830-1f3b06f7dfb9 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:04:09 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-171c427e-38fc-4a11-9ce5-04015ec71d2a tempest-CinderUnicodeTest-1711760089 None] snapshot_file for this snap is: volume-9f633e33-d975-47ba-b830-1f3b06f7dfb9.bbefcaae-b9e5-4fc3-8264-1dc97b4d4d5c {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:04:09 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e238f6-d033-491a-83f5-fdc3789d65df]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-171c427e-38fc-4a11-9ce5-04015ec71d2a tempest-CinderUnicodeTest-1711760089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9f633e33-d975-47ba-b830-1f3b06f7dfb9.bbefcaae-b9e5-4fc3-8264-1dc97b4d4d5c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:09 devstack sudo[101281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9f633e33-d975-47ba-b830-1f3b06f7dfb9.bbefcaae-b9e5-4fc3-8264-1dc97b4d4d5c Sep 28 15:04:09 devstack sudo[101281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:10 devstack sudo[101281]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-171c427e-38fc-4a11-9ce5-04015ec71d2a tempest-CinderUnicodeTest-1711760089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9f633e33-d975-47ba-b830-1f3b06f7dfb9.bbefcaae-b9e5-4fc3-8264-1dc97b4d4d5c" returned: 0 in 0.684s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:10 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-171c427e-38fc-4a11-9ce5-04015ec71d2a tempest-CinderUnicodeTest-1711760089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f633e33-d975-47ba-b830-1f3b06f7dfb9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:04:10 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63453fb-89d6-4b84-a71b-24e1b1726199]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-171c427e-38fc-4a11-9ce5-04015ec71d2a tempest-CinderUnicodeTest-1711760089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9f633e33-d975-47ba-b830-1f3b06f7dfb9 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:10 devstack sudo[101287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9f633e33-d975-47ba-b830-1f3b06f7dfb9 Sep 28 15:04:10 devstack sudo[101287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:10 devstack sudo[101287]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-171c427e-38fc-4a11-9ce5-04015ec71d2a tempest-CinderUnicodeTest-1711760089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9f633e33-d975-47ba-b830-1f3b06f7dfb9" returned: 0 in 0.715s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-171c427e-38fc-4a11-9ce5-04015ec71d2a tempest-CinderUnicodeTest-1711760089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9f633e33-d975-47ba-b830-1f3b06f7dfb9.bbefcaae-b9e5-4fc3-8264-1dc97b4d4d5c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:10 devstack sudo[101295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9f633e33-d975-47ba-b830-1f3b06f7dfb9.bbefcaae-b9e5-4fc3-8264-1dc97b4d4d5c Sep 28 15:04:10 devstack sudo[101295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:11 devstack sudo[101295]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-171c427e-38fc-4a11-9ce5-04015ec71d2a tempest-CinderUnicodeTest-1711760089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9f633e33-d975-47ba-b830-1f3b06f7dfb9.bbefcaae-b9e5-4fc3-8264-1dc97b4d4d5c" returned: 0 in 0.629s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-171c427e-38fc-4a11-9ce5-04015ec71d2a tempest-CinderUnicodeTest-1711760089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9f633e33-d975-47ba-b830-1f3b06f7dfb9.bbefcaae-b9e5-4fc3-8264-1dc97b4d4d5c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:11 devstack sudo[101303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9f633e33-d975-47ba-b830-1f3b06f7dfb9.bbefcaae-b9e5-4fc3-8264-1dc97b4d4d5c Sep 28 15:04:11 devstack sudo[101303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:11 devstack sudo[101303]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-171c427e-38fc-4a11-9ce5-04015ec71d2a tempest-CinderUnicodeTest-1711760089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9f633e33-d975-47ba-b830-1f3b06f7dfb9.bbefcaae-b9e5-4fc3-8264-1dc97b4d4d5c" returned: 0 in 0.449s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:11 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=124,cinder:UPDATE=162,cinder:INSERT=35,cinder:DELETE=16 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:04:12 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=129,cinder:INSERT=42,cinder:UPDATE=164,cinder:DELETE=14 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:04:12 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-171c427e-38fc-4a11-9ce5-04015ec71d2a tempest-CinderUnicodeTest-1711760089 None] Lock "cinder-quobyte-bbefcaae-b9e5-4fc3-8264-1dc97b4d4d5c" released by "_delete_snapshot" :: held 2.734s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:12 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-171c427e-38fc-4a11-9ce5-04015ec71d2a tempest-CinderUnicodeTest-1711760089 None] Lock "cinder-quobyte-9f633e33-d975-47ba-b830-1f3b06f7dfb9" released by "delete_snapshot" :: held 2.798s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:12 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-171c427e-38fc-4a11-9ce5-04015ec71d2a tempest-CinderUnicodeTest-1711760089 None] Created reservations ['7a07f41a-89a6-4694-bacf-1665b5b9b309', '736239d1-2b7b-4056-ae13-ceb7182541d7', '62bf3160-ddf4-42f5-85b2-6d9b2b6cf37d', '7b435c41-e811-4efd-ae82-d7352153737f'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:04:12 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-171c427e-38fc-4a11-9ce5-04015ec71d2a tempest-CinderUnicodeTest-1711760089 None] Delete snapshot completed successfully. Sep 28 15:04:12 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-171c427e-38fc-4a11-9ce5-04015ec71d2a tempest-CinderUnicodeTest-1711760089 None] Lock "cinder-bbefcaae-b9e5-4fc3-8264-1dc97b4d4d5c-delete_snapshot" released by "delete_snapshot" :: held 3.204s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:12 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-49e20419-3cd9-4618-9402-b12194c93bc0 tempest-CinderUnicodeTest-1711760089 None] Acquiring lock "cinder-9f633e33-d975-47ba-b830-1f3b06f7dfb9-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:12 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-49e20419-3cd9-4618-9402-b12194c93bc0 tempest-CinderUnicodeTest-1711760089 None] Lock "cinder-9f633e33-d975-47ba-b830-1f3b06f7dfb9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:12 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-49e20419-3cd9-4618-9402-b12194c93bc0 tempest-CinderUnicodeTest-1711760089 None] Acquiring lock "cinder-quobyte-9f633e33-d975-47ba-b830-1f3b06f7dfb9" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:12 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-49e20419-3cd9-4618-9402-b12194c93bc0 tempest-CinderUnicodeTest-1711760089 None] Lock "cinder-quobyte-9f633e33-d975-47ba-b830-1f3b06f7dfb9" acquired by "delete_volume" :: waited 0.024s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:12 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c8edb3-087f-4824-a6a0-5e725e0cb9e0]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-49e20419-3cd9-4618-9402-b12194c93bc0 tempest-CinderUnicodeTest-1711760089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9f633e33-d975-47ba-b830-1f3b06f7dfb9 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:12 devstack sudo[101306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9f633e33-d975-47ba-b830-1f3b06f7dfb9 Sep 28 15:04:12 devstack sudo[101306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:13 devstack sudo[101306]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-49e20419-3cd9-4618-9402-b12194c93bc0 tempest-CinderUnicodeTest-1711760089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9f633e33-d975-47ba-b830-1f3b06f7dfb9" returned: 0 in 0.521s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-49e20419-3cd9-4618-9402-b12194c93bc0 tempest-CinderUnicodeTest-1711760089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9f633e33-d975-47ba-b830-1f3b06f7dfb9 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:13 devstack sudo[101311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9f633e33-d975-47ba-b830-1f3b06f7dfb9 Sep 28 15:04:13 devstack sudo[101311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:13 devstack sudo[101311]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-49e20419-3cd9-4618-9402-b12194c93bc0 tempest-CinderUnicodeTest-1711760089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9f633e33-d975-47ba-b830-1f3b06f7dfb9" returned: 0 in 0.403s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:13 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-49e20419-3cd9-4618-9402-b12194c93bc0 tempest-CinderUnicodeTest-1711760089 None] Lock "cinder-quobyte-9f633e33-d975-47ba-b830-1f3b06f7dfb9" released by "delete_volume" :: held 1.046s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:13 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-49e20419-3cd9-4618-9402-b12194c93bc0 tempest-CinderUnicodeTest-1711760089 None] Created reservations ['cac47908-efe3-4ad6-a772-cb5ca003705b', 'f4d14ed8-5ab3-419a-ab0c-b9af53d9440b', '6b8eed46-ea3b-4193-a5f9-b938673c6bf8', '512840ef-2a46-45cf-9803-4f6741bdb22e'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:04:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-49e20419-3cd9-4618-9402-b12194c93bc0 tempest-CinderUnicodeTest-1711760089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-49e20419-3cd9-4618-9402-b12194c93bc0 tempest-CinderUnicodeTest-1711760089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:14 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-49e20419-3cd9-4618-9402-b12194c93bc0 tempest-CinderUnicodeTest-1711760089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:04:14 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-49e20419-3cd9-4618-9402-b12194c93bc0 tempest-CinderUnicodeTest-1711760089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:04:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-49e20419-3cd9-4618-9402-b12194c93bc0 tempest-CinderUnicodeTest-1711760089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-49e20419-3cd9-4618-9402-b12194c93bc0 tempest-CinderUnicodeTest-1711760089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:14 devstack sudo[101314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:04:14 devstack sudo[101314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:14 devstack sudo[101314]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-49e20419-3cd9-4618-9402-b12194c93bc0 tempest-CinderUnicodeTest-1711760089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.386s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:14 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-49e20419-3cd9-4618-9402-b12194c93bc0 tempest-CinderUnicodeTest-1711760089 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:04:14 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-49e20419-3cd9-4618-9402-b12194c93bc0 tempest-CinderUnicodeTest-1711760089 None] Deleted volume successfully. Sep 28 15:04:14 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-49e20419-3cd9-4618-9402-b12194c93bc0 tempest-CinderUnicodeTest-1711760089 None] Lock "cinder-9f633e33-d975-47ba-b830-1f3b06f7dfb9-delete_volume" released by "delete_volume" :: held 1.817s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8b0c35d6-6763-4264-92d1-41925de9a98b tempest-CinderUnicodeTest-1711760089 None] Acquiring lock "cinder-fcf106ef-7d83-4cd1-94ea-c62477f4974b-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8b0c35d6-6763-4264-92d1-41925de9a98b tempest-CinderUnicodeTest-1711760089 None] Lock "cinder-fcf106ef-7d83-4cd1-94ea-c62477f4974b-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8b0c35d6-6763-4264-92d1-41925de9a98b tempest-CinderUnicodeTest-1711760089 None] Acquiring lock "cinder-quobyte-fcf106ef-7d83-4cd1-94ea-c62477f4974b" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8b0c35d6-6763-4264-92d1-41925de9a98b tempest-CinderUnicodeTest-1711760089 None] Lock "cinder-quobyte-fcf106ef-7d83-4cd1-94ea-c62477f4974b" acquired by "delete_volume" :: waited 0.021s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:15 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2fabe26-38c5-4d48-98af-3def230a0a86]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8b0c35d6-6763-4264-92d1-41925de9a98b tempest-CinderUnicodeTest-1711760089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-fcf106ef-7d83-4cd1-94ea-c62477f4974b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:15 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfd8b9b0-2150-426a-874f-8a3e935805e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:04:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dfd8b9b0-2150-426a-874f-8a3e935805e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Flow 'volume_create_manager' (4ff57ae9-cb32-40cd-a38f-97759888d68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:04:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dfd8b9b0-2150-426a-874f-8a3e935805e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16f80d99-68ca-4abf-a39d-bcb379a516d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dfd8b9b0-2150-426a-874f-8a3e935805e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16f80d99-68ca-4abf-a39d-bcb379a516d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1670919107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae006e8c-21b4-43e1-bfe6-d9c37d441852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4781209711c4c4ab8e8b2cd19685379',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:04:15Z,use_quota=True,user_id='80e9529ea5214165af31f382c18989f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dfd8b9b0-2150-426a-874f-8a3e935805e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d34d0d78-cc83-4595-a12c-9a93e8a67bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dfd8b9b0-2150-426a-874f-8a3e935805e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d34d0d78-cc83-4595-a12c-9a93e8a67bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dfd8b9b0-2150-426a-874f-8a3e935805e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb63a652-71fc-429f-90d1-05d2530167a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dfd8b9b0-2150-426a-874f-8a3e935805e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb63a652-71fc-429f-90d1-05d2530167a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae006e8c-21b4-43e1-bfe6-d9c37d441852', 'volume_name': 'volume-ae006e8c-21b4-43e1-bfe6-d9c37d441852', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dfd8b9b0-2150-426a-874f-8a3e935805e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2300ce8-09a9-436f-8ab5-a1168c597b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:15 devstack sudo[101317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-fcf106ef-7d83-4cd1-94ea-c62477f4974b Sep 28 15:04:15 devstack sudo[101317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dfd8b9b0-2150-426a-874f-8a3e935805e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2300ce8-09a9-436f-8ab5-a1168c597b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dfd8b9b0-2150-426a-874f-8a3e935805e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (213e6fc9-bf9f-41f0-ba46-762c0e10eac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:15 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-dfd8b9b0-2150-426a-874f-8a3e935805e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Volume ae006e8c-21b4-43e1-bfe6-d9c37d441852: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae006e8c-21b4-43e1-bfe6-d9c37d441852', 'volume_size': 1} Sep 28 15:04:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dfd8b9b0-2150-426a-874f-8a3e935805e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dfd8b9b0-2150-426a-874f-8a3e935805e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-dfd8b9b0-2150-426a-874f-8a3e935805e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1670919107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae006e8c-21b4-43e1-bfe6-d9c37d441852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4781209711c4c4ab8e8b2cd19685379',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:04:15Z,use_quota=True,user_id='80e9529ea5214165af31f382c18989f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:04:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-dfd8b9b0-2150-426a-874f-8a3e935805e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Creating volume ae006e8c-21b4-43e1-bfe6-d9c37d441852 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:04:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dfd8b9b0-2150-426a-874f-8a3e935805e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dfd8b9b0-2150-426a-874f-8a3e935805e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-dfd8b9b0-2150-426a-874f-8a3e935805e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:04:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-dfd8b9b0-2150-426a-874f-8a3e935805e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:04:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dfd8b9b0-2150-426a-874f-8a3e935805e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-dfd8b9b0-2150-426a-874f-8a3e935805e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:04:15 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-dfd8b9b0-2150-426a-874f-8a3e935805e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:04:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dfd8b9b0-2150-426a-874f-8a3e935805e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae006e8c-21b4-43e1-bfe6-d9c37d441852 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:15 devstack sudo[101319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae006e8c-21b4-43e1-bfe6-d9c37d441852 1073741824 Sep 28 15:04:15 devstack sudo[101319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:15 devstack sudo[101317]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8b0c35d6-6763-4264-92d1-41925de9a98b tempest-CinderUnicodeTest-1711760089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-fcf106ef-7d83-4cd1-94ea-c62477f4974b" returned: 0 in 0.498s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8b0c35d6-6763-4264-92d1-41925de9a98b tempest-CinderUnicodeTest-1711760089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-fcf106ef-7d83-4cd1-94ea-c62477f4974b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:15 devstack sudo[101327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-fcf106ef-7d83-4cd1-94ea-c62477f4974b Sep 28 15:04:15 devstack sudo[101327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:16 devstack sudo[101319]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dfd8b9b0-2150-426a-874f-8a3e935805e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae006e8c-21b4-43e1-bfe6-d9c37d441852 1073741824" returned: 0 in 0.617s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dfd8b9b0-2150-426a-874f-8a3e935805e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae006e8c-21b4-43e1-bfe6-d9c37d441852 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:16 devstack sudo[101331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae006e8c-21b4-43e1-bfe6-d9c37d441852 Sep 28 15:04:16 devstack sudo[101331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:16 devstack sudo[101327]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8b0c35d6-6763-4264-92d1-41925de9a98b tempest-CinderUnicodeTest-1711760089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-fcf106ef-7d83-4cd1-94ea-c62477f4974b" returned: 0 in 0.443s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:16 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8b0c35d6-6763-4264-92d1-41925de9a98b tempest-CinderUnicodeTest-1711760089 None] Lock "cinder-quobyte-fcf106ef-7d83-4cd1-94ea-c62477f4974b" released by "delete_volume" :: held 1.049s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:16 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-8b0c35d6-6763-4264-92d1-41925de9a98b tempest-CinderUnicodeTest-1711760089 None] Created reservations ['7d5ec5a5-bb05-43a5-bc0a-b949055ae0d3', 'f8be4740-bf1b-402d-89e4-65f71d2be354', '7ddfd50e-5764-474d-90bf-b529bf8468c0', 'fa10f0e9-aa1d-4080-ba13-990fc6dd4dc5'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:04:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8b0c35d6-6763-4264-92d1-41925de9a98b tempest-CinderUnicodeTest-1711760089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8b0c35d6-6763-4264-92d1-41925de9a98b tempest-CinderUnicodeTest-1711760089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:16 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8b0c35d6-6763-4264-92d1-41925de9a98b tempest-CinderUnicodeTest-1711760089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:04:16 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8b0c35d6-6763-4264-92d1-41925de9a98b tempest-CinderUnicodeTest-1711760089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:04:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8b0c35d6-6763-4264-92d1-41925de9a98b tempest-CinderUnicodeTest-1711760089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8b0c35d6-6763-4264-92d1-41925de9a98b tempest-CinderUnicodeTest-1711760089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:16 devstack sudo[101336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:04:16 devstack sudo[101336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:16 devstack sudo[101331]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dfd8b9b0-2150-426a-874f-8a3e935805e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae006e8c-21b4-43e1-bfe6-d9c37d441852" returned: 0 in 0.450s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:16 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-dfd8b9b0-2150-426a-874f-8a3e935805e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:04:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dfd8b9b0-2150-426a-874f-8a3e935805e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:16 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dfd8b9b0-2150-426a-874f-8a3e935805e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (213e6fc9-bf9f-41f0-ba46-762c0e10eac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae006e8c-21b4-43e1-bfe6-d9c37d441852', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:16 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dfd8b9b0-2150-426a-874f-8a3e935805e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae748e29-eecc-428f-862f-5dc4b352fc69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:16 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-dfd8b9b0-2150-426a-874f-8a3e935805e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Volume volume-ae006e8c-21b4-43e1-bfe6-d9c37d441852 (ae006e8c-21b4-43e1-bfe6-d9c37d441852): created successfully Sep 28 15:04:16 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dfd8b9b0-2150-426a-874f-8a3e935805e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae748e29-eecc-428f-862f-5dc4b352fc69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:16 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dfd8b9b0-2150-426a-874f-8a3e935805e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Flow 'volume_create_manager' (4ff57ae9-cb32-40cd-a38f-97759888d68b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:04:16 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-dfd8b9b0-2150-426a-874f-8a3e935805e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Created volume successfully. Sep 28 15:04:16 devstack sudo[101336]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8b0c35d6-6763-4264-92d1-41925de9a98b tempest-CinderUnicodeTest-1711760089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.321s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:16 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-8b0c35d6-6763-4264-92d1-41925de9a98b tempest-CinderUnicodeTest-1711760089 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:04:16 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-8b0c35d6-6763-4264-92d1-41925de9a98b tempest-CinderUnicodeTest-1711760089 None] Deleted volume successfully. Sep 28 15:04:16 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8b0c35d6-6763-4264-92d1-41925de9a98b tempest-CinderUnicodeTest-1711760089 None] Lock "cinder-fcf106ef-7d83-4cd1-94ea-c62477f4974b-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:16 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:04:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:16 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:04:16 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:04:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:17 devstack sudo[101341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:04:17 devstack sudo[101341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:17 devstack sudo[101341]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.324s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:17 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:04:17 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running periodic task VolumeManager._thread_info {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:04:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] thread count: 28 {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:04:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] thread info: [<_MainThread(MainThread, started 135146735652992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:04:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-743c0364-4a46-47d8-a7f9-b3b98e7f1aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-743c0364-4a46-47d8-a7f9-b3b98e7f1aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-743c0364-4a46-47d8-a7f9-b3b98e7f1aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Creating offline snapshot ca364a09-4712-49d0-9ae0-3db3a64837fc of volume ae006e8c-21b4-43e1-bfe6-d9c37d441852 {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:04:17 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61e2e66-ec70-4529-b9dd-0a709b24e8c2]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-743c0364-4a46-47d8-a7f9-b3b98e7f1aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae006e8c-21b4-43e1-bfe6-d9c37d441852 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:18 devstack sudo[101344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae006e8c-21b4-43e1-bfe6-d9c37d441852 Sep 28 15:04:18 devstack sudo[101344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:18 devstack sudo[101344]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-743c0364-4a46-47d8-a7f9-b3b98e7f1aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae006e8c-21b4-43e1-bfe6-d9c37d441852" returned: 0 in 0.591s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-743c0364-4a46-47d8-a7f9-b3b98e7f1aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae006e8c-21b4-43e1-bfe6-d9c37d441852,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae006e8c-21b4-43e1-bfe6-d9c37d441852.ca364a09-4712-49d0-9ae0-3db3a64837fc 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:18 devstack sudo[101350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae006e8c-21b4-43e1-bfe6-d9c37d441852,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae006e8c-21b4-43e1-bfe6-d9c37d441852.ca364a09-4712-49d0-9ae0-3db3a64837fc 1G Sep 28 15:04:18 devstack sudo[101350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:19 devstack sudo[101350]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-743c0364-4a46-47d8-a7f9-b3b98e7f1aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae006e8c-21b4-43e1-bfe6-d9c37d441852,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae006e8c-21b4-43e1-bfe6-d9c37d441852.ca364a09-4712-49d0-9ae0-3db3a64837fc 1G" returned: 0 in 0.946s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-743c0364-4a46-47d8-a7f9-b3b98e7f1aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae006e8c-21b4-43e1-bfe6-d9c37d441852 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae006e8c-21b4-43e1-bfe6-d9c37d441852.ca364a09-4712-49d0-9ae0-3db3a64837fc {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:19 devstack sudo[101368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae006e8c-21b4-43e1-bfe6-d9c37d441852 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae006e8c-21b4-43e1-bfe6-d9c37d441852.ca364a09-4712-49d0-9ae0-3db3a64837fc Sep 28 15:04:19 devstack sudo[101368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:19 devstack sudo[101368]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-743c0364-4a46-47d8-a7f9-b3b98e7f1aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae006e8c-21b4-43e1-bfe6-d9c37d441852 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae006e8c-21b4-43e1-bfe6-d9c37d441852.ca364a09-4712-49d0-9ae0-3db3a64837fc" returned: 0 in 0.553s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:19 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-743c0364-4a46-47d8-a7f9-b3b98e7f1aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae006e8c-21b4-43e1-bfe6-d9c37d441852.ca364a09-4712-49d0-9ae0-3db3a64837fc is being set with open permissions: ugo+rw Sep 28 15:04:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-743c0364-4a46-47d8-a7f9-b3b98e7f1aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae006e8c-21b4-43e1-bfe6-d9c37d441852.ca364a09-4712-49d0-9ae0-3db3a64837fc {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:19 devstack sudo[101378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae006e8c-21b4-43e1-bfe6-d9c37d441852.ca364a09-4712-49d0-9ae0-3db3a64837fc Sep 28 15:04:19 devstack sudo[101378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:20 devstack sudo[101378]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-743c0364-4a46-47d8-a7f9-b3b98e7f1aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae006e8c-21b4-43e1-bfe6-d9c37d441852.ca364a09-4712-49d0-9ae0-3db3a64837fc" returned: 0 in 0.354s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-743c0364-4a46-47d8-a7f9-b3b98e7f1aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae006e8c-21b4-43e1-bfe6-d9c37d441852.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:20 devstack sudo[101381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae006e8c-21b4-43e1-bfe6-d9c37d441852.info Sep 28 15:04:20 devstack sudo[101381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:20 devstack sudo[101381]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-743c0364-4a46-47d8-a7f9-b3b98e7f1aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae006e8c-21b4-43e1-bfe6-d9c37d441852.info" returned: 0 in 0.384s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:20 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-743c0364-4a46-47d8-a7f9-b3b98e7f1aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae006e8c-21b4-43e1-bfe6-d9c37d441852.info is being set with open permissions: ugo+rw Sep 28 15:04:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-743c0364-4a46-47d8-a7f9-b3b98e7f1aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae006e8c-21b4-43e1-bfe6-d9c37d441852.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:20 devstack sudo[101385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae006e8c-21b4-43e1-bfe6-d9c37d441852.info Sep 28 15:04:20 devstack sudo[101385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:21 devstack sudo[101385]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-743c0364-4a46-47d8-a7f9-b3b98e7f1aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae006e8c-21b4-43e1-bfe6-d9c37d441852.info" returned: 0 in 0.409s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-743c0364-4a46-47d8-a7f9-b3b98e7f1aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.415s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:21 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-743c0364-4a46-47d8-a7f9-b3b98e7f1aeb tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Create snapshot completed successfully Sep 28 15:04:23 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2ae0c303-b325-485d-bfc0-d455d5a80011 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Acquiring lock "cinder-ca364a09-4712-49d0-9ae0-3db3a64837fc-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:23 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2ae0c303-b325-485d-bfc0-d455d5a80011 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Lock "cinder-ca364a09-4712-49d0-9ae0-3db3a64837fc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:23 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2ae0c303-b325-485d-bfc0-d455d5a80011 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Acquiring lock "cinder-quobyte-ae006e8c-21b4-43e1-bfe6-d9c37d441852" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:23 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2ae0c303-b325-485d-bfc0-d455d5a80011 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Lock "cinder-quobyte-ae006e8c-21b4-43e1-bfe6-d9c37d441852" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:23 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2ae0c303-b325-485d-bfc0-d455d5a80011 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Acquiring lock "cinder-quobyte-ca364a09-4712-49d0-9ae0-3db3a64837fc" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:23 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2ae0c303-b325-485d-bfc0-d455d5a80011 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Lock "cinder-quobyte-ca364a09-4712-49d0-9ae0-3db3a64837fc" acquired by "_delete_snapshot" :: waited 0.054s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:23 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-2ae0c303-b325-485d-bfc0-d455d5a80011 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Deleting offline snapshot ca364a09-4712-49d0-9ae0-3db3a64837fc of volume ae006e8c-21b4-43e1-bfe6-d9c37d441852 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:04:23 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-2ae0c303-b325-485d-bfc0-d455d5a80011 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] snapshot_file for this snap is: volume-ae006e8c-21b4-43e1-bfe6-d9c37d441852.ca364a09-4712-49d0-9ae0-3db3a64837fc {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:04:23 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd119aa9-188b-4490-a7bc-b91dd803414c]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2ae0c303-b325-485d-bfc0-d455d5a80011 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae006e8c-21b4-43e1-bfe6-d9c37d441852.ca364a09-4712-49d0-9ae0-3db3a64837fc {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:23 devstack sudo[101430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae006e8c-21b4-43e1-bfe6-d9c37d441852.ca364a09-4712-49d0-9ae0-3db3a64837fc Sep 28 15:04:23 devstack sudo[101430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:24 devstack sudo[101430]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2ae0c303-b325-485d-bfc0-d455d5a80011 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae006e8c-21b4-43e1-bfe6-d9c37d441852.ca364a09-4712-49d0-9ae0-3db3a64837fc" returned: 0 in 0.835s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:24 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-2ae0c303-b325-485d-bfc0-d455d5a80011 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae006e8c-21b4-43e1-bfe6-d9c37d441852(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:04:24 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b52437d-29b3-43cb-95e8-e8100a052012]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2ae0c303-b325-485d-bfc0-d455d5a80011 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae006e8c-21b4-43e1-bfe6-d9c37d441852 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:24 devstack sudo[101455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae006e8c-21b4-43e1-bfe6-d9c37d441852 Sep 28 15:04:24 devstack sudo[101455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:24 devstack sudo[101455]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2ae0c303-b325-485d-bfc0-d455d5a80011 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae006e8c-21b4-43e1-bfe6-d9c37d441852" returned: 0 in 0.530s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2ae0c303-b325-485d-bfc0-d455d5a80011 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae006e8c-21b4-43e1-bfe6-d9c37d441852.ca364a09-4712-49d0-9ae0-3db3a64837fc {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:24 devstack sudo[101480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae006e8c-21b4-43e1-bfe6-d9c37d441852.ca364a09-4712-49d0-9ae0-3db3a64837fc Sep 28 15:04:24 devstack sudo[101480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:25 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-effab36c-49e9-4145-94c6-dabab119f31f tempest-ProjectReaderTests-84381808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:04:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-effab36c-49e9-4145-94c6-dabab119f31f tempest-ProjectReaderTests-84381808 None] Flow 'volume_create_manager' (faa52983-0e46-4fd2-9818-dc2738ce2cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:04:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-effab36c-49e9-4145-94c6-dabab119f31f tempest-ProjectReaderTests-84381808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b90e4dbb-7693-473c-bbca-96541039d54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-effab36c-49e9-4145-94c6-dabab119f31f tempest-ProjectReaderTests-84381808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b90e4dbb-7693-473c-bbca-96541039d54e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:04:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1429622020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88e9a310-976f-4605-89a9-35c390c2b408,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d16b424925274ab0a3af321ce63b3145',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:04:25Z,use_quota=True,user_id='22ef3e818f2c4368b1a5004822176990',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-effab36c-49e9-4145-94c6-dabab119f31f tempest-ProjectReaderTests-84381808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e23fbfad-8fa8-4b0d-ba95-90fe05418e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-effab36c-49e9-4145-94c6-dabab119f31f tempest-ProjectReaderTests-84381808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e23fbfad-8fa8-4b0d-ba95-90fe05418e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-effab36c-49e9-4145-94c6-dabab119f31f tempest-ProjectReaderTests-84381808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec96d3f9-0621-4ac1-8744-cfcb8b47d9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-effab36c-49e9-4145-94c6-dabab119f31f tempest-ProjectReaderTests-84381808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec96d3f9-0621-4ac1-8744-cfcb8b47d9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88e9a310-976f-4605-89a9-35c390c2b408', 'volume_name': 'volume-88e9a310-976f-4605-89a9-35c390c2b408', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-effab36c-49e9-4145-94c6-dabab119f31f tempest-ProjectReaderTests-84381808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d81744aa-5afa-4e14-bf0f-5dc73b83d066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-effab36c-49e9-4145-94c6-dabab119f31f tempest-ProjectReaderTests-84381808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d81744aa-5afa-4e14-bf0f-5dc73b83d066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-effab36c-49e9-4145-94c6-dabab119f31f tempest-ProjectReaderTests-84381808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb2ff4e3-d618-44b1-86ce-7e18da53abe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:25 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-effab36c-49e9-4145-94c6-dabab119f31f tempest-ProjectReaderTests-84381808 None] Volume 88e9a310-976f-4605-89a9-35c390c2b408: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88e9a310-976f-4605-89a9-35c390c2b408', 'volume_size': 1} Sep 28 15:04:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-effab36c-49e9-4145-94c6-dabab119f31f tempest-ProjectReaderTests-84381808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-effab36c-49e9-4145-94c6-dabab119f31f tempest-ProjectReaderTests-84381808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:25 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-effab36c-49e9-4145-94c6-dabab119f31f tempest-ProjectReaderTests-84381808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:04:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1429622020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88e9a310-976f-4605-89a9-35c390c2b408,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d16b424925274ab0a3af321ce63b3145',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:04:25Z,use_quota=True,user_id='22ef3e818f2c4368b1a5004822176990',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:04:25 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-effab36c-49e9-4145-94c6-dabab119f31f tempest-ProjectReaderTests-84381808 None] Creating volume 88e9a310-976f-4605-89a9-35c390c2b408 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:04:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-effab36c-49e9-4145-94c6-dabab119f31f tempest-ProjectReaderTests-84381808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-effab36c-49e9-4145-94c6-dabab119f31f tempest-ProjectReaderTests-84381808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:25 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-effab36c-49e9-4145-94c6-dabab119f31f tempest-ProjectReaderTests-84381808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:04:25 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-effab36c-49e9-4145-94c6-dabab119f31f tempest-ProjectReaderTests-84381808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:04:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-effab36c-49e9-4145-94c6-dabab119f31f tempest-ProjectReaderTests-84381808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:25 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-effab36c-49e9-4145-94c6-dabab119f31f tempest-ProjectReaderTests-84381808 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:04:25 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-effab36c-49e9-4145-94c6-dabab119f31f tempest-ProjectReaderTests-84381808 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:04:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-effab36c-49e9-4145-94c6-dabab119f31f tempest-ProjectReaderTests-84381808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-88e9a310-976f-4605-89a9-35c390c2b408 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:25 devstack sudo[101483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-88e9a310-976f-4605-89a9-35c390c2b408 1073741824 Sep 28 15:04:25 devstack sudo[101483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:25 devstack sudo[101480]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2ae0c303-b325-485d-bfc0-d455d5a80011 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae006e8c-21b4-43e1-bfe6-d9c37d441852.ca364a09-4712-49d0-9ae0-3db3a64837fc" returned: 0 in 0.838s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2ae0c303-b325-485d-bfc0-d455d5a80011 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae006e8c-21b4-43e1-bfe6-d9c37d441852.ca364a09-4712-49d0-9ae0-3db3a64837fc {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:25 devstack sudo[101491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae006e8c-21b4-43e1-bfe6-d9c37d441852.ca364a09-4712-49d0-9ae0-3db3a64837fc Sep 28 15:04:25 devstack sudo[101491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8fed357a-ddb4-44e0-aaa8-fefadb5285f4 tempest-VolumesNegativeTest-1861125460 None] Acquiring lock "cinder-a6202ecd-e794-47fd-98ac-c21723304c7f-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8fed357a-ddb4-44e0-aaa8-fefadb5285f4 tempest-VolumesNegativeTest-1861125460 None] Lock "cinder-a6202ecd-e794-47fd-98ac-c21723304c7f-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:26 devstack sudo[101483]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-effab36c-49e9-4145-94c6-dabab119f31f tempest-ProjectReaderTests-84381808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-88e9a310-976f-4605-89a9-35c390c2b408 1073741824" returned: 0 in 0.768s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8fed357a-ddb4-44e0-aaa8-fefadb5285f4 tempest-VolumesNegativeTest-1861125460 None] Acquiring lock "cinder-quobyte-a6202ecd-e794-47fd-98ac-c21723304c7f" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:26 devstack sudo[101491]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2ae0c303-b325-485d-bfc0-d455d5a80011 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae006e8c-21b4-43e1-bfe6-d9c37d441852.ca364a09-4712-49d0-9ae0-3db3a64837fc" returned: 0 in 0.453s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8fed357a-ddb4-44e0-aaa8-fefadb5285f4 tempest-VolumesNegativeTest-1861125460 None] Lock "cinder-quobyte-a6202ecd-e794-47fd-98ac-c21723304c7f" acquired by "delete_volume" :: waited 0.031s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-effab36c-49e9-4145-94c6-dabab119f31f tempest-ProjectReaderTests-84381808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-88e9a310-976f-4605-89a9-35c390c2b408 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:26 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c63be56-9cc1-44d7-ac01-e4852465b929]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8fed357a-ddb4-44e0-aaa8-fefadb5285f4 tempest-VolumesNegativeTest-1861125460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a6202ecd-e794-47fd-98ac-c21723304c7f {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:26 devstack sudo[101495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-88e9a310-976f-4605-89a9-35c390c2b408 Sep 28 15:04:26 devstack sudo[101495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2ae0c303-b325-485d-bfc0-d455d5a80011 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Lock "cinder-quobyte-ca364a09-4712-49d0-9ae0-3db3a64837fc" released by "_delete_snapshot" :: held 2.955s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2ae0c303-b325-485d-bfc0-d455d5a80011 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Lock "cinder-quobyte-ae006e8c-21b4-43e1-bfe6-d9c37d441852" released by "delete_snapshot" :: held 3.031s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:26 devstack sudo[101496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a6202ecd-e794-47fd-98ac-c21723304c7f Sep 28 15:04:26 devstack sudo[101496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:26 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-2ae0c303-b325-485d-bfc0-d455d5a80011 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Created reservations ['a4e55db7-3031-4321-bcd3-09d01fd37f1c', 'aafcb73a-1ba6-43d1-8c94-cc1b03664d12', '5e13c873-c068-4af2-be0c-bd520646e40a', '50f3a349-11ca-4ce8-9775-96238ac30ec7'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:04:26 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-2ae0c303-b325-485d-bfc0-d455d5a80011 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Delete snapshot completed successfully. Sep 28 15:04:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2ae0c303-b325-485d-bfc0-d455d5a80011 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Lock "cinder-ca364a09-4712-49d0-9ae0-3db3a64837fc-delete_snapshot" released by "delete_snapshot" :: held 3.423s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:26 devstack sudo[101495]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-effab36c-49e9-4145-94c6-dabab119f31f tempest-ProjectReaderTests-84381808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-88e9a310-976f-4605-89a9-35c390c2b408" returned: 0 in 0.580s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-effab36c-49e9-4145-94c6-dabab119f31f tempest-ProjectReaderTests-84381808 None] <== create_volume: return (1454ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:04:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-effab36c-49e9-4145-94c6-dabab119f31f tempest-ProjectReaderTests-84381808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.463s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-effab36c-49e9-4145-94c6-dabab119f31f tempest-ProjectReaderTests-84381808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb2ff4e3-d618-44b1-86ce-7e18da53abe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88e9a310-976f-4605-89a9-35c390c2b408', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-effab36c-49e9-4145-94c6-dabab119f31f tempest-ProjectReaderTests-84381808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (507f9239-b9a9-4b1b-ab42-d7e1ce9d2402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:26 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-effab36c-49e9-4145-94c6-dabab119f31f tempest-ProjectReaderTests-84381808 None] Volume volume-88e9a310-976f-4605-89a9-35c390c2b408 (88e9a310-976f-4605-89a9-35c390c2b408): created successfully Sep 28 15:04:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-effab36c-49e9-4145-94c6-dabab119f31f tempest-ProjectReaderTests-84381808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (507f9239-b9a9-4b1b-ab42-d7e1ce9d2402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-effab36c-49e9-4145-94c6-dabab119f31f tempest-ProjectReaderTests-84381808 None] Flow 'volume_create_manager' (faa52983-0e46-4fd2-9818-dc2738ce2cbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:04:26 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-effab36c-49e9-4145-94c6-dabab119f31f tempest-ProjectReaderTests-84381808 None] Created volume successfully. Sep 28 15:04:26 devstack sudo[101496]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8fed357a-ddb4-44e0-aaa8-fefadb5285f4 tempest-VolumesNegativeTest-1861125460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a6202ecd-e794-47fd-98ac-c21723304c7f" returned: 0 in 0.728s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8fed357a-ddb4-44e0-aaa8-fefadb5285f4 tempest-VolumesNegativeTest-1861125460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a6202ecd-e794-47fd-98ac-c21723304c7f {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:26 devstack sudo[101505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a6202ecd-e794-47fd-98ac-c21723304c7f Sep 28 15:04:26 devstack sudo[101505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:27 devstack sudo[101505]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8fed357a-ddb4-44e0-aaa8-fefadb5285f4 tempest-VolumesNegativeTest-1861125460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a6202ecd-e794-47fd-98ac-c21723304c7f" returned: 0 in 0.390s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:27 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8fed357a-ddb4-44e0-aaa8-fefadb5285f4 tempest-VolumesNegativeTest-1861125460 None] Lock "cinder-quobyte-a6202ecd-e794-47fd-98ac-c21723304c7f" released by "delete_volume" :: held 1.191s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:27 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-98a744df-4264-4049-a570-052ea60bf1b6 tempest-ProjectReaderTests-84381808 None] Acquiring lock "cinder-88e9a310-976f-4605-89a9-35c390c2b408-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:27 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-98a744df-4264-4049-a570-052ea60bf1b6 tempest-ProjectReaderTests-84381808 None] Lock "cinder-88e9a310-976f-4605-89a9-35c390c2b408-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:27 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-8fed357a-ddb4-44e0-aaa8-fefadb5285f4 tempest-VolumesNegativeTest-1861125460 None] Created reservations ['a8cd3d26-f35e-4e4f-8bcc-1137e3e3a205', 'e7793b0e-d418-4a8d-ae8a-c6332b691223', '7aaec61d-d5ed-4dc5-b6c8-8c43ba007219', '15a92f44-2ac2-47f8-80e5-949c0b7e0fce'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:04:27 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-98a744df-4264-4049-a570-052ea60bf1b6 tempest-ProjectReaderTests-84381808 None] Acquiring lock "cinder-quobyte-88e9a310-976f-4605-89a9-35c390c2b408" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:27 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-98a744df-4264-4049-a570-052ea60bf1b6 tempest-ProjectReaderTests-84381808 None] Lock "cinder-quobyte-88e9a310-976f-4605-89a9-35c390c2b408" acquired by "delete_volume" :: waited 0.025s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:27 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f3d30d-6979-4909-a781-c28d6a9b0fc4]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-98a744df-4264-4049-a570-052ea60bf1b6 tempest-ProjectReaderTests-84381808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-88e9a310-976f-4605-89a9-35c390c2b408 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8fed357a-ddb4-44e0-aaa8-fefadb5285f4 tempest-VolumesNegativeTest-1861125460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8fed357a-ddb4-44e0-aaa8-fefadb5285f4 tempest-VolumesNegativeTest-1861125460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8fed357a-ddb4-44e0-aaa8-fefadb5285f4 tempest-VolumesNegativeTest-1861125460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:04:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8fed357a-ddb4-44e0-aaa8-fefadb5285f4 tempest-VolumesNegativeTest-1861125460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:04:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8fed357a-ddb4-44e0-aaa8-fefadb5285f4 tempest-VolumesNegativeTest-1861125460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8fed357a-ddb4-44e0-aaa8-fefadb5285f4 tempest-VolumesNegativeTest-1861125460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:27 devstack sudo[101509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:04:27 devstack sudo[101509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:27 devstack sudo[101508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-88e9a310-976f-4605-89a9-35c390c2b408 Sep 28 15:04:27 devstack sudo[101508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:27 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-32b12b19-c713-4fca-b87c-841e7ca610e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Acquiring lock "cinder-ae006e8c-21b4-43e1-bfe6-d9c37d441852-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:27 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-32b12b19-c713-4fca-b87c-841e7ca610e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Lock "cinder-ae006e8c-21b4-43e1-bfe6-d9c37d441852-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:27 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-32b12b19-c713-4fca-b87c-841e7ca610e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Acquiring lock "cinder-quobyte-ae006e8c-21b4-43e1-bfe6-d9c37d441852" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:28 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-32b12b19-c713-4fca-b87c-841e7ca610e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Lock "cinder-quobyte-ae006e8c-21b4-43e1-bfe6-d9c37d441852" acquired by "delete_volume" :: waited 0.024s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:28 devstack sudo[101509]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8fed357a-ddb4-44e0-aaa8-fefadb5285f4 tempest-VolumesNegativeTest-1861125460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.444s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:28 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-8fed357a-ddb4-44e0-aaa8-fefadb5285f4 tempest-VolumesNegativeTest-1861125460 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:04:28 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-8fed357a-ddb4-44e0-aaa8-fefadb5285f4 tempest-VolumesNegativeTest-1861125460 None] Deleted volume successfully. Sep 28 15:04:28 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf461fc1-6d6b-41fa-b78e-1383976dbb91]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-32b12b19-c713-4fca-b87c-841e7ca610e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae006e8c-21b4-43e1-bfe6-d9c37d441852 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:28 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8fed357a-ddb4-44e0-aaa8-fefadb5285f4 tempest-VolumesNegativeTest-1861125460 None] Lock "cinder-a6202ecd-e794-47fd-98ac-c21723304c7f-delete_volume" released by "delete_volume" :: held 2.067s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:28 devstack sudo[101508]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-98a744df-4264-4049-a570-052ea60bf1b6 tempest-ProjectReaderTests-84381808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-88e9a310-976f-4605-89a9-35c390c2b408" returned: 0 in 0.614s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-98a744df-4264-4049-a570-052ea60bf1b6 tempest-ProjectReaderTests-84381808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-88e9a310-976f-4605-89a9-35c390c2b408 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:28 devstack sudo[101517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-88e9a310-976f-4605-89a9-35c390c2b408 Sep 28 15:04:28 devstack sudo[101517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:28 devstack sudo[101516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae006e8c-21b4-43e1-bfe6-d9c37d441852 Sep 28 15:04:28 devstack sudo[101516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:28 devstack sudo[101516]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-32b12b19-c713-4fca-b87c-841e7ca610e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae006e8c-21b4-43e1-bfe6-d9c37d441852" returned: 0 in 0.613s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-32b12b19-c713-4fca-b87c-841e7ca610e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae006e8c-21b4-43e1-bfe6-d9c37d441852 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:28 devstack sudo[101525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae006e8c-21b4-43e1-bfe6-d9c37d441852 Sep 28 15:04:28 devstack sudo[101525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:28 devstack sudo[101517]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-98a744df-4264-4049-a570-052ea60bf1b6 tempest-ProjectReaderTests-84381808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-88e9a310-976f-4605-89a9-35c390c2b408" returned: 0 in 0.611s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:28 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-98a744df-4264-4049-a570-052ea60bf1b6 tempest-ProjectReaderTests-84381808 None] Lock "cinder-quobyte-88e9a310-976f-4605-89a9-35c390c2b408" released by "delete_volume" :: held 1.314s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:28 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-98a744df-4264-4049-a570-052ea60bf1b6 tempest-ProjectReaderTests-84381808 None] Created reservations ['90172f48-b1f7-42cb-85b7-52bec5047791', 'a31bd29e-4ebd-4dcb-8190-f4391be04e44', 'b070a08d-267a-414f-975f-8903229947a8', 'b549d067-7386-4494-8365-d2bc69089b63'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:04:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-98a744df-4264-4049-a570-052ea60bf1b6 tempest-ProjectReaderTests-84381808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-98a744df-4264-4049-a570-052ea60bf1b6 tempest-ProjectReaderTests-84381808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:29 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-98a744df-4264-4049-a570-052ea60bf1b6 tempest-ProjectReaderTests-84381808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:04:29 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-98a744df-4264-4049-a570-052ea60bf1b6 tempest-ProjectReaderTests-84381808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:04:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-98a744df-4264-4049-a570-052ea60bf1b6 tempest-ProjectReaderTests-84381808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-98a744df-4264-4049-a570-052ea60bf1b6 tempest-ProjectReaderTests-84381808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:29 devstack sudo[101527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:04:29 devstack sudo[101527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:29 devstack sudo[101525]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-32b12b19-c713-4fca-b87c-841e7ca610e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae006e8c-21b4-43e1-bfe6-d9c37d441852" returned: 0 in 0.645s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:29 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-32b12b19-c713-4fca-b87c-841e7ca610e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Lock "cinder-quobyte-ae006e8c-21b4-43e1-bfe6-d9c37d441852" released by "delete_volume" :: held 1.391s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:29 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-32b12b19-c713-4fca-b87c-841e7ca610e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Created reservations ['18555a9e-59e2-4083-893a-01eb4d89ed13', 'b0b84f3c-f53b-4bfb-988b-1b137b0c539e', '4086ba55-72f8-41ac-b00e-6deba8b5ebae', '2b04898a-293c-41f5-a80e-134cf1da5fb2'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:04:29 devstack sudo[101527]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-98a744df-4264-4049-a570-052ea60bf1b6 tempest-ProjectReaderTests-84381808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.451s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:29 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-98a744df-4264-4049-a570-052ea60bf1b6 tempest-ProjectReaderTests-84381808 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:04:29 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-98a744df-4264-4049-a570-052ea60bf1b6 tempest-ProjectReaderTests-84381808 None] Deleted volume successfully. Sep 28 15:04:29 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-98a744df-4264-4049-a570-052ea60bf1b6 tempest-ProjectReaderTests-84381808 None] Lock "cinder-88e9a310-976f-4605-89a9-35c390c2b408-delete_volume" released by "delete_volume" :: held 2.264s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-32b12b19-c713-4fca-b87c-841e7ca610e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-32b12b19-c713-4fca-b87c-841e7ca610e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:29 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-32b12b19-c713-4fca-b87c-841e7ca610e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:04:29 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-32b12b19-c713-4fca-b87c-841e7ca610e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:04:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-32b12b19-c713-4fca-b87c-841e7ca610e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-32b12b19-c713-4fca-b87c-841e7ca610e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:29 devstack sudo[101531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:04:29 devstack sudo[101531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:30 devstack sudo[101531]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-32b12b19-c713-4fca-b87c-841e7ca610e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.566s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:30 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-32b12b19-c713-4fca-b87c-841e7ca610e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:04:30 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-32b12b19-c713-4fca-b87c-841e7ca610e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Deleted volume successfully. Sep 28 15:04:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-32b12b19-c713-4fca-b87c-841e7ca610e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-943905268 None] Lock "cinder-ae006e8c-21b4-43e1-bfe6-d9c37d441852-delete_volume" released by "delete_volume" :: held 2.526s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:30 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-f70b1c2d-a75a-40c2-af4f-8d211b7da5ca tempest-ProjectReaderTests-84381808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:04:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f70b1c2d-a75a-40c2-af4f-8d211b7da5ca tempest-ProjectReaderTests-84381808 None] Flow 'volume_create_manager' (807f858d-ca27-483d-bf37-5fdd829869e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:04:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f70b1c2d-a75a-40c2-af4f-8d211b7da5ca tempest-ProjectReaderTests-84381808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d0c1f8c-0560-4da9-9d9b-f50c79fdb07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f70b1c2d-a75a-40c2-af4f-8d211b7da5ca tempest-ProjectReaderTests-84381808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d0c1f8c-0560-4da9-9d9b-f50c79fdb07c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:04:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1746714639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb1639a3-246f-493c-b40f-177d6559f2e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d16b424925274ab0a3af321ce63b3145',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:04:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:04:31Z,use_quota=True,user_id='22ef3e818f2c4368b1a5004822176990',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f70b1c2d-a75a-40c2-af4f-8d211b7da5ca tempest-ProjectReaderTests-84381808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dbd1522-e94b-44ff-ada6-bb78195bd6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f70b1c2d-a75a-40c2-af4f-8d211b7da5ca tempest-ProjectReaderTests-84381808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dbd1522-e94b-44ff-ada6-bb78195bd6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f70b1c2d-a75a-40c2-af4f-8d211b7da5ca tempest-ProjectReaderTests-84381808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ee44d38-f709-4dde-9ef4-40fe92966dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f70b1c2d-a75a-40c2-af4f-8d211b7da5ca tempest-ProjectReaderTests-84381808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ee44d38-f709-4dde-9ef4-40fe92966dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb1639a3-246f-493c-b40f-177d6559f2e4', 'volume_name': 'volume-bb1639a3-246f-493c-b40f-177d6559f2e4', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f70b1c2d-a75a-40c2-af4f-8d211b7da5ca tempest-ProjectReaderTests-84381808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa00b3a1-20dc-4b3d-be46-b64cee935ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f70b1c2d-a75a-40c2-af4f-8d211b7da5ca tempest-ProjectReaderTests-84381808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa00b3a1-20dc-4b3d-be46-b64cee935ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f70b1c2d-a75a-40c2-af4f-8d211b7da5ca tempest-ProjectReaderTests-84381808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc0013ca-ebfb-4631-8854-9dde36fad7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:30 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-f70b1c2d-a75a-40c2-af4f-8d211b7da5ca tempest-ProjectReaderTests-84381808 None] Volume bb1639a3-246f-493c-b40f-177d6559f2e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb1639a3-246f-493c-b40f-177d6559f2e4', 'volume_size': 1} Sep 28 15:04:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f70b1c2d-a75a-40c2-af4f-8d211b7da5ca tempest-ProjectReaderTests-84381808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f70b1c2d-a75a-40c2-af4f-8d211b7da5ca tempest-ProjectReaderTests-84381808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f70b1c2d-a75a-40c2-af4f-8d211b7da5ca tempest-ProjectReaderTests-84381808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:04:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1746714639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb1639a3-246f-493c-b40f-177d6559f2e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d16b424925274ab0a3af321ce63b3145',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:04:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:04:31Z,use_quota=True,user_id='22ef3e818f2c4368b1a5004822176990',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:04:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-f70b1c2d-a75a-40c2-af4f-8d211b7da5ca tempest-ProjectReaderTests-84381808 None] Creating volume bb1639a3-246f-493c-b40f-177d6559f2e4 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:04:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f70b1c2d-a75a-40c2-af4f-8d211b7da5ca tempest-ProjectReaderTests-84381808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f70b1c2d-a75a-40c2-af4f-8d211b7da5ca tempest-ProjectReaderTests-84381808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f70b1c2d-a75a-40c2-af4f-8d211b7da5ca tempest-ProjectReaderTests-84381808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:04:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f70b1c2d-a75a-40c2-af4f-8d211b7da5ca tempest-ProjectReaderTests-84381808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:04:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f70b1c2d-a75a-40c2-af4f-8d211b7da5ca tempest-ProjectReaderTests-84381808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f70b1c2d-a75a-40c2-af4f-8d211b7da5ca tempest-ProjectReaderTests-84381808 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:04:30 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-f70b1c2d-a75a-40c2-af4f-8d211b7da5ca tempest-ProjectReaderTests-84381808 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:04:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f70b1c2d-a75a-40c2-af4f-8d211b7da5ca tempest-ProjectReaderTests-84381808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bb1639a3-246f-493c-b40f-177d6559f2e4 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:30 devstack sudo[101536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bb1639a3-246f-493c-b40f-177d6559f2e4 1073741824 Sep 28 15:04:30 devstack sudo[101536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:31 devstack sudo[101536]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f70b1c2d-a75a-40c2-af4f-8d211b7da5ca tempest-ProjectReaderTests-84381808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bb1639a3-246f-493c-b40f-177d6559f2e4 1073741824" returned: 0 in 0.948s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f70b1c2d-a75a-40c2-af4f-8d211b7da5ca tempest-ProjectReaderTests-84381808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bb1639a3-246f-493c-b40f-177d6559f2e4 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:31 devstack sudo[101558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bb1639a3-246f-493c-b40f-177d6559f2e4 Sep 28 15:04:31 devstack sudo[101558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:32 devstack sudo[101558]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f70b1c2d-a75a-40c2-af4f-8d211b7da5ca tempest-ProjectReaderTests-84381808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bb1639a3-246f-493c-b40f-177d6559f2e4" returned: 0 in 0.626s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:32 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f70b1c2d-a75a-40c2-af4f-8d211b7da5ca tempest-ProjectReaderTests-84381808 None] <== create_volume: return (1668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:04:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f70b1c2d-a75a-40c2-af4f-8d211b7da5ca tempest-ProjectReaderTests-84381808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.671s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:32 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f70b1c2d-a75a-40c2-af4f-8d211b7da5ca tempest-ProjectReaderTests-84381808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc0013ca-ebfb-4631-8854-9dde36fad7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb1639a3-246f-493c-b40f-177d6559f2e4', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:32 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f70b1c2d-a75a-40c2-af4f-8d211b7da5ca tempest-ProjectReaderTests-84381808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea191c4e-87be-4d4d-8fb9-6f6586414a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:32 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-f70b1c2d-a75a-40c2-af4f-8d211b7da5ca tempest-ProjectReaderTests-84381808 None] Volume volume-bb1639a3-246f-493c-b40f-177d6559f2e4 (bb1639a3-246f-493c-b40f-177d6559f2e4): created successfully Sep 28 15:04:32 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f70b1c2d-a75a-40c2-af4f-8d211b7da5ca tempest-ProjectReaderTests-84381808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea191c4e-87be-4d4d-8fb9-6f6586414a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:32 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f70b1c2d-a75a-40c2-af4f-8d211b7da5ca tempest-ProjectReaderTests-84381808 None] Flow 'volume_create_manager' (807f858d-ca27-483d-bf37-5fdd829869e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:04:32 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-f70b1c2d-a75a-40c2-af4f-8d211b7da5ca tempest-ProjectReaderTests-84381808 None] Created volume successfully. Sep 28 15:04:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2c0f0988-dbde-4253-81c7-79728b15b998 tempest-ProjectReaderTests-84381808 None] Acquiring lock "cinder-bb1639a3-246f-493c-b40f-177d6559f2e4-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2c0f0988-dbde-4253-81c7-79728b15b998 tempest-ProjectReaderTests-84381808 None] Lock "cinder-bb1639a3-246f-493c-b40f-177d6559f2e4-delete_volume" acquired by "delete_volume" :: waited 0.098s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2c0f0988-dbde-4253-81c7-79728b15b998 tempest-ProjectReaderTests-84381808 None] Acquiring lock "cinder-quobyte-bb1639a3-246f-493c-b40f-177d6559f2e4" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2c0f0988-dbde-4253-81c7-79728b15b998 tempest-ProjectReaderTests-84381808 None] Lock "cinder-quobyte-bb1639a3-246f-493c-b40f-177d6559f2e4" acquired by "delete_volume" :: waited 0.044s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:33 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b71da9-d3a8-4389-b6f5-54e1301aa866]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2c0f0988-dbde-4253-81c7-79728b15b998 tempest-ProjectReaderTests-84381808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bb1639a3-246f-493c-b40f-177d6559f2e4 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:33 devstack sudo[101589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bb1639a3-246f-493c-b40f-177d6559f2e4 Sep 28 15:04:33 devstack sudo[101589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:34 devstack sudo[101589]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2c0f0988-dbde-4253-81c7-79728b15b998 tempest-ProjectReaderTests-84381808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bb1639a3-246f-493c-b40f-177d6559f2e4" returned: 0 in 0.602s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2c0f0988-dbde-4253-81c7-79728b15b998 tempest-ProjectReaderTests-84381808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bb1639a3-246f-493c-b40f-177d6559f2e4 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:34 devstack sudo[101594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bb1639a3-246f-493c-b40f-177d6559f2e4 Sep 28 15:04:34 devstack sudo[101594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:34 devstack sudo[101594]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2c0f0988-dbde-4253-81c7-79728b15b998 tempest-ProjectReaderTests-84381808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bb1639a3-246f-493c-b40f-177d6559f2e4" returned: 0 in 0.312s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:34 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2c0f0988-dbde-4253-81c7-79728b15b998 tempest-ProjectReaderTests-84381808 None] Lock "cinder-quobyte-bb1639a3-246f-493c-b40f-177d6559f2e4" released by "delete_volume" :: held 0.993s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:34 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-2c0f0988-dbde-4253-81c7-79728b15b998 tempest-ProjectReaderTests-84381808 None] Created reservations ['43d83122-6729-4d2c-9c3d-d13d2b9f2079', 'c734ac04-3c7a-4b1b-aace-d7892acb327f', 'f5c25c89-5934-4193-a477-c368a456579b', '9a4ed1f3-dcab-439c-be97-58cd3a1a0709'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:04:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2c0f0988-dbde-4253-81c7-79728b15b998 tempest-ProjectReaderTests-84381808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2c0f0988-dbde-4253-81c7-79728b15b998 tempest-ProjectReaderTests-84381808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:34 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2c0f0988-dbde-4253-81c7-79728b15b998 tempest-ProjectReaderTests-84381808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:04:34 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2c0f0988-dbde-4253-81c7-79728b15b998 tempest-ProjectReaderTests-84381808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:04:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2c0f0988-dbde-4253-81c7-79728b15b998 tempest-ProjectReaderTests-84381808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2c0f0988-dbde-4253-81c7-79728b15b998 tempest-ProjectReaderTests-84381808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:34 devstack sudo[101597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:04:34 devstack sudo[101597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:35 devstack sudo[101597]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2c0f0988-dbde-4253-81c7-79728b15b998 tempest-ProjectReaderTests-84381808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.380s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:35 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-2c0f0988-dbde-4253-81c7-79728b15b998 tempest-ProjectReaderTests-84381808 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:04:35 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-2c0f0988-dbde-4253-81c7-79728b15b998 tempest-ProjectReaderTests-84381808 None] Deleted volume successfully. Sep 28 15:04:35 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2c0f0988-dbde-4253-81c7-79728b15b998 tempest-ProjectReaderTests-84381808 None] Lock "cinder-bb1639a3-246f-493c-b40f-177d6559f2e4-delete_volume" released by "delete_volume" :: held 1.902s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:36 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-3797811a-523f-4db8-bca2-f6981fc257ea tempest-ProjectReaderTests-84381808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:04:36 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3797811a-523f-4db8-bca2-f6981fc257ea tempest-ProjectReaderTests-84381808 None] Flow 'volume_create_manager' (8b25aa8b-e0cf-4642-a8ca-648b6962faad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:04:36 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3797811a-523f-4db8-bca2-f6981fc257ea tempest-ProjectReaderTests-84381808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95d5220d-e933-46f7-9823-962e99ebae28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:36 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3797811a-523f-4db8-bca2-f6981fc257ea tempest-ProjectReaderTests-84381808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95d5220d-e933-46f7-9823-962e99ebae28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-841107090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3f16d04-c815-49b2-aac8-04ab7ca6efea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d16b424925274ab0a3af321ce63b3145',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:04:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:04:37Z,use_quota=True,user_id='22ef3e818f2c4368b1a5004822176990',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:36 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3797811a-523f-4db8-bca2-f6981fc257ea tempest-ProjectReaderTests-84381808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad395bb9-a342-47ca-8ece-93f431ae312e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:36 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3797811a-523f-4db8-bca2-f6981fc257ea tempest-ProjectReaderTests-84381808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad395bb9-a342-47ca-8ece-93f431ae312e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:36 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3797811a-523f-4db8-bca2-f6981fc257ea tempest-ProjectReaderTests-84381808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e8fac1e-a442-4b32-a36c-87887a5687d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:36 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3797811a-523f-4db8-bca2-f6981fc257ea tempest-ProjectReaderTests-84381808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e8fac1e-a442-4b32-a36c-87887a5687d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3f16d04-c815-49b2-aac8-04ab7ca6efea', 'volume_name': 'volume-e3f16d04-c815-49b2-aac8-04ab7ca6efea', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:36 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3797811a-523f-4db8-bca2-f6981fc257ea tempest-ProjectReaderTests-84381808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (357da121-4215-44c5-a682-b67949117ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:36 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3797811a-523f-4db8-bca2-f6981fc257ea tempest-ProjectReaderTests-84381808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (357da121-4215-44c5-a682-b67949117ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:36 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3797811a-523f-4db8-bca2-f6981fc257ea tempest-ProjectReaderTests-84381808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (798f42f9-8eda-42fd-a112-14effbbb340f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:36 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-3797811a-523f-4db8-bca2-f6981fc257ea tempest-ProjectReaderTests-84381808 None] Volume e3f16d04-c815-49b2-aac8-04ab7ca6efea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3f16d04-c815-49b2-aac8-04ab7ca6efea', 'volume_size': 1} Sep 28 15:04:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3797811a-523f-4db8-bca2-f6981fc257ea tempest-ProjectReaderTests-84381808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3797811a-523f-4db8-bca2-f6981fc257ea tempest-ProjectReaderTests-84381808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:36 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3797811a-523f-4db8-bca2-f6981fc257ea tempest-ProjectReaderTests-84381808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-841107090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3f16d04-c815-49b2-aac8-04ab7ca6efea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d16b424925274ab0a3af321ce63b3145',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:04:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:04:37Z,use_quota=True,user_id='22ef3e818f2c4368b1a5004822176990',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:04:36 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-3797811a-523f-4db8-bca2-f6981fc257ea tempest-ProjectReaderTests-84381808 None] Creating volume e3f16d04-c815-49b2-aac8-04ab7ca6efea {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:04:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3797811a-523f-4db8-bca2-f6981fc257ea tempest-ProjectReaderTests-84381808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3797811a-523f-4db8-bca2-f6981fc257ea tempest-ProjectReaderTests-84381808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:36 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3797811a-523f-4db8-bca2-f6981fc257ea tempest-ProjectReaderTests-84381808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:04:36 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3797811a-523f-4db8-bca2-f6981fc257ea tempest-ProjectReaderTests-84381808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:04:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3797811a-523f-4db8-bca2-f6981fc257ea tempest-ProjectReaderTests-84381808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:36 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3797811a-523f-4db8-bca2-f6981fc257ea tempest-ProjectReaderTests-84381808 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:04:36 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-3797811a-523f-4db8-bca2-f6981fc257ea tempest-ProjectReaderTests-84381808 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:04:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3797811a-523f-4db8-bca2-f6981fc257ea tempest-ProjectReaderTests-84381808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e3f16d04-c815-49b2-aac8-04ab7ca6efea 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:36 devstack sudo[101600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e3f16d04-c815-49b2-aac8-04ab7ca6efea 1073741824 Sep 28 15:04:36 devstack sudo[101600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:37 devstack sudo[101600]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3797811a-523f-4db8-bca2-f6981fc257ea tempest-ProjectReaderTests-84381808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e3f16d04-c815-49b2-aac8-04ab7ca6efea 1073741824" returned: 0 in 0.696s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3797811a-523f-4db8-bca2-f6981fc257ea tempest-ProjectReaderTests-84381808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e3f16d04-c815-49b2-aac8-04ab7ca6efea {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:37 devstack sudo[101605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e3f16d04-c815-49b2-aac8-04ab7ca6efea Sep 28 15:04:37 devstack sudo[101605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:37 devstack sudo[101605]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3797811a-523f-4db8-bca2-f6981fc257ea tempest-ProjectReaderTests-84381808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e3f16d04-c815-49b2-aac8-04ab7ca6efea" returned: 0 in 0.377s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:37 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3797811a-523f-4db8-bca2-f6981fc257ea tempest-ProjectReaderTests-84381808 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:04:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3797811a-523f-4db8-bca2-f6981fc257ea tempest-ProjectReaderTests-84381808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3797811a-523f-4db8-bca2-f6981fc257ea tempest-ProjectReaderTests-84381808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (798f42f9-8eda-42fd-a112-14effbbb340f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3f16d04-c815-49b2-aac8-04ab7ca6efea', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3797811a-523f-4db8-bca2-f6981fc257ea tempest-ProjectReaderTests-84381808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73e06357-92da-4409-a9b2-cb550b796825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:37 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-3797811a-523f-4db8-bca2-f6981fc257ea tempest-ProjectReaderTests-84381808 None] Volume volume-e3f16d04-c815-49b2-aac8-04ab7ca6efea (e3f16d04-c815-49b2-aac8-04ab7ca6efea): created successfully Sep 28 15:04:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3797811a-523f-4db8-bca2-f6981fc257ea tempest-ProjectReaderTests-84381808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73e06357-92da-4409-a9b2-cb550b796825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3797811a-523f-4db8-bca2-f6981fc257ea tempest-ProjectReaderTests-84381808 None] Flow 'volume_create_manager' (8b25aa8b-e0cf-4642-a8ca-648b6962faad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:04:38 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-3797811a-523f-4db8-bca2-f6981fc257ea tempest-ProjectReaderTests-84381808 None] Created volume successfully. Sep 28 15:04:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6eef7f91-7b56-4b61-b7a9-b1313b855fcb tempest-ProjectReaderTests-84381808 None] Acquiring lock "cinder-e3f16d04-c815-49b2-aac8-04ab7ca6efea-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6eef7f91-7b56-4b61-b7a9-b1313b855fcb tempest-ProjectReaderTests-84381808 None] Lock "cinder-e3f16d04-c815-49b2-aac8-04ab7ca6efea-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6eef7f91-7b56-4b61-b7a9-b1313b855fcb tempest-ProjectReaderTests-84381808 None] Acquiring lock "cinder-quobyte-e3f16d04-c815-49b2-aac8-04ab7ca6efea" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6eef7f91-7b56-4b61-b7a9-b1313b855fcb tempest-ProjectReaderTests-84381808 None] Lock "cinder-quobyte-e3f16d04-c815-49b2-aac8-04ab7ca6efea" acquired by "delete_volume" :: waited 0.035s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:39 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb515e27-6d9a-45e5-82ff-df469a7e48af]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6eef7f91-7b56-4b61-b7a9-b1313b855fcb tempest-ProjectReaderTests-84381808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e3f16d04-c815-49b2-aac8-04ab7ca6efea {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:39 devstack sudo[101608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e3f16d04-c815-49b2-aac8-04ab7ca6efea Sep 28 15:04:39 devstack sudo[101608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:39 devstack sudo[101608]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6eef7f91-7b56-4b61-b7a9-b1313b855fcb tempest-ProjectReaderTests-84381808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e3f16d04-c815-49b2-aac8-04ab7ca6efea" returned: 0 in 0.668s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6eef7f91-7b56-4b61-b7a9-b1313b855fcb tempest-ProjectReaderTests-84381808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e3f16d04-c815-49b2-aac8-04ab7ca6efea {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:39 devstack sudo[101614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e3f16d04-c815-49b2-aac8-04ab7ca6efea Sep 28 15:04:39 devstack sudo[101614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:40 devstack sudo[101614]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6eef7f91-7b56-4b61-b7a9-b1313b855fcb tempest-ProjectReaderTests-84381808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e3f16d04-c815-49b2-aac8-04ab7ca6efea" returned: 0 in 0.425s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:40 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6eef7f91-7b56-4b61-b7a9-b1313b855fcb tempest-ProjectReaderTests-84381808 None] Lock "cinder-quobyte-e3f16d04-c815-49b2-aac8-04ab7ca6efea" released by "delete_volume" :: held 1.241s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:40 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-6eef7f91-7b56-4b61-b7a9-b1313b855fcb tempest-ProjectReaderTests-84381808 None] Created reservations ['ac662b25-69d4-4c2a-afc0-cc28db3bff55', 'cc3dc06e-bd3c-42af-b416-821257826f3f', '62a21bbc-24d9-4383-bb6d-d1d5157b3ef2', 'e5e04b4a-4716-4461-986d-36561e0fad61'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:04:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6eef7f91-7b56-4b61-b7a9-b1313b855fcb tempest-ProjectReaderTests-84381808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6eef7f91-7b56-4b61-b7a9-b1313b855fcb tempest-ProjectReaderTests-84381808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:40 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-6eef7f91-7b56-4b61-b7a9-b1313b855fcb tempest-ProjectReaderTests-84381808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:04:40 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-6eef7f91-7b56-4b61-b7a9-b1313b855fcb tempest-ProjectReaderTests-84381808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:04:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6eef7f91-7b56-4b61-b7a9-b1313b855fcb tempest-ProjectReaderTests-84381808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6eef7f91-7b56-4b61-b7a9-b1313b855fcb tempest-ProjectReaderTests-84381808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:40 devstack sudo[101634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:04:40 devstack sudo[101634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:40 devstack sudo[101634]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6eef7f91-7b56-4b61-b7a9-b1313b855fcb tempest-ProjectReaderTests-84381808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.338s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:40 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-6eef7f91-7b56-4b61-b7a9-b1313b855fcb tempest-ProjectReaderTests-84381808 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:04:40 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-6eef7f91-7b56-4b61-b7a9-b1313b855fcb tempest-ProjectReaderTests-84381808 None] Deleted volume successfully. Sep 28 15:04:40 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6eef7f91-7b56-4b61-b7a9-b1313b855fcb tempest-ProjectReaderTests-84381808 None] Lock "cinder-e3f16d04-c815-49b2-aac8-04ab7ca6efea-delete_volume" released by "delete_volume" :: held 1.969s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:42 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-108547fa-7326-4519-903b-e5ebca25a717 tempest-ProjectReaderTests-84381808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:04:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-108547fa-7326-4519-903b-e5ebca25a717 tempest-ProjectReaderTests-84381808 None] Flow 'volume_create_manager' (8067c5b7-ba99-4a0e-ad80-b7b396a1724c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:04:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-108547fa-7326-4519-903b-e5ebca25a717 tempest-ProjectReaderTests-84381808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64270bba-a0ec-47b4-beaf-8ceb7ddec237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-108547fa-7326-4519-903b-e5ebca25a717 tempest-ProjectReaderTests-84381808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64270bba-a0ec-47b4-beaf-8ceb7ddec237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:04:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-476292470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30c5a154-d5dc-48c5-b503-d7f4248b3259,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d16b424925274ab0a3af321ce63b3145',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:04:42Z,use_quota=True,user_id='22ef3e818f2c4368b1a5004822176990',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-108547fa-7326-4519-903b-e5ebca25a717 tempest-ProjectReaderTests-84381808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d330460-08b2-4f9e-aab8-f94178bc0c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-108547fa-7326-4519-903b-e5ebca25a717 tempest-ProjectReaderTests-84381808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d330460-08b2-4f9e-aab8-f94178bc0c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-108547fa-7326-4519-903b-e5ebca25a717 tempest-ProjectReaderTests-84381808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (588f1335-2f7f-4d12-bc38-9004a44e7374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-108547fa-7326-4519-903b-e5ebca25a717 tempest-ProjectReaderTests-84381808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (588f1335-2f7f-4d12-bc38-9004a44e7374) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30c5a154-d5dc-48c5-b503-d7f4248b3259', 'volume_name': 'volume-30c5a154-d5dc-48c5-b503-d7f4248b3259', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-108547fa-7326-4519-903b-e5ebca25a717 tempest-ProjectReaderTests-84381808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a815a7c-e9e6-4da8-b6d8-6826ab297f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-108547fa-7326-4519-903b-e5ebca25a717 tempest-ProjectReaderTests-84381808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a815a7c-e9e6-4da8-b6d8-6826ab297f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-108547fa-7326-4519-903b-e5ebca25a717 tempest-ProjectReaderTests-84381808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c40a083a-cc1e-46ca-a9eb-a2d958fc2343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:42 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-108547fa-7326-4519-903b-e5ebca25a717 tempest-ProjectReaderTests-84381808 None] Volume 30c5a154-d5dc-48c5-b503-d7f4248b3259: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30c5a154-d5dc-48c5-b503-d7f4248b3259', 'volume_size': 1} Sep 28 15:04:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-108547fa-7326-4519-903b-e5ebca25a717 tempest-ProjectReaderTests-84381808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-108547fa-7326-4519-903b-e5ebca25a717 tempest-ProjectReaderTests-84381808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:42 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-108547fa-7326-4519-903b-e5ebca25a717 tempest-ProjectReaderTests-84381808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:04:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-476292470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30c5a154-d5dc-48c5-b503-d7f4248b3259,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d16b424925274ab0a3af321ce63b3145',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:04:42Z,use_quota=True,user_id='22ef3e818f2c4368b1a5004822176990',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:04:42 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-108547fa-7326-4519-903b-e5ebca25a717 tempest-ProjectReaderTests-84381808 None] Creating volume 30c5a154-d5dc-48c5-b503-d7f4248b3259 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:04:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-108547fa-7326-4519-903b-e5ebca25a717 tempest-ProjectReaderTests-84381808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-108547fa-7326-4519-903b-e5ebca25a717 tempest-ProjectReaderTests-84381808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:42 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-108547fa-7326-4519-903b-e5ebca25a717 tempest-ProjectReaderTests-84381808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:04:42 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-108547fa-7326-4519-903b-e5ebca25a717 tempest-ProjectReaderTests-84381808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:04:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-108547fa-7326-4519-903b-e5ebca25a717 tempest-ProjectReaderTests-84381808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:42 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-108547fa-7326-4519-903b-e5ebca25a717 tempest-ProjectReaderTests-84381808 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:04:42 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-108547fa-7326-4519-903b-e5ebca25a717 tempest-ProjectReaderTests-84381808 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:04:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-108547fa-7326-4519-903b-e5ebca25a717 tempest-ProjectReaderTests-84381808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-30c5a154-d5dc-48c5-b503-d7f4248b3259 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:42 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-985f4978-00e6-4b1f-bcc8-37211de8e16c tempest-VolumeTypesAccessTest-1954457033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:04:42 devstack sudo[101638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-30c5a154-d5dc-48c5-b503-d7f4248b3259 1073741824 Sep 28 15:04:42 devstack sudo[101638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-985f4978-00e6-4b1f-bcc8-37211de8e16c tempest-VolumeTypesAccessTest-1954457033 None] Flow 'volume_create_manager' (8844473a-773d-47df-b8f0-fc55a43bb7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:04:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-985f4978-00e6-4b1f-bcc8-37211de8e16c tempest-VolumeTypesAccessTest-1954457033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7af8d307-ff3c-4d8b-ac8b-bd52a0ea1073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-985f4978-00e6-4b1f-bcc8-37211de8e16c tempest-VolumeTypesAccessTest-1954457033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7af8d307-ff3c-4d8b-ac8b-bd52a0ea1073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1665743729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0da95867-6dc4-4292-bc86-7bf022081992,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e77ce37be4ba43f28a3b822ab9f05fc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:04:42Z,use_quota=True,user_id='696f2c6766284d6b88d8772fa774a679',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc92ec6f-8e17-4c19-bfa2-d0b3bb8bcb0b),volume_type_id=cc92ec6f-8e17-4c19-bfa2-d0b3bb8bcb0b)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-985f4978-00e6-4b1f-bcc8-37211de8e16c tempest-VolumeTypesAccessTest-1954457033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66fcabfd-3cf4-4c59-95db-5fbf9a18e88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-985f4978-00e6-4b1f-bcc8-37211de8e16c tempest-VolumeTypesAccessTest-1954457033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66fcabfd-3cf4-4c59-95db-5fbf9a18e88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-985f4978-00e6-4b1f-bcc8-37211de8e16c tempest-VolumeTypesAccessTest-1954457033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d27878a-4172-443a-9641-b1396b1e213e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-985f4978-00e6-4b1f-bcc8-37211de8e16c tempest-VolumeTypesAccessTest-1954457033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d27878a-4172-443a-9641-b1396b1e213e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0da95867-6dc4-4292-bc86-7bf022081992', 'volume_name': 'volume-0da95867-6dc4-4292-bc86-7bf022081992', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-985f4978-00e6-4b1f-bcc8-37211de8e16c tempest-VolumeTypesAccessTest-1954457033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b41613f-a1f2-47fe-9aba-ab4b3ea5902d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-985f4978-00e6-4b1f-bcc8-37211de8e16c tempest-VolumeTypesAccessTest-1954457033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b41613f-a1f2-47fe-9aba-ab4b3ea5902d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-985f4978-00e6-4b1f-bcc8-37211de8e16c tempest-VolumeTypesAccessTest-1954457033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93676356-e100-4bd2-80e5-824ef39741fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:42 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-985f4978-00e6-4b1f-bcc8-37211de8e16c tempest-VolumeTypesAccessTest-1954457033 None] Volume 0da95867-6dc4-4292-bc86-7bf022081992: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0da95867-6dc4-4292-bc86-7bf022081992', 'volume_size': 1} Sep 28 15:04:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-985f4978-00e6-4b1f-bcc8-37211de8e16c tempest-VolumeTypesAccessTest-1954457033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:43 devstack sudo[101638]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-108547fa-7326-4519-903b-e5ebca25a717 tempest-ProjectReaderTests-84381808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-30c5a154-d5dc-48c5-b503-d7f4248b3259 1073741824" returned: 0 in 0.585s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-108547fa-7326-4519-903b-e5ebca25a717 tempest-ProjectReaderTests-84381808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-30c5a154-d5dc-48c5-b503-d7f4248b3259 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:43 devstack sudo[101644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-30c5a154-d5dc-48c5-b503-d7f4248b3259 Sep 28 15:04:43 devstack sudo[101644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:43 devstack sudo[101644]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-108547fa-7326-4519-903b-e5ebca25a717 tempest-ProjectReaderTests-84381808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-30c5a154-d5dc-48c5-b503-d7f4248b3259" returned: 0 in 0.331s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:43 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-108547fa-7326-4519-903b-e5ebca25a717 tempest-ProjectReaderTests-84381808 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:04:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-108547fa-7326-4519-903b-e5ebca25a717 tempest-ProjectReaderTests-84381808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-985f4978-00e6-4b1f-bcc8-37211de8e16c tempest-VolumeTypesAccessTest-1954457033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.839s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:43 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-985f4978-00e6-4b1f-bcc8-37211de8e16c tempest-VolumeTypesAccessTest-1954457033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1665743729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0da95867-6dc4-4292-bc86-7bf022081992,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e77ce37be4ba43f28a3b822ab9f05fc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:04:42Z,use_quota=True,user_id='696f2c6766284d6b88d8772fa774a679',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc92ec6f-8e17-4c19-bfa2-d0b3bb8bcb0b),volume_type_id=cc92ec6f-8e17-4c19-bfa2-d0b3bb8bcb0b)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:04:43 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-985f4978-00e6-4b1f-bcc8-37211de8e16c tempest-VolumeTypesAccessTest-1954457033 None] Creating volume 0da95867-6dc4-4292-bc86-7bf022081992 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:04:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-985f4978-00e6-4b1f-bcc8-37211de8e16c tempest-VolumeTypesAccessTest-1954457033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-985f4978-00e6-4b1f-bcc8-37211de8e16c tempest-VolumeTypesAccessTest-1954457033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:43 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-985f4978-00e6-4b1f-bcc8-37211de8e16c tempest-VolumeTypesAccessTest-1954457033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:04:43 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-985f4978-00e6-4b1f-bcc8-37211de8e16c tempest-VolumeTypesAccessTest-1954457033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:04:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-985f4978-00e6-4b1f-bcc8-37211de8e16c tempest-VolumeTypesAccessTest-1954457033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:43 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-985f4978-00e6-4b1f-bcc8-37211de8e16c tempest-VolumeTypesAccessTest-1954457033 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:04:43 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-985f4978-00e6-4b1f-bcc8-37211de8e16c tempest-VolumeTypesAccessTest-1954457033 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:04:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-985f4978-00e6-4b1f-bcc8-37211de8e16c tempest-VolumeTypesAccessTest-1954457033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da95867-6dc4-4292-bc86-7bf022081992 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:43 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-108547fa-7326-4519-903b-e5ebca25a717 tempest-ProjectReaderTests-84381808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c40a083a-cc1e-46ca-a9eb-a2d958fc2343) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30c5a154-d5dc-48c5-b503-d7f4248b3259', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:43 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-108547fa-7326-4519-903b-e5ebca25a717 tempest-ProjectReaderTests-84381808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01e1f018-1730-41b0-8d7d-9851103fc440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:43 devstack sudo[101647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da95867-6dc4-4292-bc86-7bf022081992 1073741824 Sep 28 15:04:43 devstack sudo[101647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:43 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-108547fa-7326-4519-903b-e5ebca25a717 tempest-ProjectReaderTests-84381808 None] Volume volume-30c5a154-d5dc-48c5-b503-d7f4248b3259 (30c5a154-d5dc-48c5-b503-d7f4248b3259): created successfully Sep 28 15:04:43 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-108547fa-7326-4519-903b-e5ebca25a717 tempest-ProjectReaderTests-84381808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01e1f018-1730-41b0-8d7d-9851103fc440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:43 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-108547fa-7326-4519-903b-e5ebca25a717 tempest-ProjectReaderTests-84381808 None] Flow 'volume_create_manager' (8067c5b7-ba99-4a0e-ad80-b7b396a1724c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:04:43 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-108547fa-7326-4519-903b-e5ebca25a717 tempest-ProjectReaderTests-84381808 None] Created volume successfully. Sep 28 15:04:44 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-33274278-c4f0-45e5-a42f-8d80cc93373e tempest-ProjectReaderTests-84381808 None] Acquiring lock "cinder-30c5a154-d5dc-48c5-b503-d7f4248b3259-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:44 devstack sudo[101647]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:44 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-33274278-c4f0-45e5-a42f-8d80cc93373e tempest-ProjectReaderTests-84381808 None] Lock "cinder-30c5a154-d5dc-48c5-b503-d7f4248b3259-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-985f4978-00e6-4b1f-bcc8-37211de8e16c tempest-VolumeTypesAccessTest-1954457033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da95867-6dc4-4292-bc86-7bf022081992 1073741824" returned: 0 in 0.647s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:44 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-33274278-c4f0-45e5-a42f-8d80cc93373e tempest-ProjectReaderTests-84381808 None] Acquiring lock "cinder-quobyte-30c5a154-d5dc-48c5-b503-d7f4248b3259" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-985f4978-00e6-4b1f-bcc8-37211de8e16c tempest-VolumeTypesAccessTest-1954457033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da95867-6dc4-4292-bc86-7bf022081992 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:44 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-33274278-c4f0-45e5-a42f-8d80cc93373e tempest-ProjectReaderTests-84381808 None] Lock "cinder-quobyte-30c5a154-d5dc-48c5-b503-d7f4248b3259" acquired by "delete_volume" :: waited 0.046s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:44 devstack sudo[101653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da95867-6dc4-4292-bc86-7bf022081992 Sep 28 15:04:44 devstack sudo[101653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:44 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79642c1-be1a-4102-91c7-f95a12604734]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-33274278-c4f0-45e5-a42f-8d80cc93373e tempest-ProjectReaderTests-84381808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-30c5a154-d5dc-48c5-b503-d7f4248b3259 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:44 devstack sudo[101655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-30c5a154-d5dc-48c5-b503-d7f4248b3259 Sep 28 15:04:44 devstack sudo[101655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:44 devstack sudo[101653]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-985f4978-00e6-4b1f-bcc8-37211de8e16c tempest-VolumeTypesAccessTest-1954457033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da95867-6dc4-4292-bc86-7bf022081992" returned: 0 in 0.326s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:44 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-985f4978-00e6-4b1f-bcc8-37211de8e16c tempest-VolumeTypesAccessTest-1954457033 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:04:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-985f4978-00e6-4b1f-bcc8-37211de8e16c tempest-VolumeTypesAccessTest-1954457033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:44 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-985f4978-00e6-4b1f-bcc8-37211de8e16c tempest-VolumeTypesAccessTest-1954457033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93676356-e100-4bd2-80e5-824ef39741fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0da95867-6dc4-4292-bc86-7bf022081992', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:44 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-985f4978-00e6-4b1f-bcc8-37211de8e16c tempest-VolumeTypesAccessTest-1954457033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (937533ac-da34-4875-a946-98e727f0d09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:44 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-985f4978-00e6-4b1f-bcc8-37211de8e16c tempest-VolumeTypesAccessTest-1954457033 None] Volume volume-0da95867-6dc4-4292-bc86-7bf022081992 (0da95867-6dc4-4292-bc86-7bf022081992): created successfully Sep 28 15:04:44 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-985f4978-00e6-4b1f-bcc8-37211de8e16c tempest-VolumeTypesAccessTest-1954457033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (937533ac-da34-4875-a946-98e727f0d09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:44 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-985f4978-00e6-4b1f-bcc8-37211de8e16c tempest-VolumeTypesAccessTest-1954457033 None] Flow 'volume_create_manager' (8844473a-773d-47df-b8f0-fc55a43bb7e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:04:44 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-985f4978-00e6-4b1f-bcc8-37211de8e16c tempest-VolumeTypesAccessTest-1954457033 None] Created volume successfully. Sep 28 15:04:44 devstack sudo[101655]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-33274278-c4f0-45e5-a42f-8d80cc93373e tempest-ProjectReaderTests-84381808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-30c5a154-d5dc-48c5-b503-d7f4248b3259" returned: 0 in 0.491s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-33274278-c4f0-45e5-a42f-8d80cc93373e tempest-ProjectReaderTests-84381808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-30c5a154-d5dc-48c5-b503-d7f4248b3259 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:44 devstack sudo[101661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-30c5a154-d5dc-48c5-b503-d7f4248b3259 Sep 28 15:04:44 devstack sudo[101661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:45 devstack sudo[101661]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-33274278-c4f0-45e5-a42f-8d80cc93373e tempest-ProjectReaderTests-84381808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-30c5a154-d5dc-48c5-b503-d7f4248b3259" returned: 0 in 0.327s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-33274278-c4f0-45e5-a42f-8d80cc93373e tempest-ProjectReaderTests-84381808 None] Lock "cinder-quobyte-30c5a154-d5dc-48c5-b503-d7f4248b3259" released by "delete_volume" :: held 0.902s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:45 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-33274278-c4f0-45e5-a42f-8d80cc93373e tempest-ProjectReaderTests-84381808 None] Created reservations ['d170711e-6c24-477a-8bcc-d4412a996844', '78c67839-e4cf-454a-bb80-94332e793a0a', '075e7f75-311b-4c92-8cff-fad2fd3e0d03', '59c31c42-6316-41ae-909e-5f3a93afcfb1'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:04:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-33274278-c4f0-45e5-a42f-8d80cc93373e tempest-ProjectReaderTests-84381808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-33274278-c4f0-45e5-a42f-8d80cc93373e tempest-ProjectReaderTests-84381808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:45 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-33274278-c4f0-45e5-a42f-8d80cc93373e tempest-ProjectReaderTests-84381808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:04:45 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-33274278-c4f0-45e5-a42f-8d80cc93373e tempest-ProjectReaderTests-84381808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:04:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-33274278-c4f0-45e5-a42f-8d80cc93373e tempest-ProjectReaderTests-84381808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-33274278-c4f0-45e5-a42f-8d80cc93373e tempest-ProjectReaderTests-84381808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:45 devstack sudo[101664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:04:45 devstack sudo[101664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-27e5eea9-26fc-4df6-b90b-0c5dda0736a5 tempest-VolumeTypesAccessTest-1954457033 None] Acquiring lock "cinder-0da95867-6dc4-4292-bc86-7bf022081992-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-27e5eea9-26fc-4df6-b90b-0c5dda0736a5 tempest-VolumeTypesAccessTest-1954457033 None] Lock "cinder-0da95867-6dc4-4292-bc86-7bf022081992-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:45 devstack sudo[101664]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-33274278-c4f0-45e5-a42f-8d80cc93373e tempest-ProjectReaderTests-84381808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.414s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:45 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-33274278-c4f0-45e5-a42f-8d80cc93373e tempest-ProjectReaderTests-84381808 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:04:45 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-33274278-c4f0-45e5-a42f-8d80cc93373e tempest-ProjectReaderTests-84381808 None] Deleted volume successfully. Sep 28 15:04:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-27e5eea9-26fc-4df6-b90b-0c5dda0736a5 tempest-VolumeTypesAccessTest-1954457033 None] Acquiring lock "cinder-quobyte-0da95867-6dc4-4292-bc86-7bf022081992" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-33274278-c4f0-45e5-a42f-8d80cc93373e tempest-ProjectReaderTests-84381808 None] Lock "cinder-30c5a154-d5dc-48c5-b503-d7f4248b3259-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-27e5eea9-26fc-4df6-b90b-0c5dda0736a5 tempest-VolumeTypesAccessTest-1954457033 None] Lock "cinder-quobyte-0da95867-6dc4-4292-bc86-7bf022081992" acquired by "delete_volume" :: waited 0.021s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:45 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad8e5d2-0e6e-44b6-ba97-27827813f8fb]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-27e5eea9-26fc-4df6-b90b-0c5dda0736a5 tempest-VolumeTypesAccessTest-1954457033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da95867-6dc4-4292-bc86-7bf022081992 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:45 devstack sudo[101667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da95867-6dc4-4292-bc86-7bf022081992 Sep 28 15:04:46 devstack sudo[101667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:46 devstack sudo[101667]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-27e5eea9-26fc-4df6-b90b-0c5dda0736a5 tempest-VolumeTypesAccessTest-1954457033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da95867-6dc4-4292-bc86-7bf022081992" returned: 0 in 0.620s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-27e5eea9-26fc-4df6-b90b-0c5dda0736a5 tempest-VolumeTypesAccessTest-1954457033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da95867-6dc4-4292-bc86-7bf022081992 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:46 devstack sudo[101678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da95867-6dc4-4292-bc86-7bf022081992 Sep 28 15:04:46 devstack sudo[101678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:46 devstack sudo[101678]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-27e5eea9-26fc-4df6-b90b-0c5dda0736a5 tempest-VolumeTypesAccessTest-1954457033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da95867-6dc4-4292-bc86-7bf022081992" returned: 0 in 0.420s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-27e5eea9-26fc-4df6-b90b-0c5dda0736a5 tempest-VolumeTypesAccessTest-1954457033 None] Lock "cinder-quobyte-0da95867-6dc4-4292-bc86-7bf022081992" released by "delete_volume" :: held 1.110s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:46 devstack cinder-volume[87116]: WARNING cinder.quota [None req-27e5eea9-26fc-4df6-b90b-0c5dda0736a5 tempest-VolumeTypesAccessTest-1954457033 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1758607359 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1758607359, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:04:46 devstack cinder-volume[87116]: WARNING cinder.quota [None req-27e5eea9-26fc-4df6-b90b-0c5dda0736a5 tempest-VolumeTypesAccessTest-1954457033 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1758607359 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1758607359, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:04:47 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-27e5eea9-26fc-4df6-b90b-0c5dda0736a5 tempest-VolumeTypesAccessTest-1954457033 None] Created reservations ['2cf6d97b-6d69-44da-9b87-7b58aa037349', 'c63a780c-1057-4cd0-b398-af913561b8bf', '100ec3ed-212e-4e95-898c-cecd2dcea004', 'bec41961-0511-464e-9895-ddd0201fed87'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:04:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-27e5eea9-26fc-4df6-b90b-0c5dda0736a5 tempest-VolumeTypesAccessTest-1954457033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-27e5eea9-26fc-4df6-b90b-0c5dda0736a5 tempest-VolumeTypesAccessTest-1954457033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:47 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-27e5eea9-26fc-4df6-b90b-0c5dda0736a5 tempest-VolumeTypesAccessTest-1954457033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:04:47 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-27e5eea9-26fc-4df6-b90b-0c5dda0736a5 tempest-VolumeTypesAccessTest-1954457033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:04:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-27e5eea9-26fc-4df6-b90b-0c5dda0736a5 tempest-VolumeTypesAccessTest-1954457033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-27e5eea9-26fc-4df6-b90b-0c5dda0736a5 tempest-VolumeTypesAccessTest-1954457033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:47 devstack sudo[101684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:04:47 devstack sudo[101684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:47 devstack sudo[101684]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-27e5eea9-26fc-4df6-b90b-0c5dda0736a5 tempest-VolumeTypesAccessTest-1954457033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.474s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:47 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-27e5eea9-26fc-4df6-b90b-0c5dda0736a5 tempest-VolumeTypesAccessTest-1954457033 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:04:47 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-27e5eea9-26fc-4df6-b90b-0c5dda0736a5 tempest-VolumeTypesAccessTest-1954457033 None] Deleted volume successfully. Sep 28 15:04:47 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-27e5eea9-26fc-4df6-b90b-0c5dda0736a5 tempest-VolumeTypesAccessTest-1954457033 None] Lock "cinder-0da95867-6dc4-4292-bc86-7bf022081992-delete_volume" released by "delete_volume" :: held 2.120s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:52 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ce57e2d-6d60-4421-b58f-85fca3763ce5 tempest-VolumesSnapshotTestJSON-294013348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:04:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4ce57e2d-6d60-4421-b58f-85fca3763ce5 tempest-VolumesSnapshotTestJSON-294013348 None] Flow 'volume_create_manager' (9ff59085-94d8-4ced-be58-db5b4cab06f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:04:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4ce57e2d-6d60-4421-b58f-85fca3763ce5 tempest-VolumesSnapshotTestJSON-294013348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d74d7d1a-3552-40ee-aa0a-2d895e931a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4ce57e2d-6d60-4421-b58f-85fca3763ce5 tempest-VolumesSnapshotTestJSON-294013348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d74d7d1a-3552-40ee-aa0a-2d895e931a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:04:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1564497111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af7ccced-0ee2-4be1-80e7-5e9c10836ec3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f16165408b0406ca7fe3ce06cb4a958',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:04:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:04:52Z,use_quota=True,user_id='81a44207522d4e189834be1c317fb14a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4ce57e2d-6d60-4421-b58f-85fca3763ce5 tempest-VolumesSnapshotTestJSON-294013348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fa7f7bb-8b41-43ae-b52d-f8e693c0187c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4ce57e2d-6d60-4421-b58f-85fca3763ce5 tempest-VolumesSnapshotTestJSON-294013348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fa7f7bb-8b41-43ae-b52d-f8e693c0187c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4ce57e2d-6d60-4421-b58f-85fca3763ce5 tempest-VolumesSnapshotTestJSON-294013348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38224d06-423f-41c2-ad74-6f54f2f15404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4ce57e2d-6d60-4421-b58f-85fca3763ce5 tempest-VolumesSnapshotTestJSON-294013348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38224d06-423f-41c2-ad74-6f54f2f15404) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af7ccced-0ee2-4be1-80e7-5e9c10836ec3', 'volume_name': 'volume-af7ccced-0ee2-4be1-80e7-5e9c10836ec3', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4ce57e2d-6d60-4421-b58f-85fca3763ce5 tempest-VolumesSnapshotTestJSON-294013348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bec7c5e-b3e4-477c-9548-ad551b55e9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4ce57e2d-6d60-4421-b58f-85fca3763ce5 tempest-VolumesSnapshotTestJSON-294013348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bec7c5e-b3e4-477c-9548-ad551b55e9e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4ce57e2d-6d60-4421-b58f-85fca3763ce5 tempest-VolumesSnapshotTestJSON-294013348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c4b676a-b29a-4579-83e2-799e2f7c77c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:52 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-4ce57e2d-6d60-4421-b58f-85fca3763ce5 tempest-VolumesSnapshotTestJSON-294013348 None] Volume af7ccced-0ee2-4be1-80e7-5e9c10836ec3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af7ccced-0ee2-4be1-80e7-5e9c10836ec3', 'volume_size': 1} Sep 28 15:04:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4ce57e2d-6d60-4421-b58f-85fca3763ce5 tempest-VolumesSnapshotTestJSON-294013348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4ce57e2d-6d60-4421-b58f-85fca3763ce5 tempest-VolumesSnapshotTestJSON-294013348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4ce57e2d-6d60-4421-b58f-85fca3763ce5 tempest-VolumesSnapshotTestJSON-294013348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:04:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1564497111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af7ccced-0ee2-4be1-80e7-5e9c10836ec3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f16165408b0406ca7fe3ce06cb4a958',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:04:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:04:52Z,use_quota=True,user_id='81a44207522d4e189834be1c317fb14a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:04:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-4ce57e2d-6d60-4421-b58f-85fca3763ce5 tempest-VolumesSnapshotTestJSON-294013348 None] Creating volume af7ccced-0ee2-4be1-80e7-5e9c10836ec3 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:04:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4ce57e2d-6d60-4421-b58f-85fca3763ce5 tempest-VolumesSnapshotTestJSON-294013348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4ce57e2d-6d60-4421-b58f-85fca3763ce5 tempest-VolumesSnapshotTestJSON-294013348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4ce57e2d-6d60-4421-b58f-85fca3763ce5 tempest-VolumesSnapshotTestJSON-294013348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:04:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4ce57e2d-6d60-4421-b58f-85fca3763ce5 tempest-VolumesSnapshotTestJSON-294013348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:04:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4ce57e2d-6d60-4421-b58f-85fca3763ce5 tempest-VolumesSnapshotTestJSON-294013348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4ce57e2d-6d60-4421-b58f-85fca3763ce5 tempest-VolumesSnapshotTestJSON-294013348 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:04:52 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-4ce57e2d-6d60-4421-b58f-85fca3763ce5 tempest-VolumesSnapshotTestJSON-294013348 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:04:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4ce57e2d-6d60-4421-b58f-85fca3763ce5 tempest-VolumesSnapshotTestJSON-294013348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-af7ccced-0ee2-4be1-80e7-5e9c10836ec3 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:52 devstack sudo[101690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-af7ccced-0ee2-4be1-80e7-5e9c10836ec3 1073741824 Sep 28 15:04:52 devstack sudo[101690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:52 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-71ae1f3e-9b9a-4807-9fd1-378a5e75d9be tempest-TestServerVolumeAttachScenarioOldVersion-2004515130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:04:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-71ae1f3e-9b9a-4807-9fd1-378a5e75d9be tempest-TestServerVolumeAttachScenarioOldVersion-2004515130 None] Flow 'volume_create_manager' (03c0b9f1-a925-41a8-a60c-08a28290a6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:04:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-71ae1f3e-9b9a-4807-9fd1-378a5e75d9be tempest-TestServerVolumeAttachScenarioOldVersion-2004515130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (525ced72-ca0d-40dc-a3c4-49a5d4c7be60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-71ae1f3e-9b9a-4807-9fd1-378a5e75d9be tempest-TestServerVolumeAttachScenarioOldVersion-2004515130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (525ced72-ca0d-40dc-a3c4-49a5d4c7be60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:04:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1569675801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddaa598c-cf46-4a32-8ccb-6b6c3bb8089e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d7900bf12e14d449d4bf2d374f6f27d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:04:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:04:53Z,use_quota=True,user_id='e558e5e746fc4adeaabfacee1a0a6bc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-71ae1f3e-9b9a-4807-9fd1-378a5e75d9be tempest-TestServerVolumeAttachScenarioOldVersion-2004515130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29fe5fea-2894-4166-974e-09c74711442d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-71ae1f3e-9b9a-4807-9fd1-378a5e75d9be tempest-TestServerVolumeAttachScenarioOldVersion-2004515130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29fe5fea-2894-4166-974e-09c74711442d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-71ae1f3e-9b9a-4807-9fd1-378a5e75d9be tempest-TestServerVolumeAttachScenarioOldVersion-2004515130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab032f22-d689-451f-952f-e4e67ce7f10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-71ae1f3e-9b9a-4807-9fd1-378a5e75d9be tempest-TestServerVolumeAttachScenarioOldVersion-2004515130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab032f22-d689-451f-952f-e4e67ce7f10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddaa598c-cf46-4a32-8ccb-6b6c3bb8089e', 'volume_name': 'volume-ddaa598c-cf46-4a32-8ccb-6b6c3bb8089e', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-71ae1f3e-9b9a-4807-9fd1-378a5e75d9be tempest-TestServerVolumeAttachScenarioOldVersion-2004515130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74b7802a-c11d-42f0-b87e-41f36da39607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-71ae1f3e-9b9a-4807-9fd1-378a5e75d9be tempest-TestServerVolumeAttachScenarioOldVersion-2004515130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74b7802a-c11d-42f0-b87e-41f36da39607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-71ae1f3e-9b9a-4807-9fd1-378a5e75d9be tempest-TestServerVolumeAttachScenarioOldVersion-2004515130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbbfce95-84c5-4666-85a0-5d6e4e6535bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:52 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-71ae1f3e-9b9a-4807-9fd1-378a5e75d9be tempest-TestServerVolumeAttachScenarioOldVersion-2004515130 None] Volume ddaa598c-cf46-4a32-8ccb-6b6c3bb8089e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddaa598c-cf46-4a32-8ccb-6b6c3bb8089e', 'volume_size': 1} Sep 28 15:04:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-71ae1f3e-9b9a-4807-9fd1-378a5e75d9be tempest-TestServerVolumeAttachScenarioOldVersion-2004515130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:53 devstack sudo[101690]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4ce57e2d-6d60-4421-b58f-85fca3763ce5 tempest-VolumesSnapshotTestJSON-294013348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-af7ccced-0ee2-4be1-80e7-5e9c10836ec3 1073741824" returned: 0 in 0.578s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4ce57e2d-6d60-4421-b58f-85fca3763ce5 tempest-VolumesSnapshotTestJSON-294013348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-af7ccced-0ee2-4be1-80e7-5e9c10836ec3 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:53 devstack sudo[101696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-af7ccced-0ee2-4be1-80e7-5e9c10836ec3 Sep 28 15:04:53 devstack sudo[101696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:53 devstack sudo[101696]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4ce57e2d-6d60-4421-b58f-85fca3763ce5 tempest-VolumesSnapshotTestJSON-294013348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-af7ccced-0ee2-4be1-80e7-5e9c10836ec3" returned: 0 in 0.359s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:53 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4ce57e2d-6d60-4421-b58f-85fca3763ce5 tempest-VolumesSnapshotTestJSON-294013348 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:04:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4ce57e2d-6d60-4421-b58f-85fca3763ce5 tempest-VolumesSnapshotTestJSON-294013348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-71ae1f3e-9b9a-4807-9fd1-378a5e75d9be tempest-TestServerVolumeAttachScenarioOldVersion-2004515130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.782s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:53 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-71ae1f3e-9b9a-4807-9fd1-378a5e75d9be tempest-TestServerVolumeAttachScenarioOldVersion-2004515130 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:04:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1569675801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddaa598c-cf46-4a32-8ccb-6b6c3bb8089e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d7900bf12e14d449d4bf2d374f6f27d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:04:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:04:53Z,use_quota=True,user_id='e558e5e746fc4adeaabfacee1a0a6bc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:04:53 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-71ae1f3e-9b9a-4807-9fd1-378a5e75d9be tempest-TestServerVolumeAttachScenarioOldVersion-2004515130 None] Creating volume ddaa598c-cf46-4a32-8ccb-6b6c3bb8089e {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:04:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-71ae1f3e-9b9a-4807-9fd1-378a5e75d9be tempest-TestServerVolumeAttachScenarioOldVersion-2004515130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-71ae1f3e-9b9a-4807-9fd1-378a5e75d9be tempest-TestServerVolumeAttachScenarioOldVersion-2004515130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:53 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-71ae1f3e-9b9a-4807-9fd1-378a5e75d9be tempest-TestServerVolumeAttachScenarioOldVersion-2004515130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:04:53 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-71ae1f3e-9b9a-4807-9fd1-378a5e75d9be tempest-TestServerVolumeAttachScenarioOldVersion-2004515130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:04:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-71ae1f3e-9b9a-4807-9fd1-378a5e75d9be tempest-TestServerVolumeAttachScenarioOldVersion-2004515130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:53 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-71ae1f3e-9b9a-4807-9fd1-378a5e75d9be tempest-TestServerVolumeAttachScenarioOldVersion-2004515130 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:04:53 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-71ae1f3e-9b9a-4807-9fd1-378a5e75d9be tempest-TestServerVolumeAttachScenarioOldVersion-2004515130 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:04:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-71ae1f3e-9b9a-4807-9fd1-378a5e75d9be tempest-TestServerVolumeAttachScenarioOldVersion-2004515130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ddaa598c-cf46-4a32-8ccb-6b6c3bb8089e 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:53 devstack sudo[101699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ddaa598c-cf46-4a32-8ccb-6b6c3bb8089e 1073741824 Sep 28 15:04:53 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4ce57e2d-6d60-4421-b58f-85fca3763ce5 tempest-VolumesSnapshotTestJSON-294013348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c4b676a-b29a-4579-83e2-799e2f7c77c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af7ccced-0ee2-4be1-80e7-5e9c10836ec3', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:53 devstack sudo[101699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:53 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4ce57e2d-6d60-4421-b58f-85fca3763ce5 tempest-VolumesSnapshotTestJSON-294013348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a9298b8-1682-444b-a73a-076c05b147ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:53 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-4ce57e2d-6d60-4421-b58f-85fca3763ce5 tempest-VolumesSnapshotTestJSON-294013348 None] Volume volume-af7ccced-0ee2-4be1-80e7-5e9c10836ec3 (af7ccced-0ee2-4be1-80e7-5e9c10836ec3): created successfully Sep 28 15:04:53 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4ce57e2d-6d60-4421-b58f-85fca3763ce5 tempest-VolumesSnapshotTestJSON-294013348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a9298b8-1682-444b-a73a-076c05b147ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:53 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4ce57e2d-6d60-4421-b58f-85fca3763ce5 tempest-VolumesSnapshotTestJSON-294013348 None] Flow 'volume_create_manager' (9ff59085-94d8-4ced-be58-db5b4cab06f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:04:53 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-4ce57e2d-6d60-4421-b58f-85fca3763ce5 tempest-VolumesSnapshotTestJSON-294013348 None] Created volume successfully. Sep 28 15:04:54 devstack sudo[101699]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-71ae1f3e-9b9a-4807-9fd1-378a5e75d9be tempest-TestServerVolumeAttachScenarioOldVersion-2004515130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ddaa598c-cf46-4a32-8ccb-6b6c3bb8089e 1073741824" returned: 0 in 0.646s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-71ae1f3e-9b9a-4807-9fd1-378a5e75d9be tempest-TestServerVolumeAttachScenarioOldVersion-2004515130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ddaa598c-cf46-4a32-8ccb-6b6c3bb8089e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:54 devstack sudo[101705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ddaa598c-cf46-4a32-8ccb-6b6c3bb8089e Sep 28 15:04:54 devstack sudo[101705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:54 devstack sudo[101705]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-71ae1f3e-9b9a-4807-9fd1-378a5e75d9be tempest-TestServerVolumeAttachScenarioOldVersion-2004515130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ddaa598c-cf46-4a32-8ccb-6b6c3bb8089e" returned: 0 in 0.315s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:54 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-71ae1f3e-9b9a-4807-9fd1-378a5e75d9be tempest-TestServerVolumeAttachScenarioOldVersion-2004515130 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:04:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-71ae1f3e-9b9a-4807-9fd1-378a5e75d9be tempest-TestServerVolumeAttachScenarioOldVersion-2004515130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-71ae1f3e-9b9a-4807-9fd1-378a5e75d9be tempest-TestServerVolumeAttachScenarioOldVersion-2004515130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbbfce95-84c5-4666-85a0-5d6e4e6535bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddaa598c-cf46-4a32-8ccb-6b6c3bb8089e', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-71ae1f3e-9b9a-4807-9fd1-378a5e75d9be tempest-TestServerVolumeAttachScenarioOldVersion-2004515130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3504bdb-a919-4325-9b26-a31c452bfffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:54 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-71ae1f3e-9b9a-4807-9fd1-378a5e75d9be tempest-TestServerVolumeAttachScenarioOldVersion-2004515130 None] Volume volume-ddaa598c-cf46-4a32-8ccb-6b6c3bb8089e (ddaa598c-cf46-4a32-8ccb-6b6c3bb8089e): created successfully Sep 28 15:04:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-71ae1f3e-9b9a-4807-9fd1-378a5e75d9be tempest-TestServerVolumeAttachScenarioOldVersion-2004515130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3504bdb-a919-4325-9b26-a31c452bfffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-71ae1f3e-9b9a-4807-9fd1-378a5e75d9be tempest-TestServerVolumeAttachScenarioOldVersion-2004515130 None] Flow 'volume_create_manager' (03c0b9f1-a925-41a8-a60c-08a28290a6aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:04:54 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-71ae1f3e-9b9a-4807-9fd1-378a5e75d9be tempest-TestServerVolumeAttachScenarioOldVersion-2004515130 None] Created volume successfully. Sep 28 15:04:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-300396c9-4f2d-44f9-ada2-7137b51f792c tempest-VolumesSnapshotTestJSON-294013348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-300396c9-4f2d-44f9-ada2-7137b51f792c tempest-VolumesSnapshotTestJSON-294013348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:55 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-300396c9-4f2d-44f9-ada2-7137b51f792c tempest-VolumesSnapshotTestJSON-294013348 None] Creating offline snapshot 0bb91f44-d590-4f29-b419-2d1f12f531b8 of volume af7ccced-0ee2-4be1-80e7-5e9c10836ec3 {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:04:55 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[7363c548-5397-4463-b231-6d67e00dc26c]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-300396c9-4f2d-44f9-ada2-7137b51f792c tempest-VolumesSnapshotTestJSON-294013348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-af7ccced-0ee2-4be1-80e7-5e9c10836ec3 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:55 devstack sudo[101708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-af7ccced-0ee2-4be1-80e7-5e9c10836ec3 Sep 28 15:04:55 devstack sudo[101708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:55 devstack sudo[101708]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-300396c9-4f2d-44f9-ada2-7137b51f792c tempest-VolumesSnapshotTestJSON-294013348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-af7ccced-0ee2-4be1-80e7-5e9c10836ec3" returned: 0 in 0.488s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-300396c9-4f2d-44f9-ada2-7137b51f792c tempest-VolumesSnapshotTestJSON-294013348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-af7ccced-0ee2-4be1-80e7-5e9c10836ec3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-af7ccced-0ee2-4be1-80e7-5e9c10836ec3.0bb91f44-d590-4f29-b419-2d1f12f531b8 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:55 devstack sudo[101713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-af7ccced-0ee2-4be1-80e7-5e9c10836ec3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-af7ccced-0ee2-4be1-80e7-5e9c10836ec3.0bb91f44-d590-4f29-b419-2d1f12f531b8 1G Sep 28 15:04:55 devstack sudo[101713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:56 devstack sudo[101713]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-300396c9-4f2d-44f9-ada2-7137b51f792c tempest-VolumesSnapshotTestJSON-294013348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-af7ccced-0ee2-4be1-80e7-5e9c10836ec3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-af7ccced-0ee2-4be1-80e7-5e9c10836ec3.0bb91f44-d590-4f29-b419-2d1f12f531b8 1G" returned: 0 in 0.678s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-300396c9-4f2d-44f9-ada2-7137b51f792c tempest-VolumesSnapshotTestJSON-294013348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af7ccced-0ee2-4be1-80e7-5e9c10836ec3 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-af7ccced-0ee2-4be1-80e7-5e9c10836ec3.0bb91f44-d590-4f29-b419-2d1f12f531b8 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:56 devstack sudo[101723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af7ccced-0ee2-4be1-80e7-5e9c10836ec3 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-af7ccced-0ee2-4be1-80e7-5e9c10836ec3.0bb91f44-d590-4f29-b419-2d1f12f531b8 Sep 28 15:04:56 devstack sudo[101723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:56 devstack sudo[101723]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-300396c9-4f2d-44f9-ada2-7137b51f792c tempest-VolumesSnapshotTestJSON-294013348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af7ccced-0ee2-4be1-80e7-5e9c10836ec3 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-af7ccced-0ee2-4be1-80e7-5e9c10836ec3.0bb91f44-d590-4f29-b419-2d1f12f531b8" returned: 0 in 0.433s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:56 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-300396c9-4f2d-44f9-ada2-7137b51f792c tempest-VolumesSnapshotTestJSON-294013348 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-af7ccced-0ee2-4be1-80e7-5e9c10836ec3.0bb91f44-d590-4f29-b419-2d1f12f531b8 is being set with open permissions: ugo+rw Sep 28 15:04:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-300396c9-4f2d-44f9-ada2-7137b51f792c tempest-VolumesSnapshotTestJSON-294013348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-af7ccced-0ee2-4be1-80e7-5e9c10836ec3.0bb91f44-d590-4f29-b419-2d1f12f531b8 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:56 devstack sudo[101729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-af7ccced-0ee2-4be1-80e7-5e9c10836ec3.0bb91f44-d590-4f29-b419-2d1f12f531b8 Sep 28 15:04:56 devstack sudo[101729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:57 devstack sudo[101729]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-300396c9-4f2d-44f9-ada2-7137b51f792c tempest-VolumesSnapshotTestJSON-294013348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-af7ccced-0ee2-4be1-80e7-5e9c10836ec3.0bb91f44-d590-4f29-b419-2d1f12f531b8" returned: 0 in 0.430s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-9f609ff8-2fb5-4084-b576-2cbf9f9eb6d1 req-eda0b412-6b45-43e1-bfd5-08184ebcb0bb tempest-TestServerVolumeAttachScenarioOldVersion-2004515130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-300396c9-4f2d-44f9-ada2-7137b51f792c tempest-VolumesSnapshotTestJSON-294013348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-af7ccced-0ee2-4be1-80e7-5e9c10836ec3.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:57 devstack sudo[101740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-af7ccced-0ee2-4be1-80e7-5e9c10836ec3.info Sep 28 15:04:57 devstack sudo[101740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:57 devstack sudo[101740]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-300396c9-4f2d-44f9-ada2-7137b51f792c tempest-VolumesSnapshotTestJSON-294013348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-af7ccced-0ee2-4be1-80e7-5e9c10836ec3.info" returned: 0 in 0.311s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:57 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-300396c9-4f2d-44f9-ada2-7137b51f792c tempest-VolumesSnapshotTestJSON-294013348 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-af7ccced-0ee2-4be1-80e7-5e9c10836ec3.info is being set with open permissions: ugo+rw Sep 28 15:04:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-300396c9-4f2d-44f9-ada2-7137b51f792c tempest-VolumesSnapshotTestJSON-294013348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-af7ccced-0ee2-4be1-80e7-5e9c10836ec3.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:57 devstack sudo[101743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-af7ccced-0ee2-4be1-80e7-5e9c10836ec3.info Sep 28 15:04:57 devstack sudo[101743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:58 devstack sudo[101743]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-300396c9-4f2d-44f9-ada2-7137b51f792c tempest-VolumesSnapshotTestJSON-294013348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-af7ccced-0ee2-4be1-80e7-5e9c10836ec3.info" returned: 0 in 0.294s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-300396c9-4f2d-44f9-ada2-7137b51f792c tempest-VolumesSnapshotTestJSON-294013348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.764s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-9f609ff8-2fb5-4084-b576-2cbf9f9eb6d1 req-eda0b412-6b45-43e1-bfd5-08184ebcb0bb tempest-TestServerVolumeAttachScenarioOldVersion-2004515130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.668s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-9f609ff8-2fb5-4084-b576-2cbf9f9eb6d1 req-eda0b412-6b45-43e1-bfd5-08184ebcb0bb tempest-TestServerVolumeAttachScenarioOldVersion-2004515130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-9f609ff8-2fb5-4084-b576-2cbf9f9eb6d1 req-eda0b412-6b45-43e1-bfd5-08184ebcb0bb tempest-TestServerVolumeAttachScenarioOldVersion-2004515130 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1', 'name': 'volume-ddaa598c-cf46-4a32-8ccb-6b6c3bb8089e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9073566e-fc19-49ad-bfe3-6b9969fb9f47', 'enforce_multipath': True} {{(pid=87116) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:04:58 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-300396c9-4f2d-44f9-ada2-7137b51f792c tempest-VolumesSnapshotTestJSON-294013348 None] Create snapshot completed successfully Sep 28 15:04:58 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-9f609ff8-2fb5-4084-b576-2cbf9f9eb6d1 req-eda0b412-6b45-43e1-bfd5-08184ebcb0bb tempest-TestServerVolumeAttachScenarioOldVersion-2004515130 None] attachment_update completed successfully. Sep 28 15:04:58 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-680e323a-404b-4140-b441-7fe8f83f2119 tempest-VolumesSnapshotTestJSON-294013348 None] Acquiring lock "cinder-0bb91f44-d590-4f29-b419-2d1f12f531b8-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:58 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-680e323a-404b-4140-b441-7fe8f83f2119 tempest-VolumesSnapshotTestJSON-294013348 None] Lock "cinder-0bb91f44-d590-4f29-b419-2d1f12f531b8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:58 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-680e323a-404b-4140-b441-7fe8f83f2119 tempest-VolumesSnapshotTestJSON-294013348 None] Acquiring lock "cinder-quobyte-af7ccced-0ee2-4be1-80e7-5e9c10836ec3" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:58 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-680e323a-404b-4140-b441-7fe8f83f2119 tempest-VolumesSnapshotTestJSON-294013348 None] Lock "cinder-quobyte-af7ccced-0ee2-4be1-80e7-5e9c10836ec3" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:58 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-680e323a-404b-4140-b441-7fe8f83f2119 tempest-VolumesSnapshotTestJSON-294013348 None] Acquiring lock "cinder-quobyte-0bb91f44-d590-4f29-b419-2d1f12f531b8" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:58 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-680e323a-404b-4140-b441-7fe8f83f2119 tempest-VolumesSnapshotTestJSON-294013348 None] Lock "cinder-quobyte-0bb91f44-d590-4f29-b419-2d1f12f531b8" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-680e323a-404b-4140-b441-7fe8f83f2119 tempest-VolumesSnapshotTestJSON-294013348 None] Deleting offline snapshot 0bb91f44-d590-4f29-b419-2d1f12f531b8 of volume af7ccced-0ee2-4be1-80e7-5e9c10836ec3 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:04:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-680e323a-404b-4140-b441-7fe8f83f2119 tempest-VolumesSnapshotTestJSON-294013348 None] snapshot_file for this snap is: volume-af7ccced-0ee2-4be1-80e7-5e9c10836ec3.0bb91f44-d590-4f29-b419-2d1f12f531b8 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:04:58 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2dec5a9-3570-42dd-a4ed-c4089ac6f47b]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-680e323a-404b-4140-b441-7fe8f83f2119 tempest-VolumesSnapshotTestJSON-294013348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-af7ccced-0ee2-4be1-80e7-5e9c10836ec3.0bb91f44-d590-4f29-b419-2d1f12f531b8 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:59 devstack sudo[102160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-af7ccced-0ee2-4be1-80e7-5e9c10836ec3.0bb91f44-d590-4f29-b419-2d1f12f531b8 Sep 28 15:04:59 devstack sudo[102160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:59 devstack sudo[102160]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-680e323a-404b-4140-b441-7fe8f83f2119 tempest-VolumesSnapshotTestJSON-294013348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-af7ccced-0ee2-4be1-80e7-5e9c10836ec3.0bb91f44-d590-4f29-b419-2d1f12f531b8" returned: 0 in 0.608s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-680e323a-404b-4140-b441-7fe8f83f2119 tempest-VolumesSnapshotTestJSON-294013348 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af7ccced-0ee2-4be1-80e7-5e9c10836ec3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:04:59 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd01596-6e97-4e29-97a6-fe453e2a4e08]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-680e323a-404b-4140-b441-7fe8f83f2119 tempest-VolumesSnapshotTestJSON-294013348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-af7ccced-0ee2-4be1-80e7-5e9c10836ec3 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:59 devstack sudo[102166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-af7ccced-0ee2-4be1-80e7-5e9c10836ec3 Sep 28 15:04:59 devstack sudo[102166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:00 devstack sudo[102166]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-680e323a-404b-4140-b441-7fe8f83f2119 tempest-VolumesSnapshotTestJSON-294013348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-af7ccced-0ee2-4be1-80e7-5e9c10836ec3" returned: 0 in 0.485s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-680e323a-404b-4140-b441-7fe8f83f2119 tempest-VolumesSnapshotTestJSON-294013348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-af7ccced-0ee2-4be1-80e7-5e9c10836ec3.0bb91f44-d590-4f29-b419-2d1f12f531b8 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:00 devstack sudo[102171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-af7ccced-0ee2-4be1-80e7-5e9c10836ec3.0bb91f44-d590-4f29-b419-2d1f12f531b8 Sep 28 15:05:00 devstack sudo[102171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:00 devstack sudo[102171]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-680e323a-404b-4140-b441-7fe8f83f2119 tempest-VolumesSnapshotTestJSON-294013348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-af7ccced-0ee2-4be1-80e7-5e9c10836ec3.0bb91f44-d590-4f29-b419-2d1f12f531b8" returned: 0 in 0.503s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-680e323a-404b-4140-b441-7fe8f83f2119 tempest-VolumesSnapshotTestJSON-294013348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-af7ccced-0ee2-4be1-80e7-5e9c10836ec3.0bb91f44-d590-4f29-b419-2d1f12f531b8 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:00 devstack sudo[102176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-af7ccced-0ee2-4be1-80e7-5e9c10836ec3.0bb91f44-d590-4f29-b419-2d1f12f531b8 Sep 28 15:05:00 devstack sudo[102176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:00 devstack sudo[102176]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-680e323a-404b-4140-b441-7fe8f83f2119 tempest-VolumesSnapshotTestJSON-294013348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-af7ccced-0ee2-4be1-80e7-5e9c10836ec3.0bb91f44-d590-4f29-b419-2d1f12f531b8" returned: 0 in 0.390s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:01 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-680e323a-404b-4140-b441-7fe8f83f2119 tempest-VolumesSnapshotTestJSON-294013348 None] Lock "cinder-quobyte-0bb91f44-d590-4f29-b419-2d1f12f531b8" released by "_delete_snapshot" :: held 2.203s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:01 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-680e323a-404b-4140-b441-7fe8f83f2119 tempest-VolumesSnapshotTestJSON-294013348 None] Lock "cinder-quobyte-af7ccced-0ee2-4be1-80e7-5e9c10836ec3" released by "delete_snapshot" :: held 2.234s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:01 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-680e323a-404b-4140-b441-7fe8f83f2119 tempest-VolumesSnapshotTestJSON-294013348 None] Created reservations ['f684ea2f-0471-453f-accd-788393c453f9', '0b408af6-267d-4790-b2af-5994496ad218', '72bd4aa0-2ca1-45cb-bf42-6f574e184594', 'f012dd48-808d-4294-a2ec-dd2e1515c298'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:05:01 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-680e323a-404b-4140-b441-7fe8f83f2119 tempest-VolumesSnapshotTestJSON-294013348 None] Delete snapshot completed successfully. Sep 28 15:05:01 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-680e323a-404b-4140-b441-7fe8f83f2119 tempest-VolumesSnapshotTestJSON-294013348 None] Lock "cinder-0bb91f44-d590-4f29-b419-2d1f12f531b8-delete_snapshot" released by "delete_snapshot" :: held 2.536s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:02 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-74141276-5de9-4e3c-9fa3-a1fe7faa76c2 tempest-VolumesSnapshotTestJSON-294013348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:05:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-74141276-5de9-4e3c-9fa3-a1fe7faa76c2 tempest-VolumesSnapshotTestJSON-294013348 None] Flow 'volume_create_manager' (fd787135-50ad-4862-9f71-6c10f43047ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:05:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-74141276-5de9-4e3c-9fa3-a1fe7faa76c2 tempest-VolumesSnapshotTestJSON-294013348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee7fec36-2d01-401a-9bcf-ccdf0ee298d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-74141276-5de9-4e3c-9fa3-a1fe7faa76c2 tempest-VolumesSnapshotTestJSON-294013348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee7fec36-2d01-401a-9bcf-ccdf0ee298d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:05:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-366990122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=575d441f-8115-4641-a19b-7ea22e3cbfce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f16165408b0406ca7fe3ce06cb4a958',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:05:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:05:03Z,use_quota=True,user_id='81a44207522d4e189834be1c317fb14a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-74141276-5de9-4e3c-9fa3-a1fe7faa76c2 tempest-VolumesSnapshotTestJSON-294013348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67e1b414-7559-46e6-9cb2-89bed2cf3bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-74141276-5de9-4e3c-9fa3-a1fe7faa76c2 tempest-VolumesSnapshotTestJSON-294013348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67e1b414-7559-46e6-9cb2-89bed2cf3bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-74141276-5de9-4e3c-9fa3-a1fe7faa76c2 tempest-VolumesSnapshotTestJSON-294013348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51ae63a7-53de-4644-bae0-c9c8a786db0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-74141276-5de9-4e3c-9fa3-a1fe7faa76c2 tempest-VolumesSnapshotTestJSON-294013348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51ae63a7-53de-4644-bae0-c9c8a786db0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '575d441f-8115-4641-a19b-7ea22e3cbfce', 'volume_name': 'volume-575d441f-8115-4641-a19b-7ea22e3cbfce', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-74141276-5de9-4e3c-9fa3-a1fe7faa76c2 tempest-VolumesSnapshotTestJSON-294013348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab4a7293-26ff-48fd-84bd-2bbb88c1fb7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-74141276-5de9-4e3c-9fa3-a1fe7faa76c2 tempest-VolumesSnapshotTestJSON-294013348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab4a7293-26ff-48fd-84bd-2bbb88c1fb7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-74141276-5de9-4e3c-9fa3-a1fe7faa76c2 tempest-VolumesSnapshotTestJSON-294013348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (384e09a3-3b3b-49de-85a2-d1034d61a94f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:03 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-74141276-5de9-4e3c-9fa3-a1fe7faa76c2 tempest-VolumesSnapshotTestJSON-294013348 None] Volume 575d441f-8115-4641-a19b-7ea22e3cbfce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-575d441f-8115-4641-a19b-7ea22e3cbfce', 'volume_size': 1} Sep 28 15:05:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-74141276-5de9-4e3c-9fa3-a1fe7faa76c2 tempest-VolumesSnapshotTestJSON-294013348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-74141276-5de9-4e3c-9fa3-a1fe7faa76c2 tempest-VolumesSnapshotTestJSON-294013348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-74141276-5de9-4e3c-9fa3-a1fe7faa76c2 tempest-VolumesSnapshotTestJSON-294013348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:05:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-366990122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=575d441f-8115-4641-a19b-7ea22e3cbfce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f16165408b0406ca7fe3ce06cb4a958',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:05:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:05:03Z,use_quota=True,user_id='81a44207522d4e189834be1c317fb14a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:05:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-74141276-5de9-4e3c-9fa3-a1fe7faa76c2 tempest-VolumesSnapshotTestJSON-294013348 None] Creating volume 575d441f-8115-4641-a19b-7ea22e3cbfce {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:05:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-74141276-5de9-4e3c-9fa3-a1fe7faa76c2 tempest-VolumesSnapshotTestJSON-294013348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-74141276-5de9-4e3c-9fa3-a1fe7faa76c2 tempest-VolumesSnapshotTestJSON-294013348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-74141276-5de9-4e3c-9fa3-a1fe7faa76c2 tempest-VolumesSnapshotTestJSON-294013348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:05:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-74141276-5de9-4e3c-9fa3-a1fe7faa76c2 tempest-VolumesSnapshotTestJSON-294013348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:05:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-74141276-5de9-4e3c-9fa3-a1fe7faa76c2 tempest-VolumesSnapshotTestJSON-294013348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-74141276-5de9-4e3c-9fa3-a1fe7faa76c2 tempest-VolumesSnapshotTestJSON-294013348 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:05:03 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-74141276-5de9-4e3c-9fa3-a1fe7faa76c2 tempest-VolumesSnapshotTestJSON-294013348 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:05:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-74141276-5de9-4e3c-9fa3-a1fe7faa76c2 tempest-VolumesSnapshotTestJSON-294013348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-575d441f-8115-4641-a19b-7ea22e3cbfce 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:03 devstack sudo[102213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-575d441f-8115-4641-a19b-7ea22e3cbfce 1073741824 Sep 28 15:05:03 devstack sudo[102213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:03 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-3c243276-428f-49c0-b002-61e3a876ab18 req-355f891a-ab3c-4fcd-93fd-01fe3b768208 tempest-TestServerVolumeAttachScenarioOldVersion-2004515130 None] Terminate volume connection completed successfully. Sep 28 15:05:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-3c243276-428f-49c0-b002-61e3a876ab18 req-355f891a-ab3c-4fcd-93fd-01fe3b768208 tempest-TestServerVolumeAttachScenarioOldVersion-2004515130 None] Deleting attachment 9073566e-fc19-49ad-bfe3-6b9969fb9f47. {{(pid=87116) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:05:03 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f65df4d9-d1e7-4c1b-8e97-1dd29b931024 tempest-TestServerVolumeAttachScenarioOldVersion-2004515130 None] Acquiring lock "cinder-ddaa598c-cf46-4a32-8ccb-6b6c3bb8089e-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:03 devstack sudo[102213]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-74141276-5de9-4e3c-9fa3-a1fe7faa76c2 tempest-VolumesSnapshotTestJSON-294013348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-575d441f-8115-4641-a19b-7ea22e3cbfce 1073741824" returned: 0 in 0.690s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:03 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f65df4d9-d1e7-4c1b-8e97-1dd29b931024 tempest-TestServerVolumeAttachScenarioOldVersion-2004515130 None] Lock "cinder-ddaa598c-cf46-4a32-8ccb-6b6c3bb8089e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-74141276-5de9-4e3c-9fa3-a1fe7faa76c2 tempest-VolumesSnapshotTestJSON-294013348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-575d441f-8115-4641-a19b-7ea22e3cbfce {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:03 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f65df4d9-d1e7-4c1b-8e97-1dd29b931024 tempest-TestServerVolumeAttachScenarioOldVersion-2004515130 None] Acquiring lock "cinder-quobyte-ddaa598c-cf46-4a32-8ccb-6b6c3bb8089e" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:03 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f65df4d9-d1e7-4c1b-8e97-1dd29b931024 tempest-TestServerVolumeAttachScenarioOldVersion-2004515130 None] Lock "cinder-quobyte-ddaa598c-cf46-4a32-8ccb-6b6c3bb8089e" acquired by "delete_volume" :: waited 0.025s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:03 devstack sudo[102220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-575d441f-8115-4641-a19b-7ea22e3cbfce Sep 28 15:05:03 devstack sudo[102220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:03 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef122440-9183-4896-a50a-dc8babc624cb]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f65df4d9-d1e7-4c1b-8e97-1dd29b931024 tempest-TestServerVolumeAttachScenarioOldVersion-2004515130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ddaa598c-cf46-4a32-8ccb-6b6c3bb8089e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:04 devstack sudo[102222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ddaa598c-cf46-4a32-8ccb-6b6c3bb8089e Sep 28 15:05:04 devstack sudo[102222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:04 devstack sudo[102220]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-74141276-5de9-4e3c-9fa3-a1fe7faa76c2 tempest-VolumesSnapshotTestJSON-294013348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-575d441f-8115-4641-a19b-7ea22e3cbfce" returned: 0 in 0.365s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:04 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-74141276-5de9-4e3c-9fa3-a1fe7faa76c2 tempest-VolumesSnapshotTestJSON-294013348 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:05:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-74141276-5de9-4e3c-9fa3-a1fe7faa76c2 tempest-VolumesSnapshotTestJSON-294013348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-74141276-5de9-4e3c-9fa3-a1fe7faa76c2 tempest-VolumesSnapshotTestJSON-294013348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (384e09a3-3b3b-49de-85a2-d1034d61a94f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-575d441f-8115-4641-a19b-7ea22e3cbfce', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-74141276-5de9-4e3c-9fa3-a1fe7faa76c2 tempest-VolumesSnapshotTestJSON-294013348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b050284-9426-40b2-a9b7-823e8654750e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:04 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-74141276-5de9-4e3c-9fa3-a1fe7faa76c2 tempest-VolumesSnapshotTestJSON-294013348 None] Volume volume-575d441f-8115-4641-a19b-7ea22e3cbfce (575d441f-8115-4641-a19b-7ea22e3cbfce): created successfully Sep 28 15:05:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-74141276-5de9-4e3c-9fa3-a1fe7faa76c2 tempest-VolumesSnapshotTestJSON-294013348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b050284-9426-40b2-a9b7-823e8654750e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-74141276-5de9-4e3c-9fa3-a1fe7faa76c2 tempest-VolumesSnapshotTestJSON-294013348 None] Flow 'volume_create_manager' (fd787135-50ad-4862-9f71-6c10f43047ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:05:04 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-74141276-5de9-4e3c-9fa3-a1fe7faa76c2 tempest-VolumesSnapshotTestJSON-294013348 None] Created volume successfully. Sep 28 15:05:04 devstack sudo[102222]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f65df4d9-d1e7-4c1b-8e97-1dd29b931024 tempest-TestServerVolumeAttachScenarioOldVersion-2004515130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ddaa598c-cf46-4a32-8ccb-6b6c3bb8089e" returned: 0 in 0.506s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f65df4d9-d1e7-4c1b-8e97-1dd29b931024 tempest-TestServerVolumeAttachScenarioOldVersion-2004515130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ddaa598c-cf46-4a32-8ccb-6b6c3bb8089e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:04 devstack sudo[102228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ddaa598c-cf46-4a32-8ccb-6b6c3bb8089e Sep 28 15:05:04 devstack sudo[102228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:04 devstack sudo[102228]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f65df4d9-d1e7-4c1b-8e97-1dd29b931024 tempest-TestServerVolumeAttachScenarioOldVersion-2004515130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ddaa598c-cf46-4a32-8ccb-6b6c3bb8089e" returned: 0 in 0.307s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:04 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f65df4d9-d1e7-4c1b-8e97-1dd29b931024 tempest-TestServerVolumeAttachScenarioOldVersion-2004515130 None] Lock "cinder-quobyte-ddaa598c-cf46-4a32-8ccb-6b6c3bb8089e" released by "delete_volume" :: held 0.876s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:04 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-f65df4d9-d1e7-4c1b-8e97-1dd29b931024 tempest-TestServerVolumeAttachScenarioOldVersion-2004515130 None] Created reservations ['9c52fc7b-008d-4f41-8915-a74972d72f17', '26d72c63-28ce-48f6-a798-030bfabb96e8', '4af8ca22-4c69-4762-a0c2-dfa57ef6af64', '1c3f05c6-f37d-406c-b348-be79f59fb4e9'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:05:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f65df4d9-d1e7-4c1b-8e97-1dd29b931024 tempest-TestServerVolumeAttachScenarioOldVersion-2004515130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f65df4d9-d1e7-4c1b-8e97-1dd29b931024 tempest-TestServerVolumeAttachScenarioOldVersion-2004515130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:04 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f65df4d9-d1e7-4c1b-8e97-1dd29b931024 tempest-TestServerVolumeAttachScenarioOldVersion-2004515130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:05:04 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f65df4d9-d1e7-4c1b-8e97-1dd29b931024 tempest-TestServerVolumeAttachScenarioOldVersion-2004515130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:05:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f65df4d9-d1e7-4c1b-8e97-1dd29b931024 tempest-TestServerVolumeAttachScenarioOldVersion-2004515130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f65df4d9-d1e7-4c1b-8e97-1dd29b931024 tempest-TestServerVolumeAttachScenarioOldVersion-2004515130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:05 devstack sudo[102231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:05:05 devstack sudo[102231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-699357e4-0a43-477a-a1f7-0592738a56a5 tempest-VolumesSnapshotTestJSON-294013348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-699357e4-0a43-477a-a1f7-0592738a56a5 tempest-VolumesSnapshotTestJSON-294013348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:05 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-699357e4-0a43-477a-a1f7-0592738a56a5 tempest-VolumesSnapshotTestJSON-294013348 None] Creating offline snapshot e93db04f-96a7-42c9-9057-401d7e08d38e of volume 575d441f-8115-4641-a19b-7ea22e3cbfce {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:05:05 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf011c9-196d-4626-a03c-71e8e449b841]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-699357e4-0a43-477a-a1f7-0592738a56a5 tempest-VolumesSnapshotTestJSON-294013348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-575d441f-8115-4641-a19b-7ea22e3cbfce {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:05 devstack sudo[102231]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f65df4d9-d1e7-4c1b-8e97-1dd29b931024 tempest-TestServerVolumeAttachScenarioOldVersion-2004515130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.562s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:05 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-f65df4d9-d1e7-4c1b-8e97-1dd29b931024 tempest-TestServerVolumeAttachScenarioOldVersion-2004515130 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:05:05 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-f65df4d9-d1e7-4c1b-8e97-1dd29b931024 tempest-TestServerVolumeAttachScenarioOldVersion-2004515130 None] Deleted volume successfully. Sep 28 15:05:05 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f65df4d9-d1e7-4c1b-8e97-1dd29b931024 tempest-TestServerVolumeAttachScenarioOldVersion-2004515130 None] Lock "cinder-ddaa598c-cf46-4a32-8ccb-6b6c3bb8089e-delete_volume" released by "delete_volume" :: held 1.796s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:05 devstack sudo[102234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-575d441f-8115-4641-a19b-7ea22e3cbfce Sep 28 15:05:05 devstack sudo[102234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:06 devstack sudo[102234]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-699357e4-0a43-477a-a1f7-0592738a56a5 tempest-VolumesSnapshotTestJSON-294013348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-575d441f-8115-4641-a19b-7ea22e3cbfce" returned: 0 in 0.683s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-699357e4-0a43-477a-a1f7-0592738a56a5 tempest-VolumesSnapshotTestJSON-294013348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-575d441f-8115-4641-a19b-7ea22e3cbfce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-575d441f-8115-4641-a19b-7ea22e3cbfce.e93db04f-96a7-42c9-9057-401d7e08d38e 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:06 devstack sudo[102257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-575d441f-8115-4641-a19b-7ea22e3cbfce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-575d441f-8115-4641-a19b-7ea22e3cbfce.e93db04f-96a7-42c9-9057-401d7e08d38e 1G Sep 28 15:05:06 devstack sudo[102257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:06 devstack sudo[102257]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-699357e4-0a43-477a-a1f7-0592738a56a5 tempest-VolumesSnapshotTestJSON-294013348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-575d441f-8115-4641-a19b-7ea22e3cbfce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-575d441f-8115-4641-a19b-7ea22e3cbfce.e93db04f-96a7-42c9-9057-401d7e08d38e 1G" returned: 0 in 0.725s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-699357e4-0a43-477a-a1f7-0592738a56a5 tempest-VolumesSnapshotTestJSON-294013348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-575d441f-8115-4641-a19b-7ea22e3cbfce -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-575d441f-8115-4641-a19b-7ea22e3cbfce.e93db04f-96a7-42c9-9057-401d7e08d38e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:06 devstack sudo[102268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-575d441f-8115-4641-a19b-7ea22e3cbfce -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-575d441f-8115-4641-a19b-7ea22e3cbfce.e93db04f-96a7-42c9-9057-401d7e08d38e Sep 28 15:05:06 devstack sudo[102268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:07 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec634df8-a576-4ae3-bd2f-9f30c392e380 tempest-VolumesDeleteCascade-565550623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:05:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ec634df8-a576-4ae3-bd2f-9f30c392e380 tempest-VolumesDeleteCascade-565550623 None] Flow 'volume_create_manager' (3ef78121-5140-427f-9a02-6c1e0a13f0c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:05:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ec634df8-a576-4ae3-bd2f-9f30c392e380 tempest-VolumesDeleteCascade-565550623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (061b80c3-77d4-44a9-a9c8-2c2416a17d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ec634df8-a576-4ae3-bd2f-9f30c392e380 tempest-VolumesDeleteCascade-565550623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (061b80c3-77d4-44a9-a9c8-2c2416a17d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:05:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-260179353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73043f13-1143-4e1b-8cf3-d45793eeeb3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8237f3192f0a4427b887e840520befd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:05:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:05:07Z,use_quota=True,user_id='5db3bbdb29d7456f9fc0b31c43b82243',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ec634df8-a576-4ae3-bd2f-9f30c392e380 tempest-VolumesDeleteCascade-565550623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a39b393-7e84-44b9-8634-fd7e1c2207c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ec634df8-a576-4ae3-bd2f-9f30c392e380 tempest-VolumesDeleteCascade-565550623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a39b393-7e84-44b9-8634-fd7e1c2207c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ec634df8-a576-4ae3-bd2f-9f30c392e380 tempest-VolumesDeleteCascade-565550623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5c88796-7b9f-4b19-bd38-810c79956c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ec634df8-a576-4ae3-bd2f-9f30c392e380 tempest-VolumesDeleteCascade-565550623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5c88796-7b9f-4b19-bd38-810c79956c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73043f13-1143-4e1b-8cf3-d45793eeeb3a', 'volume_name': 'volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ec634df8-a576-4ae3-bd2f-9f30c392e380 tempest-VolumesDeleteCascade-565550623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43eb2ec7-dc9c-47bb-8415-ef53e3be1d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ec634df8-a576-4ae3-bd2f-9f30c392e380 tempest-VolumesDeleteCascade-565550623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43eb2ec7-dc9c-47bb-8415-ef53e3be1d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ec634df8-a576-4ae3-bd2f-9f30c392e380 tempest-VolumesDeleteCascade-565550623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd65c518-0d6e-4c3a-8870-388bf9cd406b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:07 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-ec634df8-a576-4ae3-bd2f-9f30c392e380 tempest-VolumesDeleteCascade-565550623 None] Volume 73043f13-1143-4e1b-8cf3-d45793eeeb3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a', 'volume_size': 1} Sep 28 15:05:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ec634df8-a576-4ae3-bd2f-9f30c392e380 tempest-VolumesDeleteCascade-565550623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:07 devstack sudo[102268]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-699357e4-0a43-477a-a1f7-0592738a56a5 tempest-VolumesSnapshotTestJSON-294013348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-575d441f-8115-4641-a19b-7ea22e3cbfce -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-575d441f-8115-4641-a19b-7ea22e3cbfce.e93db04f-96a7-42c9-9057-401d7e08d38e" returned: 0 in 0.681s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:07 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-699357e4-0a43-477a-a1f7-0592738a56a5 tempest-VolumesSnapshotTestJSON-294013348 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-575d441f-8115-4641-a19b-7ea22e3cbfce.e93db04f-96a7-42c9-9057-401d7e08d38e is being set with open permissions: ugo+rw Sep 28 15:05:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-699357e4-0a43-477a-a1f7-0592738a56a5 tempest-VolumesSnapshotTestJSON-294013348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-575d441f-8115-4641-a19b-7ea22e3cbfce.e93db04f-96a7-42c9-9057-401d7e08d38e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:07 devstack sudo[102275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-575d441f-8115-4641-a19b-7ea22e3cbfce.e93db04f-96a7-42c9-9057-401d7e08d38e Sep 28 15:05:07 devstack sudo[102275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:07 devstack sudo[102275]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-699357e4-0a43-477a-a1f7-0592738a56a5 tempest-VolumesSnapshotTestJSON-294013348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-575d441f-8115-4641-a19b-7ea22e3cbfce.e93db04f-96a7-42c9-9057-401d7e08d38e" returned: 0 in 0.325s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-699357e4-0a43-477a-a1f7-0592738a56a5 tempest-VolumesSnapshotTestJSON-294013348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-575d441f-8115-4641-a19b-7ea22e3cbfce.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:07 devstack sudo[102279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-575d441f-8115-4641-a19b-7ea22e3cbfce.info Sep 28 15:05:07 devstack sudo[102279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:08 devstack sudo[102279]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-699357e4-0a43-477a-a1f7-0592738a56a5 tempest-VolumesSnapshotTestJSON-294013348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-575d441f-8115-4641-a19b-7ea22e3cbfce.info" returned: 0 in 0.415s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:08 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-699357e4-0a43-477a-a1f7-0592738a56a5 tempest-VolumesSnapshotTestJSON-294013348 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-575d441f-8115-4641-a19b-7ea22e3cbfce.info is being set with open permissions: ugo+rw Sep 28 15:05:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-699357e4-0a43-477a-a1f7-0592738a56a5 tempest-VolumesSnapshotTestJSON-294013348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-575d441f-8115-4641-a19b-7ea22e3cbfce.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:08 devstack sudo[102283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-575d441f-8115-4641-a19b-7ea22e3cbfce.info Sep 28 15:05:08 devstack sudo[102283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:08 devstack sudo[102283]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-699357e4-0a43-477a-a1f7-0592738a56a5 tempest-VolumesSnapshotTestJSON-294013348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-575d441f-8115-4641-a19b-7ea22e3cbfce.info" returned: 0 in 0.417s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-699357e4-0a43-477a-a1f7-0592738a56a5 tempest-VolumesSnapshotTestJSON-294013348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.429s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ec634df8-a576-4ae3-bd2f-9f30c392e380 tempest-VolumesDeleteCascade-565550623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.451s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:08 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ec634df8-a576-4ae3-bd2f-9f30c392e380 tempest-VolumesDeleteCascade-565550623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:05:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-260179353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73043f13-1143-4e1b-8cf3-d45793eeeb3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8237f3192f0a4427b887e840520befd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:05:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:05:07Z,use_quota=True,user_id='5db3bbdb29d7456f9fc0b31c43b82243',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:05:08 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-ec634df8-a576-4ae3-bd2f-9f30c392e380 tempest-VolumesDeleteCascade-565550623 None] Creating volume 73043f13-1143-4e1b-8cf3-d45793eeeb3a {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:05:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ec634df8-a576-4ae3-bd2f-9f30c392e380 tempest-VolumesDeleteCascade-565550623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ec634df8-a576-4ae3-bd2f-9f30c392e380 tempest-VolumesDeleteCascade-565550623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:08 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ec634df8-a576-4ae3-bd2f-9f30c392e380 tempest-VolumesDeleteCascade-565550623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:05:08 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ec634df8-a576-4ae3-bd2f-9f30c392e380 tempest-VolumesDeleteCascade-565550623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:05:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ec634df8-a576-4ae3-bd2f-9f30c392e380 tempest-VolumesDeleteCascade-565550623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:08 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ec634df8-a576-4ae3-bd2f-9f30c392e380 tempest-VolumesDeleteCascade-565550623 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:05:08 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-ec634df8-a576-4ae3-bd2f-9f30c392e380 tempest-VolumesDeleteCascade-565550623 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:05:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ec634df8-a576-4ae3-bd2f-9f30c392e380 tempest-VolumesDeleteCascade-565550623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:08 devstack sudo[102286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a 1073741824 Sep 28 15:05:08 devstack sudo[102286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:08 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-699357e4-0a43-477a-a1f7-0592738a56a5 tempest-VolumesSnapshotTestJSON-294013348 None] Create snapshot completed successfully Sep 28 15:05:09 devstack sudo[102286]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ec634df8-a576-4ae3-bd2f-9f30c392e380 tempest-VolumesDeleteCascade-565550623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a 1073741824" returned: 0 in 0.628s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ec634df8-a576-4ae3-bd2f-9f30c392e380 tempest-VolumesDeleteCascade-565550623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:09 devstack sudo[102291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a Sep 28 15:05:09 devstack sudo[102291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:09 devstack sudo[102291]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ec634df8-a576-4ae3-bd2f-9f30c392e380 tempest-VolumesDeleteCascade-565550623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a" returned: 0 in 0.313s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:09 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ec634df8-a576-4ae3-bd2f-9f30c392e380 tempest-VolumesDeleteCascade-565550623 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:05:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ec634df8-a576-4ae3-bd2f-9f30c392e380 tempest-VolumesDeleteCascade-565550623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:09 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ec634df8-a576-4ae3-bd2f-9f30c392e380 tempest-VolumesDeleteCascade-565550623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd65c518-0d6e-4c3a-8870-388bf9cd406b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:09 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ec634df8-a576-4ae3-bd2f-9f30c392e380 tempest-VolumesDeleteCascade-565550623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7da2a02-6bc1-461c-a3af-469709b51702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:09 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-ec634df8-a576-4ae3-bd2f-9f30c392e380 tempest-VolumesDeleteCascade-565550623 None] Volume volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a (73043f13-1143-4e1b-8cf3-d45793eeeb3a): created successfully Sep 28 15:05:09 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ec634df8-a576-4ae3-bd2f-9f30c392e380 tempest-VolumesDeleteCascade-565550623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7da2a02-6bc1-461c-a3af-469709b51702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:09 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ec634df8-a576-4ae3-bd2f-9f30c392e380 tempest-VolumesDeleteCascade-565550623 None] Flow 'volume_create_manager' (3ef78121-5140-427f-9a02-6c1e0a13f0c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:05:09 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-ec634df8-a576-4ae3-bd2f-9f30c392e380 tempest-VolumesDeleteCascade-565550623 None] Created volume successfully. Sep 28 15:05:10 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-7158e22f-eaf4-4c88-ab50-6104081a763f tempest-VolumesSnapshotTestJSON-294013348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:05:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7158e22f-eaf4-4c88-ab50-6104081a763f tempest-VolumesSnapshotTestJSON-294013348 None] Flow 'volume_create_manager' (9609a60a-0ec0-4848-82bd-8386c6fef40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:05:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7158e22f-eaf4-4c88-ab50-6104081a763f tempest-VolumesSnapshotTestJSON-294013348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b43b8b9-8523-4f7e-99a3-a60d9a35fe31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7158e22f-eaf4-4c88-ab50-6104081a763f tempest-VolumesSnapshotTestJSON-294013348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b43b8b9-8523-4f7e-99a3-a60d9a35fe31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:05:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-683218713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb003ee8-1e76-4452-8eb1-51a746470154,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f16165408b0406ca7fe3ce06cb4a958',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:05:10Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=e93db04f-96a7-42c9-9057-401d7e08d38e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:05:10Z,use_quota=True,user_id='81a44207522d4e189834be1c317fb14a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7158e22f-eaf4-4c88-ab50-6104081a763f tempest-VolumesSnapshotTestJSON-294013348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c705a10e-5eb5-49dd-9c9b-931fbe098e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7158e22f-eaf4-4c88-ab50-6104081a763f tempest-VolumesSnapshotTestJSON-294013348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c705a10e-5eb5-49dd-9c9b-931fbe098e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7158e22f-eaf4-4c88-ab50-6104081a763f tempest-VolumesSnapshotTestJSON-294013348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a1205b8-90e5-4347-bea2-38e8f4ed5554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7158e22f-eaf4-4c88-ab50-6104081a763f tempest-VolumesSnapshotTestJSON-294013348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a1205b8-90e5-4347-bea2-38e8f4ed5554) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bb003ee8-1e76-4452-8eb1-51a746470154', 'volume_name': 'volume-bb003ee8-1e76-4452-8eb1-51a746470154', 'volume_size': 2, 'snapshot_id': 'e93db04f-96a7-42c9-9057-401d7e08d38e'}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7158e22f-eaf4-4c88-ab50-6104081a763f tempest-VolumesSnapshotTestJSON-294013348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bde562a0-62e0-49e2-ae03-ba4f74cda819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7158e22f-eaf4-4c88-ab50-6104081a763f tempest-VolumesSnapshotTestJSON-294013348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bde562a0-62e0-49e2-ae03-ba4f74cda819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7158e22f-eaf4-4c88-ab50-6104081a763f tempest-VolumesSnapshotTestJSON-294013348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e31ad44b-3388-4415-bff3-d7ae1fef1bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:10 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-7158e22f-eaf4-4c88-ab50-6104081a763f tempest-VolumesSnapshotTestJSON-294013348 None] Volume bb003ee8-1e76-4452-8eb1-51a746470154: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bb003ee8-1e76-4452-8eb1-51a746470154', 'volume_size': 2, 'snapshot_id': 'e93db04f-96a7-42c9-9057-401d7e08d38e'} Sep 28 15:05:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7158e22f-eaf4-4c88-ab50-6104081a763f tempest-VolumesSnapshotTestJSON-294013348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7158e22f-eaf4-4c88-ab50-6104081a763f tempest-VolumesSnapshotTestJSON-294013348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:10 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7158e22f-eaf4-4c88-ab50-6104081a763f tempest-VolumesSnapshotTestJSON-294013348 None] Acquiring lock "cinder-quobyte-e93db04f-96a7-42c9-9057-401d7e08d38e-bb003ee8-1e76-4452-8eb1-51a746470154" by "_create_volume_from_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:10 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7158e22f-eaf4-4c88-ab50-6104081a763f tempest-VolumesSnapshotTestJSON-294013348 None] Lock "cinder-quobyte-e93db04f-96a7-42c9-9057-401d7e08d38e-bb003ee8-1e76-4452-8eb1-51a746470154" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:10 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7158e22f-eaf4-4c88-ab50-6104081a763f tempest-VolumesSnapshotTestJSON-294013348 None] Creating volume bb003ee8-1e76-4452-8eb1-51a746470154 from snapshot e93db04f-96a7-42c9-9057-401d7e08d38e {{(pid=87116) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 15:05:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7158e22f-eaf4-4c88-ab50-6104081a763f tempest-VolumesSnapshotTestJSON-294013348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7158e22f-eaf4-4c88-ab50-6104081a763f tempest-VolumesSnapshotTestJSON-294013348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:10 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7158e22f-eaf4-4c88-ab50-6104081a763f tempest-VolumesSnapshotTestJSON-294013348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:05:10 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7158e22f-eaf4-4c88-ab50-6104081a763f tempest-VolumesSnapshotTestJSON-294013348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:05:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7158e22f-eaf4-4c88-ab50-6104081a763f tempest-VolumesSnapshotTestJSON-294013348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:10 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7158e22f-eaf4-4c88-ab50-6104081a763f tempest-VolumesSnapshotTestJSON-294013348 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:05:10 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7158e22f-eaf4-4c88-ab50-6104081a763f tempest-VolumesSnapshotTestJSON-294013348 None] Acquiring lock "cinder-quobyte-bb003ee8-1e76-4452-8eb1-51a746470154" by "_copy_volume_from_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:10 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7158e22f-eaf4-4c88-ab50-6104081a763f tempest-VolumesSnapshotTestJSON-294013348 None] Lock "cinder-quobyte-bb003ee8-1e76-4452-8eb1-51a746470154" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:10 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7158e22f-eaf4-4c88-ab50-6104081a763f tempest-VolumesSnapshotTestJSON-294013348 None] snapshot: e93db04f-96a7-42c9-9057-401d7e08d38e, volume: bb003ee8-1e76-4452-8eb1-51a746470154, {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 15:05:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ecf3337a-16dc-446a-8798-958d47e34ae0 tempest-VolumesDeleteCascade-565550623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7158e22f-eaf4-4c88-ab50-6104081a763f tempest-VolumesSnapshotTestJSON-294013348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7158e22f-eaf4-4c88-ab50-6104081a763f tempest-VolumesSnapshotTestJSON-294013348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:10 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7158e22f-eaf4-4c88-ab50-6104081a763f tempest-VolumesSnapshotTestJSON-294013348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:05:10 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7158e22f-eaf4-4c88-ab50-6104081a763f tempest-VolumesSnapshotTestJSON-294013348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:05:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7158e22f-eaf4-4c88-ab50-6104081a763f tempest-VolumesSnapshotTestJSON-294013348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:10 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[4624ece1-9a7f-423d-9c52-5474e2ea4d23]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7158e22f-eaf4-4c88-ab50-6104081a763f tempest-VolumesSnapshotTestJSON-294013348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-575d441f-8115-4641-a19b-7ea22e3cbfce.e93db04f-96a7-42c9-9057-401d7e08d38e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:10 devstack sudo[102295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-575d441f-8115-4641-a19b-7ea22e3cbfce.e93db04f-96a7-42c9-9057-401d7e08d38e Sep 28 15:05:10 devstack sudo[102295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:11 devstack sudo[102295]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7158e22f-eaf4-4c88-ab50-6104081a763f tempest-VolumesSnapshotTestJSON-294013348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-575d441f-8115-4641-a19b-7ea22e3cbfce.e93db04f-96a7-42c9-9057-401d7e08d38e" returned: 0 in 0.428s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:11 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-7158e22f-eaf4-4c88-ab50-6104081a763f tempest-VolumesSnapshotTestJSON-294013348 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-575d441f-8115-4641-a19b-7ea22e3cbfce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:05:11 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[33203306-7753-4577-8200-2c41822a3529]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7158e22f-eaf4-4c88-ab50-6104081a763f tempest-VolumesSnapshotTestJSON-294013348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-575d441f-8115-4641-a19b-7ea22e3cbfce {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:11 devstack sudo[102300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-575d441f-8115-4641-a19b-7ea22e3cbfce Sep 28 15:05:11 devstack sudo[102300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:11 devstack sudo[102300]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7158e22f-eaf4-4c88-ab50-6104081a763f tempest-VolumesSnapshotTestJSON-294013348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-575d441f-8115-4641-a19b-7ea22e3cbfce" returned: 0 in 0.443s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:11 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7158e22f-eaf4-4c88-ab50-6104081a763f tempest-VolumesSnapshotTestJSON-294013348 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-575d441f-8115-4641-a19b-7ea22e3cbfce {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 15:05:11 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7158e22f-eaf4-4c88-ab50-6104081a763f tempest-VolumesSnapshotTestJSON-294013348 None] Creating direct copy from snapshot {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 15:05:11 devstack cinder-volume[87116]: DEBUG cinder.utils [None req-7158e22f-eaf4-4c88-ab50-6104081a763f tempest-VolumesSnapshotTestJSON-294013348 None] Path /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bb003ee8-1e76-4452-8eb1-51a746470154 not found in is_blk_device check {{(pid=87116) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 15:05:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7158e22f-eaf4-4c88-ab50-6104081a763f tempest-VolumesSnapshotTestJSON-294013348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-575d441f-8115-4641-a19b-7ea22e3cbfce /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bb003ee8-1e76-4452-8eb1-51a746470154 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:11 devstack sudo[102305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-575d441f-8115-4641-a19b-7ea22e3cbfce /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bb003ee8-1e76-4452-8eb1-51a746470154 Sep 28 15:05:11 devstack sudo[102305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:16 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:05:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:16 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:05:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:05:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:17 devstack sudo[102319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:05:17 devstack sudo[102319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:17 devstack sudo[102319]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.399s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:17 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:05:17 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running periodic task VolumeManager._thread_info {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:05:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] thread count: 28 {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:05:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] thread info: [<_MainThread(MainThread, started 135146735652992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:05:19 devstack sudo[102305]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7158e22f-eaf4-4c88-ab50-6104081a763f tempest-VolumesSnapshotTestJSON-294013348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-575d441f-8115-4641-a19b-7ea22e3cbfce /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bb003ee8-1e76-4452-8eb1-51a746470154" returned: 0 in 7.787s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:19 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-7158e22f-eaf4-4c88-ab50-6104081a763f tempest-VolumesSnapshotTestJSON-294013348 None] Image conversion details: src /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-575d441f-8115-4641-a19b-7ea22e3cbfce, size 1024.00 MB, duration 7.79 sec, destination /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bb003ee8-1e76-4452-8eb1-51a746470154 {{(pid=87116) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:05:19 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-7158e22f-eaf4-4c88-ab50-6104081a763f tempest-VolumesSnapshotTestJSON-294013348 None] Converted 1024.00 MB image at 131.48 MB/s Sep 28 15:05:19 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-7158e22f-eaf4-4c88-ab50-6104081a763f tempest-VolumesSnapshotTestJSON-294013348 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bb003ee8-1e76-4452-8eb1-51a746470154 is being set with open permissions: ugo+rw Sep 28 15:05:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7158e22f-eaf4-4c88-ab50-6104081a763f tempest-VolumesSnapshotTestJSON-294013348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bb003ee8-1e76-4452-8eb1-51a746470154 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:19 devstack sudo[102323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bb003ee8-1e76-4452-8eb1-51a746470154 Sep 28 15:05:19 devstack sudo[102323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:19 devstack sudo[102323]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7158e22f-eaf4-4c88-ab50-6104081a763f tempest-VolumesSnapshotTestJSON-294013348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bb003ee8-1e76-4452-8eb1-51a746470154" returned: 0 in 0.287s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:19 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7158e22f-eaf4-4c88-ab50-6104081a763f tempest-VolumesSnapshotTestJSON-294013348 None] Lock "cinder-quobyte-bb003ee8-1e76-4452-8eb1-51a746470154" released by "_copy_volume_from_snapshot" :: held 9.059s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:19 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=114,cinder:INSERT=38,cinder:UPDATE=129,cinder:DELETE=9 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:05:19 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=111,cinder:INSERT=27,cinder:UPDATE=140,cinder:DELETE=14 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:05:19 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7158e22f-eaf4-4c88-ab50-6104081a763f tempest-VolumesSnapshotTestJSON-294013348 None] Lock "cinder-quobyte-e93db04f-96a7-42c9-9057-401d7e08d38e-bb003ee8-1e76-4452-8eb1-51a746470154" released by "_create_volume_from_snapshot" :: held 9.180s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7158e22f-eaf4-4c88-ab50-6104081a763f tempest-VolumesSnapshotTestJSON-294013348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.203s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ecf3337a-16dc-446a-8798-958d47e34ae0 tempest-VolumesDeleteCascade-565550623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.122s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-ecf3337a-16dc-446a-8798-958d47e34ae0 tempest-VolumesDeleteCascade-565550623 None] Creating offline snapshot 751923f3-4dc6-410e-9582-6ec4536de089 of volume 73043f13-1143-4e1b-8cf3-d45793eeeb3a {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:05:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7158e22f-eaf4-4c88-ab50-6104081a763f tempest-VolumesSnapshotTestJSON-294013348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e31ad44b-3388-4415-bff3-d7ae1fef1bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb003ee8-1e76-4452-8eb1-51a746470154', 'volume_size': 2, 'snapshot_id': 'e93db04f-96a7-42c9-9057-401d7e08d38e'}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7158e22f-eaf4-4c88-ab50-6104081a763f tempest-VolumesSnapshotTestJSON-294013348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68e4fc4c-7595-4700-9693-9f0d615d9a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:19 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[08023d37-5251-4cb6-9053-8ec89659406e]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ecf3337a-16dc-446a-8798-958d47e34ae0 tempest-VolumesDeleteCascade-565550623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:19 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-7158e22f-eaf4-4c88-ab50-6104081a763f tempest-VolumesSnapshotTestJSON-294013348 None] Volume volume-bb003ee8-1e76-4452-8eb1-51a746470154 (bb003ee8-1e76-4452-8eb1-51a746470154): created successfully Sep 28 15:05:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7158e22f-eaf4-4c88-ab50-6104081a763f tempest-VolumesSnapshotTestJSON-294013348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68e4fc4c-7595-4700-9693-9f0d615d9a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7158e22f-eaf4-4c88-ab50-6104081a763f tempest-VolumesSnapshotTestJSON-294013348 None] Flow 'volume_create_manager' (9609a60a-0ec0-4848-82bd-8386c6fef40c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:05:19 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-7158e22f-eaf4-4c88-ab50-6104081a763f tempest-VolumesSnapshotTestJSON-294013348 None] Created volume successfully. Sep 28 15:05:20 devstack sudo[102327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a Sep 28 15:05:20 devstack sudo[102327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:20 devstack sudo[102327]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ecf3337a-16dc-446a-8798-958d47e34ae0 tempest-VolumesDeleteCascade-565550623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a" returned: 0 in 0.492s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ecf3337a-16dc-446a-8798-958d47e34ae0 tempest-VolumesDeleteCascade-565550623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.751923f3-4dc6-410e-9582-6ec4536de089 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:20 devstack sudo[102332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.751923f3-4dc6-410e-9582-6ec4536de089 1G Sep 28 15:05:20 devstack sudo[102332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:20 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-30035056-c96f-4866-a086-f0326d0e59f9 tempest-VolumesSnapshotTestJSON-294013348 None] Acquiring lock "cinder-bb003ee8-1e76-4452-8eb1-51a746470154-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:20 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-30035056-c96f-4866-a086-f0326d0e59f9 tempest-VolumesSnapshotTestJSON-294013348 None] Lock "cinder-bb003ee8-1e76-4452-8eb1-51a746470154-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:20 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-30035056-c96f-4866-a086-f0326d0e59f9 tempest-VolumesSnapshotTestJSON-294013348 None] Acquiring lock "cinder-quobyte-bb003ee8-1e76-4452-8eb1-51a746470154" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:20 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-30035056-c96f-4866-a086-f0326d0e59f9 tempest-VolumesSnapshotTestJSON-294013348 None] Lock "cinder-quobyte-bb003ee8-1e76-4452-8eb1-51a746470154" acquired by "delete_volume" :: waited 0.019s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:20 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aecf315-d5d0-4a8e-ae5d-1c34cd37fef8]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-30035056-c96f-4866-a086-f0326d0e59f9 tempest-VolumesSnapshotTestJSON-294013348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bb003ee8-1e76-4452-8eb1-51a746470154 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:20 devstack sudo[102337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bb003ee8-1e76-4452-8eb1-51a746470154 Sep 28 15:05:20 devstack sudo[102337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:21 devstack sudo[102332]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ecf3337a-16dc-446a-8798-958d47e34ae0 tempest-VolumesDeleteCascade-565550623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.751923f3-4dc6-410e-9582-6ec4536de089 1G" returned: 0 in 0.716s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ecf3337a-16dc-446a-8798-958d47e34ae0 tempest-VolumesDeleteCascade-565550623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.751923f3-4dc6-410e-9582-6ec4536de089 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:21 devstack sudo[102342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.751923f3-4dc6-410e-9582-6ec4536de089 Sep 28 15:05:21 devstack sudo[102342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:21 devstack sudo[102337]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-30035056-c96f-4866-a086-f0326d0e59f9 tempest-VolumesSnapshotTestJSON-294013348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bb003ee8-1e76-4452-8eb1-51a746470154" returned: 0 in 0.545s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-30035056-c96f-4866-a086-f0326d0e59f9 tempest-VolumesSnapshotTestJSON-294013348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bb003ee8-1e76-4452-8eb1-51a746470154 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:21 devstack sudo[102347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bb003ee8-1e76-4452-8eb1-51a746470154 Sep 28 15:05:21 devstack sudo[102347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:21 devstack sudo[102342]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ecf3337a-16dc-446a-8798-958d47e34ae0 tempest-VolumesDeleteCascade-565550623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.751923f3-4dc6-410e-9582-6ec4536de089" returned: 0 in 0.378s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:21 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-ecf3337a-16dc-446a-8798-958d47e34ae0 tempest-VolumesDeleteCascade-565550623 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.751923f3-4dc6-410e-9582-6ec4536de089 is being set with open permissions: ugo+rw Sep 28 15:05:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ecf3337a-16dc-446a-8798-958d47e34ae0 tempest-VolumesDeleteCascade-565550623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.751923f3-4dc6-410e-9582-6ec4536de089 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:21 devstack sudo[102352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.751923f3-4dc6-410e-9582-6ec4536de089 Sep 28 15:05:21 devstack sudo[102352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:21 devstack sudo[102347]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-30035056-c96f-4866-a086-f0326d0e59f9 tempest-VolumesSnapshotTestJSON-294013348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bb003ee8-1e76-4452-8eb1-51a746470154" returned: 0 in 0.320s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:21 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-30035056-c96f-4866-a086-f0326d0e59f9 tempest-VolumesSnapshotTestJSON-294013348 None] Lock "cinder-quobyte-bb003ee8-1e76-4452-8eb1-51a746470154" released by "delete_volume" :: held 0.930s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:21 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-30035056-c96f-4866-a086-f0326d0e59f9 tempest-VolumesSnapshotTestJSON-294013348 None] Created reservations ['55f5a063-67c0-4eb1-a94b-604118b68470', '41d939e3-be47-429a-b6c4-86a110667609', 'ab335334-70b2-4237-83c3-90d210d3ad53', '2d6c6337-4c82-453a-b707-3a9f0add97f3'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:05:21 devstack sudo[102352]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ecf3337a-16dc-446a-8798-958d47e34ae0 tempest-VolumesDeleteCascade-565550623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.751923f3-4dc6-410e-9582-6ec4536de089" returned: 0 in 0.320s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ecf3337a-16dc-446a-8798-958d47e34ae0 tempest-VolumesDeleteCascade-565550623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-30035056-c96f-4866-a086-f0326d0e59f9 tempest-VolumesSnapshotTestJSON-294013348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-30035056-c96f-4866-a086-f0326d0e59f9 tempest-VolumesSnapshotTestJSON-294013348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:21 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-30035056-c96f-4866-a086-f0326d0e59f9 tempest-VolumesSnapshotTestJSON-294013348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:05:21 devstack sudo[102356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.info Sep 28 15:05:21 devstack sudo[102356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:21 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-30035056-c96f-4866-a086-f0326d0e59f9 tempest-VolumesSnapshotTestJSON-294013348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:05:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-30035056-c96f-4866-a086-f0326d0e59f9 tempest-VolumesSnapshotTestJSON-294013348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-30035056-c96f-4866-a086-f0326d0e59f9 tempest-VolumesSnapshotTestJSON-294013348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:21 devstack sudo[102358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:05:21 devstack sudo[102358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:22 devstack sudo[102356]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ecf3337a-16dc-446a-8798-958d47e34ae0 tempest-VolumesDeleteCascade-565550623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.info" returned: 0 in 0.315s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:22 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-ecf3337a-16dc-446a-8798-958d47e34ae0 tempest-VolumesDeleteCascade-565550623 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.info is being set with open permissions: ugo+rw Sep 28 15:05:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ecf3337a-16dc-446a-8798-958d47e34ae0 tempest-VolumesDeleteCascade-565550623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:22 devstack sudo[102362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.info Sep 28 15:05:22 devstack sudo[102362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:22 devstack sudo[102358]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-30035056-c96f-4866-a086-f0326d0e59f9 tempest-VolumesSnapshotTestJSON-294013348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.356s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:22 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-30035056-c96f-4866-a086-f0326d0e59f9 tempest-VolumesSnapshotTestJSON-294013348 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:05:22 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-30035056-c96f-4866-a086-f0326d0e59f9 tempest-VolumesSnapshotTestJSON-294013348 None] Deleted volume successfully. Sep 28 15:05:22 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-30035056-c96f-4866-a086-f0326d0e59f9 tempest-VolumesSnapshotTestJSON-294013348 None] Lock "cinder-bb003ee8-1e76-4452-8eb1-51a746470154-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:22 devstack sudo[102362]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ecf3337a-16dc-446a-8798-958d47e34ae0 tempest-VolumesDeleteCascade-565550623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.info" returned: 0 in 0.337s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ecf3337a-16dc-446a-8798-958d47e34ae0 tempest-VolumesDeleteCascade-565550623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.732s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:22 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-ecf3337a-16dc-446a-8798-958d47e34ae0 tempest-VolumesDeleteCascade-565550623 None] Create snapshot completed successfully Sep 28 15:05:22 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-46a98e3d-a5d1-41cd-922c-f02e024354fc tempest-VolumesSnapshotTestJSON-294013348 None] Acquiring lock "cinder-e93db04f-96a7-42c9-9057-401d7e08d38e-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:22 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-46a98e3d-a5d1-41cd-922c-f02e024354fc tempest-VolumesSnapshotTestJSON-294013348 None] Lock "cinder-e93db04f-96a7-42c9-9057-401d7e08d38e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:23 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-46a98e3d-a5d1-41cd-922c-f02e024354fc tempest-VolumesSnapshotTestJSON-294013348 None] Acquiring lock "cinder-quobyte-575d441f-8115-4641-a19b-7ea22e3cbfce" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:23 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-46a98e3d-a5d1-41cd-922c-f02e024354fc tempest-VolumesSnapshotTestJSON-294013348 None] Lock "cinder-quobyte-575d441f-8115-4641-a19b-7ea22e3cbfce" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:23 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-46a98e3d-a5d1-41cd-922c-f02e024354fc tempest-VolumesSnapshotTestJSON-294013348 None] Acquiring lock "cinder-quobyte-e93db04f-96a7-42c9-9057-401d7e08d38e" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:23 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-46a98e3d-a5d1-41cd-922c-f02e024354fc tempest-VolumesSnapshotTestJSON-294013348 None] Lock "cinder-quobyte-e93db04f-96a7-42c9-9057-401d7e08d38e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:23 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-46a98e3d-a5d1-41cd-922c-f02e024354fc tempest-VolumesSnapshotTestJSON-294013348 None] Deleting offline snapshot e93db04f-96a7-42c9-9057-401d7e08d38e of volume 575d441f-8115-4641-a19b-7ea22e3cbfce {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:05:23 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-46a98e3d-a5d1-41cd-922c-f02e024354fc tempest-VolumesSnapshotTestJSON-294013348 None] snapshot_file for this snap is: volume-575d441f-8115-4641-a19b-7ea22e3cbfce.e93db04f-96a7-42c9-9057-401d7e08d38e {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:05:23 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6f0665-8c4f-4516-97e5-74b0adf41fc8]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-46a98e3d-a5d1-41cd-922c-f02e024354fc tempest-VolumesSnapshotTestJSON-294013348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-575d441f-8115-4641-a19b-7ea22e3cbfce.e93db04f-96a7-42c9-9057-401d7e08d38e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:23 devstack sudo[102365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-575d441f-8115-4641-a19b-7ea22e3cbfce.e93db04f-96a7-42c9-9057-401d7e08d38e Sep 28 15:05:23 devstack sudo[102365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:23 devstack sudo[102365]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-46a98e3d-a5d1-41cd-922c-f02e024354fc tempest-VolumesSnapshotTestJSON-294013348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-575d441f-8115-4641-a19b-7ea22e3cbfce.e93db04f-96a7-42c9-9057-401d7e08d38e" returned: 0 in 0.570s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:23 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-46a98e3d-a5d1-41cd-922c-f02e024354fc tempest-VolumesSnapshotTestJSON-294013348 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-575d441f-8115-4641-a19b-7ea22e3cbfce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:05:23 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4c4ca4-0574-411d-95be-8cd7973e4679]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-46a98e3d-a5d1-41cd-922c-f02e024354fc tempest-VolumesSnapshotTestJSON-294013348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-575d441f-8115-4641-a19b-7ea22e3cbfce {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-163c26ea-2043-4911-b615-7d90a2cfccd3 tempest-VolumesDeleteCascade-565550623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-163c26ea-2043-4911-b615-7d90a2cfccd3 tempest-VolumesDeleteCascade-565550623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:23 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-163c26ea-2043-4911-b615-7d90a2cfccd3 tempest-VolumesDeleteCascade-565550623 None] Creating offline snapshot 90598e4c-3de5-466d-8e4a-b9d3f7c000b7 of volume 73043f13-1143-4e1b-8cf3-d45793eeeb3a {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:05:23 devstack sudo[102371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-575d441f-8115-4641-a19b-7ea22e3cbfce Sep 28 15:05:23 devstack sudo[102371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:23 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[642b5a94-3706-4c47-a883-e823733b267d]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-163c26ea-2043-4911-b615-7d90a2cfccd3 tempest-VolumesDeleteCascade-565550623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.751923f3-4dc6-410e-9582-6ec4536de089 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:23 devstack sudo[102373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.751923f3-4dc6-410e-9582-6ec4536de089 Sep 28 15:05:23 devstack sudo[102373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:24 devstack sudo[102373]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-163c26ea-2043-4911-b615-7d90a2cfccd3 tempest-VolumesDeleteCascade-565550623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.751923f3-4dc6-410e-9582-6ec4536de089" returned: 0 in 0.490s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:24 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-163c26ea-2043-4911-b615-7d90a2cfccd3 tempest-VolumesDeleteCascade-565550623 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:05:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-163c26ea-2043-4911-b615-7d90a2cfccd3 tempest-VolumesDeleteCascade-565550623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.751923f3-4dc6-410e-9582-6ec4536de089,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.90598e4c-3de5-466d-8e4a-b9d3f7c000b7 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:24 devstack sudo[102371]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-46a98e3d-a5d1-41cd-922c-f02e024354fc tempest-VolumesSnapshotTestJSON-294013348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-575d441f-8115-4641-a19b-7ea22e3cbfce" returned: 0 in 0.698s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:24 devstack sudo[102381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.751923f3-4dc6-410e-9582-6ec4536de089,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.90598e4c-3de5-466d-8e4a-b9d3f7c000b7 1G Sep 28 15:05:24 devstack sudo[102381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-46a98e3d-a5d1-41cd-922c-f02e024354fc tempest-VolumesSnapshotTestJSON-294013348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-575d441f-8115-4641-a19b-7ea22e3cbfce.e93db04f-96a7-42c9-9057-401d7e08d38e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:24 devstack sudo[102383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-575d441f-8115-4641-a19b-7ea22e3cbfce.e93db04f-96a7-42c9-9057-401d7e08d38e Sep 28 15:05:24 devstack sudo[102383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:24 devstack sudo[102383]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-46a98e3d-a5d1-41cd-922c-f02e024354fc tempest-VolumesSnapshotTestJSON-294013348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-575d441f-8115-4641-a19b-7ea22e3cbfce.e93db04f-96a7-42c9-9057-401d7e08d38e" returned: 0 in 0.511s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-46a98e3d-a5d1-41cd-922c-f02e024354fc tempest-VolumesSnapshotTestJSON-294013348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-575d441f-8115-4641-a19b-7ea22e3cbfce.e93db04f-96a7-42c9-9057-401d7e08d38e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:24 devstack sudo[102393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-575d441f-8115-4641-a19b-7ea22e3cbfce.e93db04f-96a7-42c9-9057-401d7e08d38e Sep 28 15:05:24 devstack sudo[102393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:25 devstack sudo[102381]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-163c26ea-2043-4911-b615-7d90a2cfccd3 tempest-VolumesDeleteCascade-565550623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.751923f3-4dc6-410e-9582-6ec4536de089,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.90598e4c-3de5-466d-8e4a-b9d3f7c000b7 1G" returned: 0 in 0.663s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-163c26ea-2043-4911-b615-7d90a2cfccd3 tempest-VolumesDeleteCascade-565550623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.751923f3-4dc6-410e-9582-6ec4536de089 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.90598e4c-3de5-466d-8e4a-b9d3f7c000b7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:25 devstack sudo[102396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.751923f3-4dc6-410e-9582-6ec4536de089 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.90598e4c-3de5-466d-8e4a-b9d3f7c000b7 Sep 28 15:05:25 devstack sudo[102396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:25 devstack sudo[102393]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-46a98e3d-a5d1-41cd-922c-f02e024354fc tempest-VolumesSnapshotTestJSON-294013348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-575d441f-8115-4641-a19b-7ea22e3cbfce.e93db04f-96a7-42c9-9057-401d7e08d38e" returned: 0 in 0.352s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:25 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-46a98e3d-a5d1-41cd-922c-f02e024354fc tempest-VolumesSnapshotTestJSON-294013348 None] Lock "cinder-quobyte-e93db04f-96a7-42c9-9057-401d7e08d38e" released by "_delete_snapshot" :: held 2.306s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:25 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-46a98e3d-a5d1-41cd-922c-f02e024354fc tempest-VolumesSnapshotTestJSON-294013348 None] Lock "cinder-quobyte-575d441f-8115-4641-a19b-7ea22e3cbfce" released by "delete_snapshot" :: held 2.333s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:25 devstack sudo[102396]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-163c26ea-2043-4911-b615-7d90a2cfccd3 tempest-VolumesDeleteCascade-565550623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.751923f3-4dc6-410e-9582-6ec4536de089 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.90598e4c-3de5-466d-8e4a-b9d3f7c000b7" returned: 0 in 0.400s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:25 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-163c26ea-2043-4911-b615-7d90a2cfccd3 tempest-VolumesDeleteCascade-565550623 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.90598e4c-3de5-466d-8e4a-b9d3f7c000b7 is being set with open permissions: ugo+rw Sep 28 15:05:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-163c26ea-2043-4911-b615-7d90a2cfccd3 tempest-VolumesDeleteCascade-565550623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.90598e4c-3de5-466d-8e4a-b9d3f7c000b7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:25 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-46a98e3d-a5d1-41cd-922c-f02e024354fc tempest-VolumesSnapshotTestJSON-294013348 None] Created reservations ['d25506aa-882c-444d-a409-878bb1925f9f', '8256cee0-ccb9-4b58-84c8-a392c3181d2f', '96a72ff3-67d7-4537-941b-d1a1697e1248', '75d3d083-0501-4659-8cde-d2789f73dc61'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:05:25 devstack sudo[102402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.90598e4c-3de5-466d-8e4a-b9d3f7c000b7 Sep 28 15:05:25 devstack sudo[102402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:25 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-46a98e3d-a5d1-41cd-922c-f02e024354fc tempest-VolumesSnapshotTestJSON-294013348 None] Delete snapshot completed successfully. Sep 28 15:05:25 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-46a98e3d-a5d1-41cd-922c-f02e024354fc tempest-VolumesSnapshotTestJSON-294013348 None] Lock "cinder-e93db04f-96a7-42c9-9057-401d7e08d38e-delete_snapshot" released by "delete_snapshot" :: held 2.551s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:25 devstack sudo[102402]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-163c26ea-2043-4911-b615-7d90a2cfccd3 tempest-VolumesDeleteCascade-565550623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.90598e4c-3de5-466d-8e4a-b9d3f7c000b7" returned: 0 in 0.304s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-163c26ea-2043-4911-b615-7d90a2cfccd3 tempest-VolumesDeleteCascade-565550623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.002s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:25 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-163c26ea-2043-4911-b615-7d90a2cfccd3 tempest-VolumesDeleteCascade-565550623 None] Create snapshot completed successfully Sep 28 15:05:25 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] Acquiring lock "cinder-73043f13-1143-4e1b-8cf3-d45793eeeb3a-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] Lock "cinder-73043f13-1143-4e1b-8cf3-d45793eeeb3a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] Performing cascade delete. {{(pid=87116) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 28 15:05:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] Acquiring lock "cinder-751923f3-4dc6-410e-9582-6ec4536de089-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] Lock "cinder-751923f3-4dc6-410e-9582-6ec4536de089-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] Acquiring lock "cinder-quobyte-73043f13-1143-4e1b-8cf3-d45793eeeb3a" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] Lock "cinder-quobyte-73043f13-1143-4e1b-8cf3-d45793eeeb3a" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] Acquiring lock "cinder-quobyte-751923f3-4dc6-410e-9582-6ec4536de089" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] Lock "cinder-quobyte-751923f3-4dc6-410e-9582-6ec4536de089" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] Deleting offline snapshot 751923f3-4dc6-410e-9582-6ec4536de089 of volume 73043f13-1143-4e1b-8cf3-d45793eeeb3a {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:05:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] snapshot_file for this snap is: volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.751923f3-4dc6-410e-9582-6ec4536de089 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:05:26 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d635673-489a-48a9-9539-980644500d87]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.751923f3-4dc6-410e-9582-6ec4536de089 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e649ed0d-dce9-44c3-8ffb-bc2f42dcd25e tempest-VolumesSnapshotTestJSON-294013348 None] Acquiring lock "cinder-575d441f-8115-4641-a19b-7ea22e3cbfce-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e649ed0d-dce9-44c3-8ffb-bc2f42dcd25e tempest-VolumesSnapshotTestJSON-294013348 None] Lock "cinder-575d441f-8115-4641-a19b-7ea22e3cbfce-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:26 devstack sudo[102405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.751923f3-4dc6-410e-9582-6ec4536de089 Sep 28 15:05:26 devstack sudo[102405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e649ed0d-dce9-44c3-8ffb-bc2f42dcd25e tempest-VolumesSnapshotTestJSON-294013348 None] Acquiring lock "cinder-quobyte-575d441f-8115-4641-a19b-7ea22e3cbfce" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e649ed0d-dce9-44c3-8ffb-bc2f42dcd25e tempest-VolumesSnapshotTestJSON-294013348 None] Lock "cinder-quobyte-575d441f-8115-4641-a19b-7ea22e3cbfce" acquired by "delete_volume" :: waited 0.023s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:26 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0494bf2-c55b-417a-ba0b-ae07fe48dd10]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e649ed0d-dce9-44c3-8ffb-bc2f42dcd25e tempest-VolumesSnapshotTestJSON-294013348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-575d441f-8115-4641-a19b-7ea22e3cbfce {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:26 devstack sudo[102407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-575d441f-8115-4641-a19b-7ea22e3cbfce Sep 28 15:05:26 devstack sudo[102407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:26 devstack sudo[102405]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.751923f3-4dc6-410e-9582-6ec4536de089" returned: 0 in 0.487s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:05:26 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e9b289-1ac6-48aa-a71a-7ade858dbc38]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:26 devstack sudo[102412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a Sep 28 15:05:26 devstack sudo[102412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:27 devstack sudo[102407]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e649ed0d-dce9-44c3-8ffb-bc2f42dcd25e tempest-VolumesSnapshotTestJSON-294013348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-575d441f-8115-4641-a19b-7ea22e3cbfce" returned: 0 in 0.498s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e649ed0d-dce9-44c3-8ffb-bc2f42dcd25e tempest-VolumesSnapshotTestJSON-294013348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-575d441f-8115-4641-a19b-7ea22e3cbfce {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:27 devstack sudo[102418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-575d441f-8115-4641-a19b-7ea22e3cbfce Sep 28 15:05:27 devstack sudo[102418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:27 devstack sudo[102412]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a" returned: 0 in 0.516s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:27 devstack sudo[102418]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e649ed0d-dce9-44c3-8ffb-bc2f42dcd25e tempest-VolumesSnapshotTestJSON-294013348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-575d441f-8115-4641-a19b-7ea22e3cbfce" returned: 0 in 0.330s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:27 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff3a7ab-f6d8-4f51-96f8-4d3f0a1a8902]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.90598e4c-3de5-466d-8e4a-b9d3f7c000b7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:27 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e649ed0d-dce9-44c3-8ffb-bc2f42dcd25e tempest-VolumesSnapshotTestJSON-294013348 None] Lock "cinder-quobyte-575d441f-8115-4641-a19b-7ea22e3cbfce" released by "delete_volume" :: held 0.923s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:27 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-e649ed0d-dce9-44c3-8ffb-bc2f42dcd25e tempest-VolumesSnapshotTestJSON-294013348 None] Created reservations ['4e59e908-318b-4618-a701-907424d96d04', '77ddb609-16db-459d-b7ab-6e9cb6bdc95c', 'c1f2998e-c89c-40cf-84ea-9a0476cdeae2', 'ab00364c-a6ab-4624-8c9e-0c30e334b846'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:05:27 devstack sudo[102424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.90598e4c-3de5-466d-8e4a-b9d3f7c000b7 Sep 28 15:05:27 devstack sudo[102424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e649ed0d-dce9-44c3-8ffb-bc2f42dcd25e tempest-VolumesSnapshotTestJSON-294013348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e649ed0d-dce9-44c3-8ffb-bc2f42dcd25e tempest-VolumesSnapshotTestJSON-294013348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e649ed0d-dce9-44c3-8ffb-bc2f42dcd25e tempest-VolumesSnapshotTestJSON-294013348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:05:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e649ed0d-dce9-44c3-8ffb-bc2f42dcd25e tempest-VolumesSnapshotTestJSON-294013348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:05:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e649ed0d-dce9-44c3-8ffb-bc2f42dcd25e tempest-VolumesSnapshotTestJSON-294013348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e649ed0d-dce9-44c3-8ffb-bc2f42dcd25e tempest-VolumesSnapshotTestJSON-294013348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:27 devstack sudo[102426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:05:27 devstack sudo[102426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:27 devstack sudo[102424]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.90598e4c-3de5-466d-8e4a-b9d3f7c000b7" returned: 0 in 0.530s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:05:27 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e193038-48b7-4cc0-b3bd-27b54beb2be6]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.751923f3-4dc6-410e-9582-6ec4536de089 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:28 devstack sudo[102426]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e649ed0d-dce9-44c3-8ffb-bc2f42dcd25e tempest-VolumesSnapshotTestJSON-294013348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.395s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:28 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-e649ed0d-dce9-44c3-8ffb-bc2f42dcd25e tempest-VolumesSnapshotTestJSON-294013348 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:05:28 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-e649ed0d-dce9-44c3-8ffb-bc2f42dcd25e tempest-VolumesSnapshotTestJSON-294013348 None] Deleted volume successfully. Sep 28 15:05:28 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e649ed0d-dce9-44c3-8ffb-bc2f42dcd25e tempest-VolumesSnapshotTestJSON-294013348 None] Lock "cinder-575d441f-8115-4641-a19b-7ea22e3cbfce-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:28 devstack sudo[102431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.751923f3-4dc6-410e-9582-6ec4536de089 Sep 28 15:05:28 devstack sudo[102431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:28 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d090171-4927-469e-95be-a021ffdfaf6d tempest-VolumesSnapshotTestJSON-294013348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:05:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7d090171-4927-469e-95be-a021ffdfaf6d tempest-VolumesSnapshotTestJSON-294013348 None] Flow 'volume_create_manager' (07df2ff1-954c-497a-98a7-303c36562d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:05:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7d090171-4927-469e-95be-a021ffdfaf6d tempest-VolumesSnapshotTestJSON-294013348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a47d6b62-45bd-40d3-91b0-de387b2aea25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7d090171-4927-469e-95be-a021ffdfaf6d tempest-VolumesSnapshotTestJSON-294013348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a47d6b62-45bd-40d3-91b0-de387b2aea25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-629187576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0da2f848-d9e4-4767-9a3a-9220e5a7431f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f16165408b0406ca7fe3ce06cb4a958',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:05:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:05:28Z,use_quota=True,user_id='81a44207522d4e189834be1c317fb14a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7d090171-4927-469e-95be-a021ffdfaf6d tempest-VolumesSnapshotTestJSON-294013348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60f4cdc4-32e5-4089-b6cd-c7c7b7d07183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7d090171-4927-469e-95be-a021ffdfaf6d tempest-VolumesSnapshotTestJSON-294013348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60f4cdc4-32e5-4089-b6cd-c7c7b7d07183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:28 devstack sudo[102431]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7d090171-4927-469e-95be-a021ffdfaf6d tempest-VolumesSnapshotTestJSON-294013348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (765c5740-cdd4-43a9-8768-34fdd02baad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7d090171-4927-469e-95be-a021ffdfaf6d tempest-VolumesSnapshotTestJSON-294013348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (765c5740-cdd4-43a9-8768-34fdd02baad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0da2f848-d9e4-4767-9a3a-9220e5a7431f', 'volume_name': 'volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7d090171-4927-469e-95be-a021ffdfaf6d tempest-VolumesSnapshotTestJSON-294013348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e54a6c08-137b-4306-8019-c308d8fbfd9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7d090171-4927-469e-95be-a021ffdfaf6d tempest-VolumesSnapshotTestJSON-294013348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e54a6c08-137b-4306-8019-c308d8fbfd9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7d090171-4927-469e-95be-a021ffdfaf6d tempest-VolumesSnapshotTestJSON-294013348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3382f06a-c71e-470c-8ba0-d3bc841c94f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:28 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-7d090171-4927-469e-95be-a021ffdfaf6d tempest-VolumesSnapshotTestJSON-294013348 None] Volume 0da2f848-d9e4-4767-9a3a-9220e5a7431f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f', 'volume_size': 1} Sep 28 15:05:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7d090171-4927-469e-95be-a021ffdfaf6d tempest-VolumesSnapshotTestJSON-294013348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7d090171-4927-469e-95be-a021ffdfaf6d tempest-VolumesSnapshotTestJSON-294013348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:28 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7d090171-4927-469e-95be-a021ffdfaf6d tempest-VolumesSnapshotTestJSON-294013348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-629187576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0da2f848-d9e4-4767-9a3a-9220e5a7431f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f16165408b0406ca7fe3ce06cb4a958',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:05:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:05:28Z,use_quota=True,user_id='81a44207522d4e189834be1c317fb14a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:05:28 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-7d090171-4927-469e-95be-a021ffdfaf6d tempest-VolumesSnapshotTestJSON-294013348 None] Creating volume 0da2f848-d9e4-4767-9a3a-9220e5a7431f {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:05:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7d090171-4927-469e-95be-a021ffdfaf6d tempest-VolumesSnapshotTestJSON-294013348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7d090171-4927-469e-95be-a021ffdfaf6d tempest-VolumesSnapshotTestJSON-294013348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:28 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7d090171-4927-469e-95be-a021ffdfaf6d tempest-VolumesSnapshotTestJSON-294013348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:05:28 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7d090171-4927-469e-95be-a021ffdfaf6d tempest-VolumesSnapshotTestJSON-294013348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:05:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7d090171-4927-469e-95be-a021ffdfaf6d tempest-VolumesSnapshotTestJSON-294013348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:28 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7d090171-4927-469e-95be-a021ffdfaf6d tempest-VolumesSnapshotTestJSON-294013348 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:05:28 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-7d090171-4927-469e-95be-a021ffdfaf6d tempest-VolumesSnapshotTestJSON-294013348 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:05:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7d090171-4927-469e-95be-a021ffdfaf6d tempest-VolumesSnapshotTestJSON-294013348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.751923f3-4dc6-410e-9582-6ec4536de089" returned: 0 in 0.637s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:28 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:05:28 devstack sudo[102438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f 1073741824 Sep 28 15:05:28 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8863df0-955d-4a82-99e0-a61f74f9306b]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:28 devstack sudo[102438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:28 devstack sudo[102440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a Sep 28 15:05:28 devstack sudo[102440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:29 devstack sudo[102440]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a" returned: 0 in 0.445s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.751923f3-4dc6-410e-9582-6ec4536de089 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:29 devstack sudo[102449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.751923f3-4dc6-410e-9582-6ec4536de089 Sep 28 15:05:29 devstack sudo[102449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:29 devstack sudo[102438]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7d090171-4927-469e-95be-a021ffdfaf6d tempest-VolumesSnapshotTestJSON-294013348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f 1073741824" returned: 0 in 0.597s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7d090171-4927-469e-95be-a021ffdfaf6d tempest-VolumesSnapshotTestJSON-294013348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:29 devstack sudo[102451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f Sep 28 15:05:29 devstack sudo[102451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:29 devstack sudo[102451]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7d090171-4927-469e-95be-a021ffdfaf6d tempest-VolumesSnapshotTestJSON-294013348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f" returned: 0 in 0.362s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:29 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7d090171-4927-469e-95be-a021ffdfaf6d tempest-VolumesSnapshotTestJSON-294013348 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:05:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7d090171-4927-469e-95be-a021ffdfaf6d tempest-VolumesSnapshotTestJSON-294013348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7d090171-4927-469e-95be-a021ffdfaf6d tempest-VolumesSnapshotTestJSON-294013348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3382f06a-c71e-470c-8ba0-d3bc841c94f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7d090171-4927-469e-95be-a021ffdfaf6d tempest-VolumesSnapshotTestJSON-294013348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2115ed30-3136-476f-96b7-925e7855157b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:29 devstack sudo[102449]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:29 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-7d090171-4927-469e-95be-a021ffdfaf6d tempest-VolumesSnapshotTestJSON-294013348 None] Volume volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f (0da2f848-d9e4-4767-9a3a-9220e5a7431f): created successfully Sep 28 15:05:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7d090171-4927-469e-95be-a021ffdfaf6d tempest-VolumesSnapshotTestJSON-294013348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2115ed30-3136-476f-96b7-925e7855157b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7d090171-4927-469e-95be-a021ffdfaf6d tempest-VolumesSnapshotTestJSON-294013348 None] Flow 'volume_create_manager' (07df2ff1-954c-497a-98a7-303c36562d3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:05:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.751923f3-4dc6-410e-9582-6ec4536de089" returned: 0 in 0.625s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.751923f3-4dc6-410e-9582-6ec4536de089 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:29 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-7d090171-4927-469e-95be-a021ffdfaf6d tempest-VolumesSnapshotTestJSON-294013348 None] Created volume successfully. Sep 28 15:05:29 devstack sudo[102457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.751923f3-4dc6-410e-9582-6ec4536de089 Sep 28 15:05:29 devstack sudo[102457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:29 devstack sudo[102457]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.751923f3-4dc6-410e-9582-6ec4536de089" returned: 0 in 0.348s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.90598e4c-3de5-466d-8e4a-b9d3f7c000b7 -F qcow2 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:30 devstack sudo[102460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.90598e4c-3de5-466d-8e4a-b9d3f7c000b7 -F qcow2 Sep 28 15:05:30 devstack sudo[102460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:30 devstack sudo[102460]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.90598e4c-3de5-466d-8e4a-b9d3f7c000b7 -F qcow2" returned: 0 in 0.548s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] Lock "cinder-quobyte-751923f3-4dc6-410e-9582-6ec4536de089" released by "_delete_snapshot" :: held 4.455s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] Lock "cinder-quobyte-73043f13-1143-4e1b-8cf3-d45793eeeb3a" released by "delete_snapshot" :: held 4.486s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:30 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] Created reservations ['e9c834df-ed06-4f29-9600-4c7d92ace5f0', '6d270f21-e00b-417a-8d0c-66d185f1bfe3', '3ea53c3f-542c-4b5a-b247-27b72995bd6f', '515ee902-cd56-493f-81d9-ae8b3f8c398d'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:05:30 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] Delete snapshot completed successfully. Sep 28 15:05:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] Lock "cinder-751923f3-4dc6-410e-9582-6ec4536de089-delete_snapshot" released by "delete_snapshot" :: held 4.727s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] Acquiring lock "cinder-90598e4c-3de5-466d-8e4a-b9d3f7c000b7-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] Lock "cinder-90598e4c-3de5-466d-8e4a-b9d3f7c000b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] Acquiring lock "cinder-quobyte-73043f13-1143-4e1b-8cf3-d45793eeeb3a" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] Lock "cinder-quobyte-73043f13-1143-4e1b-8cf3-d45793eeeb3a" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] Acquiring lock "cinder-quobyte-90598e4c-3de5-466d-8e4a-b9d3f7c000b7" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] Lock "cinder-quobyte-90598e4c-3de5-466d-8e4a-b9d3f7c000b7" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] Deleting offline snapshot 90598e4c-3de5-466d-8e4a-b9d3f7c000b7 of volume 73043f13-1143-4e1b-8cf3-d45793eeeb3a {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:05:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] snapshot_file for this snap is: volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.90598e4c-3de5-466d-8e4a-b9d3f7c000b7 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:05:31 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca534f3-3195-437b-972a-08718472b9bd]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.90598e4c-3de5-466d-8e4a-b9d3f7c000b7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f5ddbd52-57d1-4444-84e1-842f0a11b20f tempest-VolumesSnapshotTestJSON-294013348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f5ddbd52-57d1-4444-84e1-842f0a11b20f tempest-VolumesSnapshotTestJSON-294013348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:31 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-f5ddbd52-57d1-4444-84e1-842f0a11b20f tempest-VolumesSnapshotTestJSON-294013348 None] Creating offline snapshot f48b0850-e2a2-43f7-ba9e-c1c1667e18c3 of volume 0da2f848-d9e4-4767-9a3a-9220e5a7431f {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:05:31 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[72dd8a86-7907-47e7-975c-d076fac9dbfb]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f5ddbd52-57d1-4444-84e1-842f0a11b20f tempest-VolumesSnapshotTestJSON-294013348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:31 devstack sudo[102469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.90598e4c-3de5-466d-8e4a-b9d3f7c000b7 Sep 28 15:05:31 devstack sudo[102469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:31 devstack sudo[102470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f Sep 28 15:05:31 devstack sudo[102470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:31 devstack sudo[102469]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.90598e4c-3de5-466d-8e4a-b9d3f7c000b7" returned: 0 in 0.499s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:31 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:05:31 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[e633e212-ab09-4022-b768-f315855878f7]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:31 devstack sudo[102470]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f5ddbd52-57d1-4444-84e1-842f0a11b20f tempest-VolumesSnapshotTestJSON-294013348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f" returned: 0 in 0.576s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f5ddbd52-57d1-4444-84e1-842f0a11b20f tempest-VolumesSnapshotTestJSON-294013348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f.f48b0850-e2a2-43f7-ba9e-c1c1667e18c3 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:31 devstack sudo[102480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f.f48b0850-e2a2-43f7-ba9e-c1c1667e18c3 1G Sep 28 15:05:31 devstack sudo[102480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:31 devstack sudo[102479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a Sep 28 15:05:31 devstack sudo[102479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:32 devstack sudo[102479]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a" returned: 0 in 0.508s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.90598e4c-3de5-466d-8e4a-b9d3f7c000b7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:32 devstack sudo[102489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.90598e4c-3de5-466d-8e4a-b9d3f7c000b7 Sep 28 15:05:32 devstack sudo[102489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:32 devstack sudo[102480]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f5ddbd52-57d1-4444-84e1-842f0a11b20f tempest-VolumesSnapshotTestJSON-294013348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f.f48b0850-e2a2-43f7-ba9e-c1c1667e18c3 1G" returned: 0 in 0.619s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f5ddbd52-57d1-4444-84e1-842f0a11b20f tempest-VolumesSnapshotTestJSON-294013348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f.f48b0850-e2a2-43f7-ba9e-c1c1667e18c3 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:32 devstack sudo[102492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f.f48b0850-e2a2-43f7-ba9e-c1c1667e18c3 Sep 28 15:05:32 devstack sudo[102492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:32 devstack sudo[102489]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.90598e4c-3de5-466d-8e4a-b9d3f7c000b7" returned: 0 in 0.583s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.90598e4c-3de5-466d-8e4a-b9d3f7c000b7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:32 devstack sudo[102492]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f5ddbd52-57d1-4444-84e1-842f0a11b20f tempest-VolumesSnapshotTestJSON-294013348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f.f48b0850-e2a2-43f7-ba9e-c1c1667e18c3" returned: 0 in 0.397s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:32 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-f5ddbd52-57d1-4444-84e1-842f0a11b20f tempest-VolumesSnapshotTestJSON-294013348 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f.f48b0850-e2a2-43f7-ba9e-c1c1667e18c3 is being set with open permissions: ugo+rw Sep 28 15:05:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f5ddbd52-57d1-4444-84e1-842f0a11b20f tempest-VolumesSnapshotTestJSON-294013348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f.f48b0850-e2a2-43f7-ba9e-c1c1667e18c3 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:32 devstack sudo[102506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.90598e4c-3de5-466d-8e4a-b9d3f7c000b7 Sep 28 15:05:32 devstack sudo[102506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:32 devstack sudo[102507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f.f48b0850-e2a2-43f7-ba9e-c1c1667e18c3 Sep 28 15:05:32 devstack sudo[102507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:32 devstack sudo[102506]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a.90598e4c-3de5-466d-8e4a-b9d3f7c000b7" returned: 0 in 0.317s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:33 devstack sudo[102507]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] Lock "cinder-quobyte-90598e4c-3de5-466d-8e4a-b9d3f7c000b7" released by "_delete_snapshot" :: held 2.125s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f5ddbd52-57d1-4444-84e1-842f0a11b20f tempest-VolumesSnapshotTestJSON-294013348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f.f48b0850-e2a2-43f7-ba9e-c1c1667e18c3" returned: 0 in 0.368s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] Lock "cinder-quobyte-73043f13-1143-4e1b-8cf3-d45793eeeb3a" released by "delete_snapshot" :: held 2.177s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f5ddbd52-57d1-4444-84e1-842f0a11b20f tempest-VolumesSnapshotTestJSON-294013348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:33 devstack sudo[102512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f.info Sep 28 15:05:33 devstack sudo[102512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:33 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] Created reservations ['f135f780-de30-4de9-84e0-5e34088c5450', '61df6f36-7b97-4dcc-9755-2c8c0917a274', 'c3c3583b-e62f-46cd-a41a-e197775759d9', '194a2f6d-1dfb-4ebe-b48b-ff7b34a664db'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:05:33 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] Delete snapshot completed successfully. Sep 28 15:05:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] Lock "cinder-90598e4c-3de5-466d-8e4a-b9d3f7c000b7-delete_snapshot" released by "delete_snapshot" :: held 2.472s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] Snapshots deleted, issuing volume delete {{(pid=87116) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 28 15:05:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] Acquiring lock "cinder-quobyte-73043f13-1143-4e1b-8cf3-d45793eeeb3a" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] Lock "cinder-quobyte-73043f13-1143-4e1b-8cf3-d45793eeeb3a" acquired by "delete_volume" :: waited 0.025s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:33 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[651f2417-392b-4d7d-8681-8e1035ac0893]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:33 devstack sudo[102514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a Sep 28 15:05:33 devstack sudo[102514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:33 devstack sudo[102512]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f5ddbd52-57d1-4444-84e1-842f0a11b20f tempest-VolumesSnapshotTestJSON-294013348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f.info" returned: 0 in 0.426s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:33 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-f5ddbd52-57d1-4444-84e1-842f0a11b20f tempest-VolumesSnapshotTestJSON-294013348 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f.info is being set with open permissions: ugo+rw Sep 28 15:05:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f5ddbd52-57d1-4444-84e1-842f0a11b20f tempest-VolumesSnapshotTestJSON-294013348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:33 devstack sudo[102551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f.info Sep 28 15:05:33 devstack sudo[102551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:33 devstack sudo[102551]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f5ddbd52-57d1-4444-84e1-842f0a11b20f tempest-VolumesSnapshotTestJSON-294013348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f.info" returned: 0 in 0.391s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f5ddbd52-57d1-4444-84e1-842f0a11b20f tempest-VolumesSnapshotTestJSON-294013348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.950s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:34 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-f5ddbd52-57d1-4444-84e1-842f0a11b20f tempest-VolumesSnapshotTestJSON-294013348 None] Create snapshot completed successfully Sep 28 15:05:34 devstack sudo[102514]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a" returned: 0 in 0.621s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:34 devstack sudo[102559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a Sep 28 15:05:34 devstack sudo[102559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:34 devstack sudo[102559]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-73043f13-1143-4e1b-8cf3-d45793eeeb3a" returned: 0 in 0.408s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:34 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] Lock "cinder-quobyte-73043f13-1143-4e1b-8cf3-d45793eeeb3a" released by "delete_volume" :: held 1.140s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:34 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] Created reservations ['238a8455-67db-4af0-8241-8b3007814c7e', '1ba5d51e-f74e-422d-870e-82b77ab0b12b', '549126b1-c43f-414a-992b-7794f9b2dd91', '48f43885-5f65-4611-b4a4-f3d21fd84d75'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:05:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:34 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:05:34 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:05:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:34 devstack sudo[102562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:05:34 devstack sudo[102562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:35 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1206f02-e53b-40fb-a409-ec61ec71bb22 tempest-VolumesSnapshotTestJSON-294013348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:05:35 devstack sudo[102562]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d1206f02-e53b-40fb-a409-ec61ec71bb22 tempest-VolumesSnapshotTestJSON-294013348 None] Flow 'volume_create_manager' (8d67a2d8-bf92-4bc9-b25c-8054ae938de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:05:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d1206f02-e53b-40fb-a409-ec61ec71bb22 tempest-VolumesSnapshotTestJSON-294013348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9656463-621d-4867-b505-99585a86edaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.372s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:35 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:05:35 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] Deleted volume successfully. Sep 28 15:05:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d1206f02-e53b-40fb-a409-ec61ec71bb22 tempest-VolumesSnapshotTestJSON-294013348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9656463-621d-4867-b505-99585a86edaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:05:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-748038851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17f7f267-a051-41b7-926f-8bde1e1ea209,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f16165408b0406ca7fe3ce06cb4a958',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f48b0850-e2a2-43f7-ba9e-c1c1667e18c3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:05:35Z,use_quota=True,user_id='81a44207522d4e189834be1c317fb14a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d1206f02-e53b-40fb-a409-ec61ec71bb22 tempest-VolumesSnapshotTestJSON-294013348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (115d7418-23e0-468d-8d05-7797ec6207f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d1206f02-e53b-40fb-a409-ec61ec71bb22 tempest-VolumesSnapshotTestJSON-294013348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (115d7418-23e0-468d-8d05-7797ec6207f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d1206f02-e53b-40fb-a409-ec61ec71bb22 tempest-VolumesSnapshotTestJSON-294013348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43ba6de2-cb50-4b41-980d-cb7b9fbb7870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d1206f02-e53b-40fb-a409-ec61ec71bb22 tempest-VolumesSnapshotTestJSON-294013348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43ba6de2-cb50-4b41-980d-cb7b9fbb7870) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '17f7f267-a051-41b7-926f-8bde1e1ea209', 'volume_name': 'volume-17f7f267-a051-41b7-926f-8bde1e1ea209', 'volume_size': 1, 'snapshot_id': 'f48b0850-e2a2-43f7-ba9e-c1c1667e18c3'}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d1206f02-e53b-40fb-a409-ec61ec71bb22 tempest-VolumesSnapshotTestJSON-294013348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0515b940-289f-45a5-9701-2e60597ec34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d1206f02-e53b-40fb-a409-ec61ec71bb22 tempest-VolumesSnapshotTestJSON-294013348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0515b940-289f-45a5-9701-2e60597ec34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d1206f02-e53b-40fb-a409-ec61ec71bb22 tempest-VolumesSnapshotTestJSON-294013348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (462facc5-e9a8-4e53-960e-335e6ca10eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:35 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-d1206f02-e53b-40fb-a409-ec61ec71bb22 tempest-VolumesSnapshotTestJSON-294013348 None] Volume 17f7f267-a051-41b7-926f-8bde1e1ea209: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-17f7f267-a051-41b7-926f-8bde1e1ea209', 'volume_size': 1, 'snapshot_id': 'f48b0850-e2a2-43f7-ba9e-c1c1667e18c3'} Sep 28 15:05:35 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-95757d33-b5ab-413c-b609-cc6f804aaa72 tempest-VolumesDeleteCascade-565550623 None] Lock "cinder-73043f13-1143-4e1b-8cf3-d45793eeeb3a-delete_volume" released by "delete_volume" :: held 9.180s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d1206f02-e53b-40fb-a409-ec61ec71bb22 tempest-VolumesSnapshotTestJSON-294013348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d1206f02-e53b-40fb-a409-ec61ec71bb22 tempest-VolumesSnapshotTestJSON-294013348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:35 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d1206f02-e53b-40fb-a409-ec61ec71bb22 tempest-VolumesSnapshotTestJSON-294013348 None] Acquiring lock "cinder-quobyte-f48b0850-e2a2-43f7-ba9e-c1c1667e18c3-17f7f267-a051-41b7-926f-8bde1e1ea209" by "_create_volume_from_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:35 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d1206f02-e53b-40fb-a409-ec61ec71bb22 tempest-VolumesSnapshotTestJSON-294013348 None] Lock "cinder-quobyte-f48b0850-e2a2-43f7-ba9e-c1c1667e18c3-17f7f267-a051-41b7-926f-8bde1e1ea209" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d1206f02-e53b-40fb-a409-ec61ec71bb22 tempest-VolumesSnapshotTestJSON-294013348 None] Creating volume 17f7f267-a051-41b7-926f-8bde1e1ea209 from snapshot f48b0850-e2a2-43f7-ba9e-c1c1667e18c3 {{(pid=87116) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 15:05:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d1206f02-e53b-40fb-a409-ec61ec71bb22 tempest-VolumesSnapshotTestJSON-294013348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d1206f02-e53b-40fb-a409-ec61ec71bb22 tempest-VolumesSnapshotTestJSON-294013348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d1206f02-e53b-40fb-a409-ec61ec71bb22 tempest-VolumesSnapshotTestJSON-294013348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:05:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d1206f02-e53b-40fb-a409-ec61ec71bb22 tempest-VolumesSnapshotTestJSON-294013348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:05:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d1206f02-e53b-40fb-a409-ec61ec71bb22 tempest-VolumesSnapshotTestJSON-294013348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d1206f02-e53b-40fb-a409-ec61ec71bb22 tempest-VolumesSnapshotTestJSON-294013348 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:05:35 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d1206f02-e53b-40fb-a409-ec61ec71bb22 tempest-VolumesSnapshotTestJSON-294013348 None] Acquiring lock "cinder-quobyte-17f7f267-a051-41b7-926f-8bde1e1ea209" by "_copy_volume_from_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:35 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d1206f02-e53b-40fb-a409-ec61ec71bb22 tempest-VolumesSnapshotTestJSON-294013348 None] Lock "cinder-quobyte-17f7f267-a051-41b7-926f-8bde1e1ea209" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d1206f02-e53b-40fb-a409-ec61ec71bb22 tempest-VolumesSnapshotTestJSON-294013348 None] snapshot: f48b0850-e2a2-43f7-ba9e-c1c1667e18c3, volume: 17f7f267-a051-41b7-926f-8bde1e1ea209, {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 15:05:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d1206f02-e53b-40fb-a409-ec61ec71bb22 tempest-VolumesSnapshotTestJSON-294013348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d1206f02-e53b-40fb-a409-ec61ec71bb22 tempest-VolumesSnapshotTestJSON-294013348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d1206f02-e53b-40fb-a409-ec61ec71bb22 tempest-VolumesSnapshotTestJSON-294013348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:05:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d1206f02-e53b-40fb-a409-ec61ec71bb22 tempest-VolumesSnapshotTestJSON-294013348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:05:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d1206f02-e53b-40fb-a409-ec61ec71bb22 tempest-VolumesSnapshotTestJSON-294013348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:35 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[1522ad4b-fbc2-45a7-b39a-2b3afd3aa8d3]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d1206f02-e53b-40fb-a409-ec61ec71bb22 tempest-VolumesSnapshotTestJSON-294013348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f.f48b0850-e2a2-43f7-ba9e-c1c1667e18c3 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:35 devstack sudo[102565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f.f48b0850-e2a2-43f7-ba9e-c1c1667e18c3 Sep 28 15:05:35 devstack sudo[102565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:35 devstack sudo[102565]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d1206f02-e53b-40fb-a409-ec61ec71bb22 tempest-VolumesSnapshotTestJSON-294013348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f.f48b0850-e2a2-43f7-ba9e-c1c1667e18c3" returned: 0 in 0.486s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-d1206f02-e53b-40fb-a409-ec61ec71bb22 tempest-VolumesSnapshotTestJSON-294013348 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:05:35 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a390ad-58ca-4179-8362-7d321d156a34]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d1206f02-e53b-40fb-a409-ec61ec71bb22 tempest-VolumesSnapshotTestJSON-294013348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:36 devstack sudo[102570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f Sep 28 15:05:36 devstack sudo[102570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:36 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e3a705a-9000-47c7-8306-b84a70cf26a1 tempest-VolumesDeleteCascade-565550623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:05:36 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3e3a705a-9000-47c7-8306-b84a70cf26a1 tempest-VolumesDeleteCascade-565550623 None] Flow 'volume_create_manager' (91c503c2-46ba-4509-8032-eb8b08807d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:05:36 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3e3a705a-9000-47c7-8306-b84a70cf26a1 tempest-VolumesDeleteCascade-565550623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5291acbd-af7e-4abf-b9af-b3ac322d599d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:36 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3e3a705a-9000-47c7-8306-b84a70cf26a1 tempest-VolumesDeleteCascade-565550623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5291acbd-af7e-4abf-b9af-b3ac322d599d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:05:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-871863199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35be945c-10b3-45b2-b3cb-6cf4afc46209,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8237f3192f0a4427b887e840520befd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:05:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:05:36Z,use_quota=True,user_id='5db3bbdb29d7456f9fc0b31c43b82243',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:36 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3e3a705a-9000-47c7-8306-b84a70cf26a1 tempest-VolumesDeleteCascade-565550623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a83c9c0-f1bf-4e1d-8c02-dac8070e6bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:36 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3e3a705a-9000-47c7-8306-b84a70cf26a1 tempest-VolumesDeleteCascade-565550623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a83c9c0-f1bf-4e1d-8c02-dac8070e6bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:36 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3e3a705a-9000-47c7-8306-b84a70cf26a1 tempest-VolumesDeleteCascade-565550623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15acb849-75b3-498b-8422-e7039a3ec77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:36 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3e3a705a-9000-47c7-8306-b84a70cf26a1 tempest-VolumesDeleteCascade-565550623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15acb849-75b3-498b-8422-e7039a3ec77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35be945c-10b3-45b2-b3cb-6cf4afc46209', 'volume_name': 'volume-35be945c-10b3-45b2-b3cb-6cf4afc46209', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:36 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3e3a705a-9000-47c7-8306-b84a70cf26a1 tempest-VolumesDeleteCascade-565550623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (981a14e5-1537-4ce1-b119-cc592da8f665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:36 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3e3a705a-9000-47c7-8306-b84a70cf26a1 tempest-VolumesDeleteCascade-565550623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (981a14e5-1537-4ce1-b119-cc592da8f665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:36 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3e3a705a-9000-47c7-8306-b84a70cf26a1 tempest-VolumesDeleteCascade-565550623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f539dbe-afac-48e2-8f02-6749d537719a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:36 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-3e3a705a-9000-47c7-8306-b84a70cf26a1 tempest-VolumesDeleteCascade-565550623 None] Volume 35be945c-10b3-45b2-b3cb-6cf4afc46209: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35be945c-10b3-45b2-b3cb-6cf4afc46209', 'volume_size': 1} Sep 28 15:05:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3e3a705a-9000-47c7-8306-b84a70cf26a1 tempest-VolumesDeleteCascade-565550623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:36 devstack sudo[102570]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d1206f02-e53b-40fb-a409-ec61ec71bb22 tempest-VolumesSnapshotTestJSON-294013348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f" returned: 0 in 0.682s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:36 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d1206f02-e53b-40fb-a409-ec61ec71bb22 tempest-VolumesSnapshotTestJSON-294013348 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 15:05:36 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d1206f02-e53b-40fb-a409-ec61ec71bb22 tempest-VolumesSnapshotTestJSON-294013348 None] Creating direct copy from snapshot {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 15:05:36 devstack cinder-volume[87116]: DEBUG cinder.utils [None req-d1206f02-e53b-40fb-a409-ec61ec71bb22 tempest-VolumesSnapshotTestJSON-294013348 None] Path /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-17f7f267-a051-41b7-926f-8bde1e1ea209 not found in is_blk_device check {{(pid=87116) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 15:05:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d1206f02-e53b-40fb-a409-ec61ec71bb22 tempest-VolumesSnapshotTestJSON-294013348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-17f7f267-a051-41b7-926f-8bde1e1ea209 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:36 devstack sudo[102575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-17f7f267-a051-41b7-926f-8bde1e1ea209 Sep 28 15:05:36 devstack sudo[102575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:44 devstack sudo[102575]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d1206f02-e53b-40fb-a409-ec61ec71bb22 tempest-VolumesSnapshotTestJSON-294013348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-17f7f267-a051-41b7-926f-8bde1e1ea209" returned: 0 in 7.816s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:44 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-d1206f02-e53b-40fb-a409-ec61ec71bb22 tempest-VolumesSnapshotTestJSON-294013348 None] Image conversion details: src /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f, size 1024.00 MB, duration 7.82 sec, destination /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-17f7f267-a051-41b7-926f-8bde1e1ea209 {{(pid=87116) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:05:44 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-d1206f02-e53b-40fb-a409-ec61ec71bb22 tempest-VolumesSnapshotTestJSON-294013348 None] Converted 1024.00 MB image at 130.98 MB/s Sep 28 15:05:44 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-d1206f02-e53b-40fb-a409-ec61ec71bb22 tempest-VolumesSnapshotTestJSON-294013348 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-17f7f267-a051-41b7-926f-8bde1e1ea209 is being set with open permissions: ugo+rw Sep 28 15:05:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d1206f02-e53b-40fb-a409-ec61ec71bb22 tempest-VolumesSnapshotTestJSON-294013348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-17f7f267-a051-41b7-926f-8bde1e1ea209 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:44 devstack sudo[102589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-17f7f267-a051-41b7-926f-8bde1e1ea209 Sep 28 15:05:44 devstack sudo[102589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:44 devstack sudo[102589]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d1206f02-e53b-40fb-a409-ec61ec71bb22 tempest-VolumesSnapshotTestJSON-294013348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-17f7f267-a051-41b7-926f-8bde1e1ea209" returned: 0 in 0.300s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:44 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d1206f02-e53b-40fb-a409-ec61ec71bb22 tempest-VolumesSnapshotTestJSON-294013348 None] Lock "cinder-quobyte-17f7f267-a051-41b7-926f-8bde1e1ea209" released by "_copy_volume_from_snapshot" :: held 9.424s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:44 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d1206f02-e53b-40fb-a409-ec61ec71bb22 tempest-VolumesSnapshotTestJSON-294013348 None] Lock "cinder-quobyte-f48b0850-e2a2-43f7-ba9e-c1c1667e18c3-17f7f267-a051-41b7-926f-8bde1e1ea209" released by "_create_volume_from_snapshot" :: held 9.531s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d1206f02-e53b-40fb-a409-ec61ec71bb22 tempest-VolumesSnapshotTestJSON-294013348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.557s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3e3a705a-9000-47c7-8306-b84a70cf26a1 tempest-VolumesDeleteCascade-565550623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.320s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:44 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3e3a705a-9000-47c7-8306-b84a70cf26a1 tempest-VolumesDeleteCascade-565550623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:05:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-871863199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35be945c-10b3-45b2-b3cb-6cf4afc46209,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8237f3192f0a4427b887e840520befd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:05:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:05:36Z,use_quota=True,user_id='5db3bbdb29d7456f9fc0b31c43b82243',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:05:44 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-3e3a705a-9000-47c7-8306-b84a70cf26a1 tempest-VolumesDeleteCascade-565550623 None] Creating volume 35be945c-10b3-45b2-b3cb-6cf4afc46209 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:05:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3e3a705a-9000-47c7-8306-b84a70cf26a1 tempest-VolumesDeleteCascade-565550623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3e3a705a-9000-47c7-8306-b84a70cf26a1 tempest-VolumesDeleteCascade-565550623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:44 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3e3a705a-9000-47c7-8306-b84a70cf26a1 tempest-VolumesDeleteCascade-565550623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:05:44 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3e3a705a-9000-47c7-8306-b84a70cf26a1 tempest-VolumesDeleteCascade-565550623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:05:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3e3a705a-9000-47c7-8306-b84a70cf26a1 tempest-VolumesDeleteCascade-565550623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:44 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3e3a705a-9000-47c7-8306-b84a70cf26a1 tempest-VolumesDeleteCascade-565550623 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:05:44 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-3e3a705a-9000-47c7-8306-b84a70cf26a1 tempest-VolumesDeleteCascade-565550623 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:05:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3e3a705a-9000-47c7-8306-b84a70cf26a1 tempest-VolumesDeleteCascade-565550623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-35be945c-10b3-45b2-b3cb-6cf4afc46209 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:44 devstack sudo[102592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-35be945c-10b3-45b2-b3cb-6cf4afc46209 1073741824 Sep 28 15:05:44 devstack sudo[102592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:44 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d1206f02-e53b-40fb-a409-ec61ec71bb22 tempest-VolumesSnapshotTestJSON-294013348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (462facc5-e9a8-4e53-960e-335e6ca10eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17f7f267-a051-41b7-926f-8bde1e1ea209', 'volume_size': 1, 'snapshot_id': 'f48b0850-e2a2-43f7-ba9e-c1c1667e18c3'}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:44 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d1206f02-e53b-40fb-a409-ec61ec71bb22 tempest-VolumesSnapshotTestJSON-294013348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90f56404-1943-4266-87fd-ea526370b4b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:44 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-d1206f02-e53b-40fb-a409-ec61ec71bb22 tempest-VolumesSnapshotTestJSON-294013348 None] Volume volume-17f7f267-a051-41b7-926f-8bde1e1ea209 (17f7f267-a051-41b7-926f-8bde1e1ea209): created successfully Sep 28 15:05:44 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d1206f02-e53b-40fb-a409-ec61ec71bb22 tempest-VolumesSnapshotTestJSON-294013348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90f56404-1943-4266-87fd-ea526370b4b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:44 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d1206f02-e53b-40fb-a409-ec61ec71bb22 tempest-VolumesSnapshotTestJSON-294013348 None] Flow 'volume_create_manager' (8d67a2d8-bf92-4bc9-b25c-8054ae938de3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:05:44 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-d1206f02-e53b-40fb-a409-ec61ec71bb22 tempest-VolumesSnapshotTestJSON-294013348 None] Created volume successfully. Sep 28 15:05:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a800f6a8-0be5-4706-86f3-a45712246427 tempest-VolumesSnapshotTestJSON-294013348 None] Acquiring lock "cinder-17f7f267-a051-41b7-926f-8bde1e1ea209-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a800f6a8-0be5-4706-86f3-a45712246427 tempest-VolumesSnapshotTestJSON-294013348 None] Lock "cinder-17f7f267-a051-41b7-926f-8bde1e1ea209-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a800f6a8-0be5-4706-86f3-a45712246427 tempest-VolumesSnapshotTestJSON-294013348 None] Acquiring lock "cinder-quobyte-17f7f267-a051-41b7-926f-8bde1e1ea209" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a800f6a8-0be5-4706-86f3-a45712246427 tempest-VolumesSnapshotTestJSON-294013348 None] Lock "cinder-quobyte-17f7f267-a051-41b7-926f-8bde1e1ea209" acquired by "delete_volume" :: waited 0.026s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:45 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[3614e9f1-2db1-44c9-81b0-b5bb384d72ed]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a800f6a8-0be5-4706-86f3-a45712246427 tempest-VolumesSnapshotTestJSON-294013348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-17f7f267-a051-41b7-926f-8bde1e1ea209 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:45 devstack sudo[102592]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3e3a705a-9000-47c7-8306-b84a70cf26a1 tempest-VolumesDeleteCascade-565550623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-35be945c-10b3-45b2-b3cb-6cf4afc46209 1073741824" returned: 0 in 0.735s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3e3a705a-9000-47c7-8306-b84a70cf26a1 tempest-VolumesDeleteCascade-565550623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-35be945c-10b3-45b2-b3cb-6cf4afc46209 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:45 devstack sudo[102598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-17f7f267-a051-41b7-926f-8bde1e1ea209 Sep 28 15:05:45 devstack sudo[102598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:45 devstack sudo[102600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-35be945c-10b3-45b2-b3cb-6cf4afc46209 Sep 28 15:05:45 devstack sudo[102600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:45 devstack sudo[102598]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a800f6a8-0be5-4706-86f3-a45712246427 tempest-VolumesSnapshotTestJSON-294013348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-17f7f267-a051-41b7-926f-8bde1e1ea209" returned: 0 in 0.480s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a800f6a8-0be5-4706-86f3-a45712246427 tempest-VolumesSnapshotTestJSON-294013348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-17f7f267-a051-41b7-926f-8bde1e1ea209 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:45 devstack sudo[102606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-17f7f267-a051-41b7-926f-8bde1e1ea209 Sep 28 15:05:45 devstack sudo[102606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:45 devstack sudo[102600]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3e3a705a-9000-47c7-8306-b84a70cf26a1 tempest-VolumesDeleteCascade-565550623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-35be945c-10b3-45b2-b3cb-6cf4afc46209" returned: 0 in 0.368s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:45 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3e3a705a-9000-47c7-8306-b84a70cf26a1 tempest-VolumesDeleteCascade-565550623 None] <== create_volume: return (1167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:05:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3e3a705a-9000-47c7-8306-b84a70cf26a1 tempest-VolumesDeleteCascade-565550623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3e3a705a-9000-47c7-8306-b84a70cf26a1 tempest-VolumesDeleteCascade-565550623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f539dbe-afac-48e2-8f02-6749d537719a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35be945c-10b3-45b2-b3cb-6cf4afc46209', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3e3a705a-9000-47c7-8306-b84a70cf26a1 tempest-VolumesDeleteCascade-565550623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9fcd4c4-a45f-4a89-8cca-9b43ee5e2616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:45 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-3e3a705a-9000-47c7-8306-b84a70cf26a1 tempest-VolumesDeleteCascade-565550623 None] Volume volume-35be945c-10b3-45b2-b3cb-6cf4afc46209 (35be945c-10b3-45b2-b3cb-6cf4afc46209): created successfully Sep 28 15:05:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3e3a705a-9000-47c7-8306-b84a70cf26a1 tempest-VolumesDeleteCascade-565550623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9fcd4c4-a45f-4a89-8cca-9b43ee5e2616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3e3a705a-9000-47c7-8306-b84a70cf26a1 tempest-VolumesDeleteCascade-565550623 None] Flow 'volume_create_manager' (91c503c2-46ba-4509-8032-eb8b08807d0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:05:45 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-3e3a705a-9000-47c7-8306-b84a70cf26a1 tempest-VolumesDeleteCascade-565550623 None] Created volume successfully. Sep 28 15:05:46 devstack sudo[102606]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a800f6a8-0be5-4706-86f3-a45712246427 tempest-VolumesSnapshotTestJSON-294013348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-17f7f267-a051-41b7-926f-8bde1e1ea209" returned: 0 in 0.332s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a800f6a8-0be5-4706-86f3-a45712246427 tempest-VolumesSnapshotTestJSON-294013348 None] Lock "cinder-quobyte-17f7f267-a051-41b7-926f-8bde1e1ea209" released by "delete_volume" :: held 0.880s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:46 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-a800f6a8-0be5-4706-86f3-a45712246427 tempest-VolumesSnapshotTestJSON-294013348 None] Created reservations ['44d72430-8f6f-46c5-9329-0efdb20dcd4f', '195232da-18cf-4f49-b03d-9b3017a4bfc5', 'd5796d7e-15cd-4069-b955-f99b6a6330e9', '70097aa9-a494-4aba-902d-99879a990e0a'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:05:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a800f6a8-0be5-4706-86f3-a45712246427 tempest-VolumesSnapshotTestJSON-294013348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a800f6a8-0be5-4706-86f3-a45712246427 tempest-VolumesSnapshotTestJSON-294013348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:46 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a800f6a8-0be5-4706-86f3-a45712246427 tempest-VolumesSnapshotTestJSON-294013348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:05:46 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a800f6a8-0be5-4706-86f3-a45712246427 tempest-VolumesSnapshotTestJSON-294013348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:05:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a800f6a8-0be5-4706-86f3-a45712246427 tempest-VolumesSnapshotTestJSON-294013348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a800f6a8-0be5-4706-86f3-a45712246427 tempest-VolumesSnapshotTestJSON-294013348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:46 devstack sudo[102609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:05:46 devstack sudo[102609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-095d3ddc-910c-4ff4-af90-05d087a81880 tempest-VolumesDeleteCascade-565550623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-095d3ddc-910c-4ff4-af90-05d087a81880 tempest-VolumesDeleteCascade-565550623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:46 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-095d3ddc-910c-4ff4-af90-05d087a81880 tempest-VolumesDeleteCascade-565550623 None] Creating offline snapshot aec2afd9-2e40-40a6-beff-530e50c7b72c of volume 35be945c-10b3-45b2-b3cb-6cf4afc46209 {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:05:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7fe228a9-1163-4120-87ac-3e1dad2a92c7 tempest-VolumesSnapshotTestJSON-294013348 None] Acquiring lock "cinder-f48b0850-e2a2-43f7-ba9e-c1c1667e18c3-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:46 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aad3a48-4ab9-4b3f-9978-ad83958559d6]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-095d3ddc-910c-4ff4-af90-05d087a81880 tempest-VolumesDeleteCascade-565550623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-35be945c-10b3-45b2-b3cb-6cf4afc46209 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7fe228a9-1163-4120-87ac-3e1dad2a92c7 tempest-VolumesSnapshotTestJSON-294013348 None] Lock "cinder-f48b0850-e2a2-43f7-ba9e-c1c1667e18c3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.062s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7fe228a9-1163-4120-87ac-3e1dad2a92c7 tempest-VolumesSnapshotTestJSON-294013348 None] Acquiring lock "cinder-quobyte-0da2f848-d9e4-4767-9a3a-9220e5a7431f" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7fe228a9-1163-4120-87ac-3e1dad2a92c7 tempest-VolumesSnapshotTestJSON-294013348 None] Lock "cinder-quobyte-0da2f848-d9e4-4767-9a3a-9220e5a7431f" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7fe228a9-1163-4120-87ac-3e1dad2a92c7 tempest-VolumesSnapshotTestJSON-294013348 None] Acquiring lock "cinder-quobyte-f48b0850-e2a2-43f7-ba9e-c1c1667e18c3" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7fe228a9-1163-4120-87ac-3e1dad2a92c7 tempest-VolumesSnapshotTestJSON-294013348 None] Lock "cinder-quobyte-f48b0850-e2a2-43f7-ba9e-c1c1667e18c3" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:46 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-7fe228a9-1163-4120-87ac-3e1dad2a92c7 tempest-VolumesSnapshotTestJSON-294013348 None] Deleting offline snapshot f48b0850-e2a2-43f7-ba9e-c1c1667e18c3 of volume 0da2f848-d9e4-4767-9a3a-9220e5a7431f {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:05:46 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-7fe228a9-1163-4120-87ac-3e1dad2a92c7 tempest-VolumesSnapshotTestJSON-294013348 None] snapshot_file for this snap is: volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f.f48b0850-e2a2-43f7-ba9e-c1c1667e18c3 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:05:46 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af00a45-bfc7-4ae3-93a1-5a6fce0be505]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7fe228a9-1163-4120-87ac-3e1dad2a92c7 tempest-VolumesSnapshotTestJSON-294013348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f.f48b0850-e2a2-43f7-ba9e-c1c1667e18c3 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:46 devstack sudo[102611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-35be945c-10b3-45b2-b3cb-6cf4afc46209 Sep 28 15:05:46 devstack sudo[102611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:46 devstack sudo[102609]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a800f6a8-0be5-4706-86f3-a45712246427 tempest-VolumesSnapshotTestJSON-294013348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.466s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:46 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-a800f6a8-0be5-4706-86f3-a45712246427 tempest-VolumesSnapshotTestJSON-294013348 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:05:46 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-a800f6a8-0be5-4706-86f3-a45712246427 tempest-VolumesSnapshotTestJSON-294013348 None] Deleted volume successfully. Sep 28 15:05:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a800f6a8-0be5-4706-86f3-a45712246427 tempest-VolumesSnapshotTestJSON-294013348 None] Lock "cinder-17f7f267-a051-41b7-926f-8bde1e1ea209-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:47 devstack sudo[102613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f.f48b0850-e2a2-43f7-ba9e-c1c1667e18c3 Sep 28 15:05:47 devstack sudo[102613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:47 devstack sudo[102611]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-095d3ddc-910c-4ff4-af90-05d087a81880 tempest-VolumesDeleteCascade-565550623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-35be945c-10b3-45b2-b3cb-6cf4afc46209" returned: 0 in 0.684s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-095d3ddc-910c-4ff4-af90-05d087a81880 tempest-VolumesDeleteCascade-565550623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-35be945c-10b3-45b2-b3cb-6cf4afc46209,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-35be945c-10b3-45b2-b3cb-6cf4afc46209.aec2afd9-2e40-40a6-beff-530e50c7b72c 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:47 devstack sudo[102623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-35be945c-10b3-45b2-b3cb-6cf4afc46209,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-35be945c-10b3-45b2-b3cb-6cf4afc46209.aec2afd9-2e40-40a6-beff-530e50c7b72c 1G Sep 28 15:05:47 devstack sudo[102623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:47 devstack sudo[102613]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7fe228a9-1163-4120-87ac-3e1dad2a92c7 tempest-VolumesSnapshotTestJSON-294013348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f.f48b0850-e2a2-43f7-ba9e-c1c1667e18c3" returned: 0 in 0.597s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:47 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-7fe228a9-1163-4120-87ac-3e1dad2a92c7 tempest-VolumesSnapshotTestJSON-294013348 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:05:47 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[da854992-3816-4538-82b7-11c1021464d7]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7fe228a9-1163-4120-87ac-3e1dad2a92c7 tempest-VolumesSnapshotTestJSON-294013348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:47 devstack sudo[102626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f Sep 28 15:05:47 devstack sudo[102626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:47 devstack sudo[102623]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-095d3ddc-910c-4ff4-af90-05d087a81880 tempest-VolumesDeleteCascade-565550623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-35be945c-10b3-45b2-b3cb-6cf4afc46209,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-35be945c-10b3-45b2-b3cb-6cf4afc46209.aec2afd9-2e40-40a6-beff-530e50c7b72c 1G" returned: 0 in 0.633s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-095d3ddc-910c-4ff4-af90-05d087a81880 tempest-VolumesDeleteCascade-565550623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35be945c-10b3-45b2-b3cb-6cf4afc46209 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-35be945c-10b3-45b2-b3cb-6cf4afc46209.aec2afd9-2e40-40a6-beff-530e50c7b72c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:47 devstack sudo[102633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35be945c-10b3-45b2-b3cb-6cf4afc46209 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-35be945c-10b3-45b2-b3cb-6cf4afc46209.aec2afd9-2e40-40a6-beff-530e50c7b72c Sep 28 15:05:47 devstack sudo[102633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:48 devstack sudo[102626]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7fe228a9-1163-4120-87ac-3e1dad2a92c7 tempest-VolumesSnapshotTestJSON-294013348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f" returned: 0 in 0.735s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7fe228a9-1163-4120-87ac-3e1dad2a92c7 tempest-VolumesSnapshotTestJSON-294013348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f.f48b0850-e2a2-43f7-ba9e-c1c1667e18c3 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:48 devstack sudo[102640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f.f48b0850-e2a2-43f7-ba9e-c1c1667e18c3 Sep 28 15:05:48 devstack sudo[102640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:48 devstack sudo[102633]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-095d3ddc-910c-4ff4-af90-05d087a81880 tempest-VolumesDeleteCascade-565550623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35be945c-10b3-45b2-b3cb-6cf4afc46209 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-35be945c-10b3-45b2-b3cb-6cf4afc46209.aec2afd9-2e40-40a6-beff-530e50c7b72c" returned: 0 in 0.357s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:48 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-095d3ddc-910c-4ff4-af90-05d087a81880 tempest-VolumesDeleteCascade-565550623 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-35be945c-10b3-45b2-b3cb-6cf4afc46209.aec2afd9-2e40-40a6-beff-530e50c7b72c is being set with open permissions: ugo+rw Sep 28 15:05:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-095d3ddc-910c-4ff4-af90-05d087a81880 tempest-VolumesDeleteCascade-565550623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-35be945c-10b3-45b2-b3cb-6cf4afc46209.aec2afd9-2e40-40a6-beff-530e50c7b72c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:48 devstack sudo[102643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-35be945c-10b3-45b2-b3cb-6cf4afc46209.aec2afd9-2e40-40a6-beff-530e50c7b72c Sep 28 15:05:48 devstack sudo[102643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:48 devstack sudo[102643]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-095d3ddc-910c-4ff4-af90-05d087a81880 tempest-VolumesDeleteCascade-565550623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-35be945c-10b3-45b2-b3cb-6cf4afc46209.aec2afd9-2e40-40a6-beff-530e50c7b72c" returned: 0 in 0.336s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:48 devstack sudo[102640]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7fe228a9-1163-4120-87ac-3e1dad2a92c7 tempest-VolumesSnapshotTestJSON-294013348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f.f48b0850-e2a2-43f7-ba9e-c1c1667e18c3" returned: 0 in 0.470s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7fe228a9-1163-4120-87ac-3e1dad2a92c7 tempest-VolumesSnapshotTestJSON-294013348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f.f48b0850-e2a2-43f7-ba9e-c1c1667e18c3 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-095d3ddc-910c-4ff4-af90-05d087a81880 tempest-VolumesDeleteCascade-565550623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-35be945c-10b3-45b2-b3cb-6cf4afc46209.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:48 devstack sudo[102650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f.f48b0850-e2a2-43f7-ba9e-c1c1667e18c3 Sep 28 15:05:48 devstack sudo[102650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:48 devstack sudo[102651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-35be945c-10b3-45b2-b3cb-6cf4afc46209.info Sep 28 15:05:48 devstack sudo[102651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:49 devstack sudo[102650]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7fe228a9-1163-4120-87ac-3e1dad2a92c7 tempest-VolumesSnapshotTestJSON-294013348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f.f48b0850-e2a2-43f7-ba9e-c1c1667e18c3" returned: 0 in 0.317s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:49 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7fe228a9-1163-4120-87ac-3e1dad2a92c7 tempest-VolumesSnapshotTestJSON-294013348 None] Lock "cinder-quobyte-f48b0850-e2a2-43f7-ba9e-c1c1667e18c3" released by "_delete_snapshot" :: held 2.327s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:49 devstack sudo[102651]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-095d3ddc-910c-4ff4-af90-05d087a81880 tempest-VolumesDeleteCascade-565550623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-35be945c-10b3-45b2-b3cb-6cf4afc46209.info" returned: 0 in 0.379s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:49 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-095d3ddc-910c-4ff4-af90-05d087a81880 tempest-VolumesDeleteCascade-565550623 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-35be945c-10b3-45b2-b3cb-6cf4afc46209.info is being set with open permissions: ugo+rw Sep 28 15:05:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-095d3ddc-910c-4ff4-af90-05d087a81880 tempest-VolumesDeleteCascade-565550623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-35be945c-10b3-45b2-b3cb-6cf4afc46209.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:49 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7fe228a9-1163-4120-87ac-3e1dad2a92c7 tempest-VolumesSnapshotTestJSON-294013348 None] Lock "cinder-quobyte-0da2f848-d9e4-4767-9a3a-9220e5a7431f" released by "delete_snapshot" :: held 2.394s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:49 devstack sudo[102656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-35be945c-10b3-45b2-b3cb-6cf4afc46209.info Sep 28 15:05:49 devstack sudo[102656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:49 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-7fe228a9-1163-4120-87ac-3e1dad2a92c7 tempest-VolumesSnapshotTestJSON-294013348 None] Created reservations ['cca5f066-9a5f-454a-bd56-73de9e031968', '3256134f-73a8-4759-9fbe-c4e629cf4796', 'ff70b478-5296-48fb-9ba1-d20bfbe89c3f', '14e01ff5-d6d6-4b73-b5f8-8e3566c51434'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:05:49 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-7fe228a9-1163-4120-87ac-3e1dad2a92c7 tempest-VolumesSnapshotTestJSON-294013348 None] Delete snapshot completed successfully. Sep 28 15:05:49 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7fe228a9-1163-4120-87ac-3e1dad2a92c7 tempest-VolumesSnapshotTestJSON-294013348 None] Lock "cinder-f48b0850-e2a2-43f7-ba9e-c1c1667e18c3-delete_snapshot" released by "delete_snapshot" :: held 2.678s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:49 devstack sudo[102656]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-095d3ddc-910c-4ff4-af90-05d087a81880 tempest-VolumesDeleteCascade-565550623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-35be945c-10b3-45b2-b3cb-6cf4afc46209.info" returned: 0 in 0.413s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-095d3ddc-910c-4ff4-af90-05d087a81880 tempest-VolumesDeleteCascade-565550623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.989s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:49 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-095d3ddc-910c-4ff4-af90-05d087a81880 tempest-VolumesDeleteCascade-565550623 None] Create snapshot completed successfully Sep 28 15:05:50 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-76ba55ea-60d2-4292-8dd6-dc0e4f9d80ca tempest-VolumesSnapshotTestJSON-294013348 None] Acquiring lock "cinder-0da2f848-d9e4-4767-9a3a-9220e5a7431f-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:50 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-76ba55ea-60d2-4292-8dd6-dc0e4f9d80ca tempest-VolumesSnapshotTestJSON-294013348 None] Lock "cinder-0da2f848-d9e4-4767-9a3a-9220e5a7431f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:50 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-76ba55ea-60d2-4292-8dd6-dc0e4f9d80ca tempest-VolumesSnapshotTestJSON-294013348 None] Acquiring lock "cinder-quobyte-0da2f848-d9e4-4767-9a3a-9220e5a7431f" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:50 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-76ba55ea-60d2-4292-8dd6-dc0e4f9d80ca tempest-VolumesSnapshotTestJSON-294013348 None] Lock "cinder-quobyte-0da2f848-d9e4-4767-9a3a-9220e5a7431f" acquired by "delete_volume" :: waited 0.016s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:50 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80874c0-90d9-4ce6-a6d1-d655c7e45958]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-76ba55ea-60d2-4292-8dd6-dc0e4f9d80ca tempest-VolumesSnapshotTestJSON-294013348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:50 devstack sudo[102659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f Sep 28 15:05:50 devstack sudo[102659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:50 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ad332c0-ed3a-4818-bad1-fab10cabfadf tempest-VolumesDeleteCascade-565550623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:05:50 devstack sudo[102659]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7ad332c0-ed3a-4818-bad1-fab10cabfadf tempest-VolumesDeleteCascade-565550623 None] Flow 'volume_create_manager' (4cadf009-52c6-44e1-83d9-a81b74b4637b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:05:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7ad332c0-ed3a-4818-bad1-fab10cabfadf tempest-VolumesDeleteCascade-565550623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da4ee99b-129d-4a73-9c2a-ee48a1ba15b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-76ba55ea-60d2-4292-8dd6-dc0e4f9d80ca tempest-VolumesSnapshotTestJSON-294013348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f" returned: 0 in 0.564s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-76ba55ea-60d2-4292-8dd6-dc0e4f9d80ca tempest-VolumesSnapshotTestJSON-294013348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7ad332c0-ed3a-4818-bad1-fab10cabfadf tempest-VolumesDeleteCascade-565550623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da4ee99b-129d-4a73-9c2a-ee48a1ba15b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-502194311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee227842-1024-49a6-b10e-c083592b28e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8237f3192f0a4427b887e840520befd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=aec2afd9-2e40-40a6-beff-530e50c7b72c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:05:51Z,use_quota=True,user_id='5db3bbdb29d7456f9fc0b31c43b82243',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:50 devstack sudo[102665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f Sep 28 15:05:50 devstack sudo[102665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7ad332c0-ed3a-4818-bad1-fab10cabfadf tempest-VolumesDeleteCascade-565550623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da65883a-1581-44d9-962b-04d5e712eda7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7ad332c0-ed3a-4818-bad1-fab10cabfadf tempest-VolumesDeleteCascade-565550623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da65883a-1581-44d9-962b-04d5e712eda7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7ad332c0-ed3a-4818-bad1-fab10cabfadf tempest-VolumesDeleteCascade-565550623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79c3a837-f59f-48c2-9de3-1a5bd75c3b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7ad332c0-ed3a-4818-bad1-fab10cabfadf tempest-VolumesDeleteCascade-565550623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79c3a837-f59f-48c2-9de3-1a5bd75c3b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ee227842-1024-49a6-b10e-c083592b28e3', 'volume_name': 'volume-ee227842-1024-49a6-b10e-c083592b28e3', 'volume_size': 1, 'snapshot_id': 'aec2afd9-2e40-40a6-beff-530e50c7b72c'}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7ad332c0-ed3a-4818-bad1-fab10cabfadf tempest-VolumesDeleteCascade-565550623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6a7f74b-8b5d-4a59-ad58-758569aa5561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7ad332c0-ed3a-4818-bad1-fab10cabfadf tempest-VolumesDeleteCascade-565550623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6a7f74b-8b5d-4a59-ad58-758569aa5561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7ad332c0-ed3a-4818-bad1-fab10cabfadf tempest-VolumesDeleteCascade-565550623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24a39261-82d8-4936-95ae-7b6ae3b13bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:50 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-7ad332c0-ed3a-4818-bad1-fab10cabfadf tempest-VolumesDeleteCascade-565550623 None] Volume ee227842-1024-49a6-b10e-c083592b28e3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ee227842-1024-49a6-b10e-c083592b28e3', 'volume_size': 1, 'snapshot_id': 'aec2afd9-2e40-40a6-beff-530e50c7b72c'} Sep 28 15:05:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7ad332c0-ed3a-4818-bad1-fab10cabfadf tempest-VolumesDeleteCascade-565550623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7ad332c0-ed3a-4818-bad1-fab10cabfadf tempest-VolumesDeleteCascade-565550623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:50 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7ad332c0-ed3a-4818-bad1-fab10cabfadf tempest-VolumesDeleteCascade-565550623 None] Acquiring lock "cinder-quobyte-aec2afd9-2e40-40a6-beff-530e50c7b72c-ee227842-1024-49a6-b10e-c083592b28e3" by "_create_volume_from_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:50 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7ad332c0-ed3a-4818-bad1-fab10cabfadf tempest-VolumesDeleteCascade-565550623 None] Lock "cinder-quobyte-aec2afd9-2e40-40a6-beff-530e50c7b72c-ee227842-1024-49a6-b10e-c083592b28e3" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:50 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7ad332c0-ed3a-4818-bad1-fab10cabfadf tempest-VolumesDeleteCascade-565550623 None] Creating volume ee227842-1024-49a6-b10e-c083592b28e3 from snapshot aec2afd9-2e40-40a6-beff-530e50c7b72c {{(pid=87116) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 15:05:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7ad332c0-ed3a-4818-bad1-fab10cabfadf tempest-VolumesDeleteCascade-565550623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7ad332c0-ed3a-4818-bad1-fab10cabfadf tempest-VolumesDeleteCascade-565550623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:50 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7ad332c0-ed3a-4818-bad1-fab10cabfadf tempest-VolumesDeleteCascade-565550623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:05:50 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7ad332c0-ed3a-4818-bad1-fab10cabfadf tempest-VolumesDeleteCascade-565550623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:05:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7ad332c0-ed3a-4818-bad1-fab10cabfadf tempest-VolumesDeleteCascade-565550623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:50 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7ad332c0-ed3a-4818-bad1-fab10cabfadf tempest-VolumesDeleteCascade-565550623 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:05:50 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7ad332c0-ed3a-4818-bad1-fab10cabfadf tempest-VolumesDeleteCascade-565550623 None] Acquiring lock "cinder-quobyte-ee227842-1024-49a6-b10e-c083592b28e3" by "_copy_volume_from_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:50 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7ad332c0-ed3a-4818-bad1-fab10cabfadf tempest-VolumesDeleteCascade-565550623 None] Lock "cinder-quobyte-ee227842-1024-49a6-b10e-c083592b28e3" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:50 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7ad332c0-ed3a-4818-bad1-fab10cabfadf tempest-VolumesDeleteCascade-565550623 None] snapshot: aec2afd9-2e40-40a6-beff-530e50c7b72c, volume: ee227842-1024-49a6-b10e-c083592b28e3, {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 15:05:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7ad332c0-ed3a-4818-bad1-fab10cabfadf tempest-VolumesDeleteCascade-565550623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7ad332c0-ed3a-4818-bad1-fab10cabfadf tempest-VolumesDeleteCascade-565550623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:50 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7ad332c0-ed3a-4818-bad1-fab10cabfadf tempest-VolumesDeleteCascade-565550623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:05:50 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7ad332c0-ed3a-4818-bad1-fab10cabfadf tempest-VolumesDeleteCascade-565550623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:05:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7ad332c0-ed3a-4818-bad1-fab10cabfadf tempest-VolumesDeleteCascade-565550623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:51 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[97de01d3-74f2-4039-85c9-354fd12a33af]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7ad332c0-ed3a-4818-bad1-fab10cabfadf tempest-VolumesDeleteCascade-565550623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-35be945c-10b3-45b2-b3cb-6cf4afc46209.aec2afd9-2e40-40a6-beff-530e50c7b72c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:51 devstack sudo[102665]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-76ba55ea-60d2-4292-8dd6-dc0e4f9d80ca tempest-VolumesSnapshotTestJSON-294013348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0da2f848-d9e4-4767-9a3a-9220e5a7431f" returned: 0 in 0.347s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:51 devstack sudo[102667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-35be945c-10b3-45b2-b3cb-6cf4afc46209.aec2afd9-2e40-40a6-beff-530e50c7b72c Sep 28 15:05:51 devstack sudo[102667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:51 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-76ba55ea-60d2-4292-8dd6-dc0e4f9d80ca tempest-VolumesSnapshotTestJSON-294013348 None] Lock "cinder-quobyte-0da2f848-d9e4-4767-9a3a-9220e5a7431f" released by "delete_volume" :: held 1.041s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:51 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-76ba55ea-60d2-4292-8dd6-dc0e4f9d80ca tempest-VolumesSnapshotTestJSON-294013348 None] Created reservations ['f1db647c-34a9-4a3c-bfdc-15e9dabbbc3d', 'a44c4d10-2499-4b58-906e-abd804e427bc', '484c5e06-fbe7-4a69-926a-6de14f00a5fe', '8b7a63a7-b117-4d24-ac00-85b76971c835'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:05:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-76ba55ea-60d2-4292-8dd6-dc0e4f9d80ca tempest-VolumesSnapshotTestJSON-294013348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-76ba55ea-60d2-4292-8dd6-dc0e4f9d80ca tempest-VolumesSnapshotTestJSON-294013348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:51 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-76ba55ea-60d2-4292-8dd6-dc0e4f9d80ca tempest-VolumesSnapshotTestJSON-294013348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:05:51 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-76ba55ea-60d2-4292-8dd6-dc0e4f9d80ca tempest-VolumesSnapshotTestJSON-294013348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:05:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-76ba55ea-60d2-4292-8dd6-dc0e4f9d80ca tempest-VolumesSnapshotTestJSON-294013348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-76ba55ea-60d2-4292-8dd6-dc0e4f9d80ca tempest-VolumesSnapshotTestJSON-294013348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:51 devstack sudo[102670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:05:51 devstack sudo[102670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:51 devstack sudo[102667]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7ad332c0-ed3a-4818-bad1-fab10cabfadf tempest-VolumesDeleteCascade-565550623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-35be945c-10b3-45b2-b3cb-6cf4afc46209.aec2afd9-2e40-40a6-beff-530e50c7b72c" returned: 0 in 0.573s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:51 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-7ad332c0-ed3a-4818-bad1-fab10cabfadf tempest-VolumesDeleteCascade-565550623 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35be945c-10b3-45b2-b3cb-6cf4afc46209(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:05:51 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c07db0-dbb5-491a-a30b-bd9fede653b6]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7ad332c0-ed3a-4818-bad1-fab10cabfadf tempest-VolumesDeleteCascade-565550623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-35be945c-10b3-45b2-b3cb-6cf4afc46209 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:51 devstack sudo[102675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-35be945c-10b3-45b2-b3cb-6cf4afc46209 Sep 28 15:05:51 devstack sudo[102675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:51 devstack sudo[102670]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-76ba55ea-60d2-4292-8dd6-dc0e4f9d80ca tempest-VolumesSnapshotTestJSON-294013348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.375s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:51 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-76ba55ea-60d2-4292-8dd6-dc0e4f9d80ca tempest-VolumesSnapshotTestJSON-294013348 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:05:51 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-76ba55ea-60d2-4292-8dd6-dc0e4f9d80ca tempest-VolumesSnapshotTestJSON-294013348 None] Deleted volume successfully. Sep 28 15:05:51 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-76ba55ea-60d2-4292-8dd6-dc0e4f9d80ca tempest-VolumesSnapshotTestJSON-294013348 None] Lock "cinder-0da2f848-d9e4-4767-9a3a-9220e5a7431f-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:52 devstack sudo[102675]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7ad332c0-ed3a-4818-bad1-fab10cabfadf tempest-VolumesDeleteCascade-565550623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-35be945c-10b3-45b2-b3cb-6cf4afc46209" returned: 0 in 0.471s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7ad332c0-ed3a-4818-bad1-fab10cabfadf tempest-VolumesDeleteCascade-565550623 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-35be945c-10b3-45b2-b3cb-6cf4afc46209 {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 15:05:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7ad332c0-ed3a-4818-bad1-fab10cabfadf tempest-VolumesDeleteCascade-565550623 None] Creating direct copy from snapshot {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 15:05:52 devstack cinder-volume[87116]: DEBUG cinder.utils [None req-7ad332c0-ed3a-4818-bad1-fab10cabfadf tempest-VolumesDeleteCascade-565550623 None] Path /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ee227842-1024-49a6-b10e-c083592b28e3 not found in is_blk_device check {{(pid=87116) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 15:05:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7ad332c0-ed3a-4818-bad1-fab10cabfadf tempest-VolumesDeleteCascade-565550623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-35be945c-10b3-45b2-b3cb-6cf4afc46209 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ee227842-1024-49a6-b10e-c083592b28e3 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:52 devstack sudo[102681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-35be945c-10b3-45b2-b3cb-6cf4afc46209 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ee227842-1024-49a6-b10e-c083592b28e3 Sep 28 15:05:52 devstack sudo[102681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:52 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-10222e6d-dcbe-45a7-b276-2013a6027c82 tempest-VolumesSnapshotTestJSON-294013348 None] Acquiring lock "cinder-af7ccced-0ee2-4be1-80e7-5e9c10836ec3-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:52 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-10222e6d-dcbe-45a7-b276-2013a6027c82 tempest-VolumesSnapshotTestJSON-294013348 None] Lock "cinder-af7ccced-0ee2-4be1-80e7-5e9c10836ec3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:52 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-10222e6d-dcbe-45a7-b276-2013a6027c82 tempest-VolumesSnapshotTestJSON-294013348 None] Acquiring lock "cinder-quobyte-af7ccced-0ee2-4be1-80e7-5e9c10836ec3" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:52 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-10222e6d-dcbe-45a7-b276-2013a6027c82 tempest-VolumesSnapshotTestJSON-294013348 None] Lock "cinder-quobyte-af7ccced-0ee2-4be1-80e7-5e9c10836ec3" acquired by "delete_volume" :: waited 0.024s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:52 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[0112da3a-efd3-4746-ae55-762a253b5c59]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-10222e6d-dcbe-45a7-b276-2013a6027c82 tempest-VolumesSnapshotTestJSON-294013348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-af7ccced-0ee2-4be1-80e7-5e9c10836ec3 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:52 devstack sudo[102686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-af7ccced-0ee2-4be1-80e7-5e9c10836ec3 Sep 28 15:05:52 devstack sudo[102686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:53 devstack sudo[102686]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-10222e6d-dcbe-45a7-b276-2013a6027c82 tempest-VolumesSnapshotTestJSON-294013348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-af7ccced-0ee2-4be1-80e7-5e9c10836ec3" returned: 0 in 0.693s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-10222e6d-dcbe-45a7-b276-2013a6027c82 tempest-VolumesSnapshotTestJSON-294013348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-af7ccced-0ee2-4be1-80e7-5e9c10836ec3 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:53 devstack sudo[102698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-af7ccced-0ee2-4be1-80e7-5e9c10836ec3 Sep 28 15:05:53 devstack sudo[102698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:53 devstack sudo[102698]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-10222e6d-dcbe-45a7-b276-2013a6027c82 tempest-VolumesSnapshotTestJSON-294013348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-af7ccced-0ee2-4be1-80e7-5e9c10836ec3" returned: 0 in 0.604s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:54 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-10222e6d-dcbe-45a7-b276-2013a6027c82 tempest-VolumesSnapshotTestJSON-294013348 None] Lock "cinder-quobyte-af7ccced-0ee2-4be1-80e7-5e9c10836ec3" released by "delete_volume" :: held 1.430s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:54 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-10222e6d-dcbe-45a7-b276-2013a6027c82 tempest-VolumesSnapshotTestJSON-294013348 None] Created reservations ['de21c938-d7a5-43ba-80fc-b7b7d4eb6329', '633b88ce-857b-40a4-b347-ace409706a5b', '34b013fb-d2d3-42dc-807f-baf2327a434a', 'e61953d6-4b57-4dd0-97a7-2758b6a3b3c9'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:05:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-10222e6d-dcbe-45a7-b276-2013a6027c82 tempest-VolumesSnapshotTestJSON-294013348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-10222e6d-dcbe-45a7-b276-2013a6027c82 tempest-VolumesSnapshotTestJSON-294013348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:54 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-10222e6d-dcbe-45a7-b276-2013a6027c82 tempest-VolumesSnapshotTestJSON-294013348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:05:54 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-10222e6d-dcbe-45a7-b276-2013a6027c82 tempest-VolumesSnapshotTestJSON-294013348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:05:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-10222e6d-dcbe-45a7-b276-2013a6027c82 tempest-VolumesSnapshotTestJSON-294013348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-10222e6d-dcbe-45a7-b276-2013a6027c82 tempest-VolumesSnapshotTestJSON-294013348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:54 devstack sudo[102701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:05:54 devstack sudo[102701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:55 devstack sudo[102701]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-10222e6d-dcbe-45a7-b276-2013a6027c82 tempest-VolumesSnapshotTestJSON-294013348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.867s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:55 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-10222e6d-dcbe-45a7-b276-2013a6027c82 tempest-VolumesSnapshotTestJSON-294013348 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:05:55 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-10222e6d-dcbe-45a7-b276-2013a6027c82 tempest-VolumesSnapshotTestJSON-294013348 None] Deleted volume successfully. Sep 28 15:05:55 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-10222e6d-dcbe-45a7-b276-2013a6027c82 tempest-VolumesSnapshotTestJSON-294013348 None] Lock "cinder-af7ccced-0ee2-4be1-80e7-5e9c10836ec3-delete_volume" released by "delete_volume" :: held 2.879s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:01 devstack sudo[102681]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7ad332c0-ed3a-4818-bad1-fab10cabfadf tempest-VolumesDeleteCascade-565550623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-35be945c-10b3-45b2-b3cb-6cf4afc46209 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ee227842-1024-49a6-b10e-c083592b28e3" returned: 0 in 9.000s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:01 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-7ad332c0-ed3a-4818-bad1-fab10cabfadf tempest-VolumesDeleteCascade-565550623 None] Image conversion details: src /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-35be945c-10b3-45b2-b3cb-6cf4afc46209, size 1024.00 MB, duration 9.00 sec, destination /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ee227842-1024-49a6-b10e-c083592b28e3 {{(pid=87116) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:06:01 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-7ad332c0-ed3a-4818-bad1-fab10cabfadf tempest-VolumesDeleteCascade-565550623 None] Converted 1024.00 MB image at 113.77 MB/s Sep 28 15:06:01 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-7ad332c0-ed3a-4818-bad1-fab10cabfadf tempest-VolumesDeleteCascade-565550623 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ee227842-1024-49a6-b10e-c083592b28e3 is being set with open permissions: ugo+rw Sep 28 15:06:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7ad332c0-ed3a-4818-bad1-fab10cabfadf tempest-VolumesDeleteCascade-565550623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ee227842-1024-49a6-b10e-c083592b28e3 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:01 devstack sudo[102707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ee227842-1024-49a6-b10e-c083592b28e3 Sep 28 15:06:01 devstack sudo[102707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:01 devstack sudo[102707]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7ad332c0-ed3a-4818-bad1-fab10cabfadf tempest-VolumesDeleteCascade-565550623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ee227842-1024-49a6-b10e-c083592b28e3" returned: 0 in 0.313s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:01 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7ad332c0-ed3a-4818-bad1-fab10cabfadf tempest-VolumesDeleteCascade-565550623 None] Lock "cinder-quobyte-ee227842-1024-49a6-b10e-c083592b28e3" released by "_copy_volume_from_snapshot" :: held 10.495s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:01 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7ad332c0-ed3a-4818-bad1-fab10cabfadf tempest-VolumesDeleteCascade-565550623 None] Lock "cinder-quobyte-aec2afd9-2e40-40a6-beff-530e50c7b72c-ee227842-1024-49a6-b10e-c083592b28e3" released by "_create_volume_from_snapshot" :: held 10.579s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7ad332c0-ed3a-4818-bad1-fab10cabfadf tempest-VolumesDeleteCascade-565550623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.603s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7ad332c0-ed3a-4818-bad1-fab10cabfadf tempest-VolumesDeleteCascade-565550623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24a39261-82d8-4936-95ae-7b6ae3b13bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee227842-1024-49a6-b10e-c083592b28e3', 'volume_size': 1, 'snapshot_id': 'aec2afd9-2e40-40a6-beff-530e50c7b72c'}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7ad332c0-ed3a-4818-bad1-fab10cabfadf tempest-VolumesDeleteCascade-565550623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bab96e0f-5526-4091-b5d3-02f2ff588341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:01 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-7ad332c0-ed3a-4818-bad1-fab10cabfadf tempest-VolumesDeleteCascade-565550623 None] Volume volume-ee227842-1024-49a6-b10e-c083592b28e3 (ee227842-1024-49a6-b10e-c083592b28e3): created successfully Sep 28 15:06:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7ad332c0-ed3a-4818-bad1-fab10cabfadf tempest-VolumesDeleteCascade-565550623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bab96e0f-5526-4091-b5d3-02f2ff588341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7ad332c0-ed3a-4818-bad1-fab10cabfadf tempest-VolumesDeleteCascade-565550623 None] Flow 'volume_create_manager' (4cadf009-52c6-44e1-83d9-a81b74b4637b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:01 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-7ad332c0-ed3a-4818-bad1-fab10cabfadf tempest-VolumesDeleteCascade-565550623 None] Created volume successfully. Sep 28 15:06:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ca6bae4c-e154-46f5-a725-f76994528d7c tempest-VolumesDeleteCascade-565550623 None] Acquiring lock "cinder-35be945c-10b3-45b2-b3cb-6cf4afc46209-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ca6bae4c-e154-46f5-a725-f76994528d7c tempest-VolumesDeleteCascade-565550623 None] Lock "cinder-35be945c-10b3-45b2-b3cb-6cf4afc46209-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ca6bae4c-e154-46f5-a725-f76994528d7c tempest-VolumesDeleteCascade-565550623 None] Performing cascade delete. {{(pid=87116) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 28 15:06:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ca6bae4c-e154-46f5-a725-f76994528d7c tempest-VolumesDeleteCascade-565550623 None] Acquiring lock "cinder-aec2afd9-2e40-40a6-beff-530e50c7b72c-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ca6bae4c-e154-46f5-a725-f76994528d7c tempest-VolumesDeleteCascade-565550623 None] Lock "cinder-aec2afd9-2e40-40a6-beff-530e50c7b72c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ca6bae4c-e154-46f5-a725-f76994528d7c tempest-VolumesDeleteCascade-565550623 None] Acquiring lock "cinder-quobyte-35be945c-10b3-45b2-b3cb-6cf4afc46209" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ca6bae4c-e154-46f5-a725-f76994528d7c tempest-VolumesDeleteCascade-565550623 None] Lock "cinder-quobyte-35be945c-10b3-45b2-b3cb-6cf4afc46209" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ca6bae4c-e154-46f5-a725-f76994528d7c tempest-VolumesDeleteCascade-565550623 None] Acquiring lock "cinder-quobyte-aec2afd9-2e40-40a6-beff-530e50c7b72c" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ca6bae4c-e154-46f5-a725-f76994528d7c tempest-VolumesDeleteCascade-565550623 None] Lock "cinder-quobyte-aec2afd9-2e40-40a6-beff-530e50c7b72c" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-ca6bae4c-e154-46f5-a725-f76994528d7c tempest-VolumesDeleteCascade-565550623 None] Deleting offline snapshot aec2afd9-2e40-40a6-beff-530e50c7b72c of volume 35be945c-10b3-45b2-b3cb-6cf4afc46209 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:06:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-ca6bae4c-e154-46f5-a725-f76994528d7c tempest-VolumesDeleteCascade-565550623 None] snapshot_file for this snap is: volume-35be945c-10b3-45b2-b3cb-6cf4afc46209.aec2afd9-2e40-40a6-beff-530e50c7b72c {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:06:02 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5841f92-f414-445d-a0d8-92a2534e4c61]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ca6bae4c-e154-46f5-a725-f76994528d7c tempest-VolumesDeleteCascade-565550623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-35be945c-10b3-45b2-b3cb-6cf4afc46209.aec2afd9-2e40-40a6-beff-530e50c7b72c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:02 devstack sudo[102710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-35be945c-10b3-45b2-b3cb-6cf4afc46209.aec2afd9-2e40-40a6-beff-530e50c7b72c Sep 28 15:06:02 devstack sudo[102710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:03 devstack sudo[102710]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ca6bae4c-e154-46f5-a725-f76994528d7c tempest-VolumesDeleteCascade-565550623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-35be945c-10b3-45b2-b3cb-6cf4afc46209.aec2afd9-2e40-40a6-beff-530e50c7b72c" returned: 0 in 0.641s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-ca6bae4c-e154-46f5-a725-f76994528d7c tempest-VolumesDeleteCascade-565550623 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35be945c-10b3-45b2-b3cb-6cf4afc46209(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:06:03 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46cb960-e909-43e8-bdcf-3625de896431]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ca6bae4c-e154-46f5-a725-f76994528d7c tempest-VolumesDeleteCascade-565550623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-35be945c-10b3-45b2-b3cb-6cf4afc46209 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:03 devstack sudo[102715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-35be945c-10b3-45b2-b3cb-6cf4afc46209 Sep 28 15:06:03 devstack sudo[102715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:03 devstack sudo[102715]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ca6bae4c-e154-46f5-a725-f76994528d7c tempest-VolumesDeleteCascade-565550623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-35be945c-10b3-45b2-b3cb-6cf4afc46209" returned: 0 in 0.725s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ca6bae4c-e154-46f5-a725-f76994528d7c tempest-VolumesDeleteCascade-565550623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-35be945c-10b3-45b2-b3cb-6cf4afc46209.aec2afd9-2e40-40a6-beff-530e50c7b72c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:03 devstack sudo[102721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-35be945c-10b3-45b2-b3cb-6cf4afc46209.aec2afd9-2e40-40a6-beff-530e50c7b72c Sep 28 15:06:03 devstack sudo[102721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:04 devstack sudo[102721]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ca6bae4c-e154-46f5-a725-f76994528d7c tempest-VolumesDeleteCascade-565550623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-35be945c-10b3-45b2-b3cb-6cf4afc46209.aec2afd9-2e40-40a6-beff-530e50c7b72c" returned: 0 in 0.529s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ca6bae4c-e154-46f5-a725-f76994528d7c tempest-VolumesDeleteCascade-565550623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-35be945c-10b3-45b2-b3cb-6cf4afc46209.aec2afd9-2e40-40a6-beff-530e50c7b72c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:04 devstack sudo[102728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-35be945c-10b3-45b2-b3cb-6cf4afc46209.aec2afd9-2e40-40a6-beff-530e50c7b72c Sep 28 15:06:04 devstack sudo[102728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:04 devstack sudo[102728]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ca6bae4c-e154-46f5-a725-f76994528d7c tempest-VolumesDeleteCascade-565550623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-35be945c-10b3-45b2-b3cb-6cf4afc46209.aec2afd9-2e40-40a6-beff-530e50c7b72c" returned: 0 in 0.371s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:04 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ca6bae4c-e154-46f5-a725-f76994528d7c tempest-VolumesDeleteCascade-565550623 None] Lock "cinder-quobyte-aec2afd9-2e40-40a6-beff-530e50c7b72c" released by "_delete_snapshot" :: held 2.416s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:04 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ca6bae4c-e154-46f5-a725-f76994528d7c tempest-VolumesDeleteCascade-565550623 None] Lock "cinder-quobyte-35be945c-10b3-45b2-b3cb-6cf4afc46209" released by "delete_snapshot" :: held 2.450s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:04 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-ca6bae4c-e154-46f5-a725-f76994528d7c tempest-VolumesDeleteCascade-565550623 None] Created reservations ['431f6102-9502-4f18-9962-ccd81878505e', '2ca71f5c-50a6-4036-bc7d-1d7c39f05c2c', 'cfcd3fce-3132-4452-ba3e-3b4f5927b839', '1c5c3dbf-7aa8-4324-a03a-aef7286963f2'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:06:05 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-ca6bae4c-e154-46f5-a725-f76994528d7c tempest-VolumesDeleteCascade-565550623 None] Delete snapshot completed successfully. Sep 28 15:06:05 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ca6bae4c-e154-46f5-a725-f76994528d7c tempest-VolumesDeleteCascade-565550623 None] Lock "cinder-aec2afd9-2e40-40a6-beff-530e50c7b72c-delete_snapshot" released by "delete_snapshot" :: held 2.672s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ca6bae4c-e154-46f5-a725-f76994528d7c tempest-VolumesDeleteCascade-565550623 None] Snapshots deleted, issuing volume delete {{(pid=87116) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 28 15:06:05 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ca6bae4c-e154-46f5-a725-f76994528d7c tempest-VolumesDeleteCascade-565550623 None] Acquiring lock "cinder-quobyte-35be945c-10b3-45b2-b3cb-6cf4afc46209" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:05 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ca6bae4c-e154-46f5-a725-f76994528d7c tempest-VolumesDeleteCascade-565550623 None] Lock "cinder-quobyte-35be945c-10b3-45b2-b3cb-6cf4afc46209" acquired by "delete_volume" :: waited 0.022s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:05 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08fc8c0-01d0-4886-84ec-8c1b9f7b0909]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ca6bae4c-e154-46f5-a725-f76994528d7c tempest-VolumesDeleteCascade-565550623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-35be945c-10b3-45b2-b3cb-6cf4afc46209 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:05 devstack sudo[102731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-35be945c-10b3-45b2-b3cb-6cf4afc46209 Sep 28 15:06:05 devstack sudo[102731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:05 devstack sudo[102731]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ca6bae4c-e154-46f5-a725-f76994528d7c tempest-VolumesDeleteCascade-565550623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-35be945c-10b3-45b2-b3cb-6cf4afc46209" returned: 0 in 0.601s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ca6bae4c-e154-46f5-a725-f76994528d7c tempest-VolumesDeleteCascade-565550623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-35be945c-10b3-45b2-b3cb-6cf4afc46209 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:05 devstack sudo[102736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-35be945c-10b3-45b2-b3cb-6cf4afc46209 Sep 28 15:06:05 devstack sudo[102736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:06 devstack sudo[102736]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ca6bae4c-e154-46f5-a725-f76994528d7c tempest-VolumesDeleteCascade-565550623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-35be945c-10b3-45b2-b3cb-6cf4afc46209" returned: 0 in 0.355s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ca6bae4c-e154-46f5-a725-f76994528d7c tempest-VolumesDeleteCascade-565550623 None] Lock "cinder-quobyte-35be945c-10b3-45b2-b3cb-6cf4afc46209" released by "delete_volume" :: held 1.063s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:06 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-ca6bae4c-e154-46f5-a725-f76994528d7c tempest-VolumesDeleteCascade-565550623 None] Created reservations ['363ab90f-ef2d-4793-8d8e-d2354c43e010', '91ba7a35-26f3-4b8c-9305-befeab3e3471', '77cb36fe-9b28-4fd1-8c4f-fd096b443929', '1ca50786-20a9-4880-ad6c-cf0fa757d0d9'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:06:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ca6bae4c-e154-46f5-a725-f76994528d7c tempest-VolumesDeleteCascade-565550623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ca6bae4c-e154-46f5-a725-f76994528d7c tempest-VolumesDeleteCascade-565550623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ca6bae4c-e154-46f5-a725-f76994528d7c tempest-VolumesDeleteCascade-565550623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:06:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ca6bae4c-e154-46f5-a725-f76994528d7c tempest-VolumesDeleteCascade-565550623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:06:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ca6bae4c-e154-46f5-a725-f76994528d7c tempest-VolumesDeleteCascade-565550623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ca6bae4c-e154-46f5-a725-f76994528d7c tempest-VolumesDeleteCascade-565550623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:06 devstack sudo[102739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:06:06 devstack sudo[102739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:06 devstack sudo[102739]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ca6bae4c-e154-46f5-a725-f76994528d7c tempest-VolumesDeleteCascade-565550623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.342s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:06 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-ca6bae4c-e154-46f5-a725-f76994528d7c tempest-VolumesDeleteCascade-565550623 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:06:06 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-ca6bae4c-e154-46f5-a725-f76994528d7c tempest-VolumesDeleteCascade-565550623 None] Deleted volume successfully. Sep 28 15:06:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ca6bae4c-e154-46f5-a725-f76994528d7c tempest-VolumesDeleteCascade-565550623 None] Lock "cinder-35be945c-10b3-45b2-b3cb-6cf4afc46209-delete_volume" released by "delete_volume" :: held 4.518s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:07 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3dfa6279-be78-441e-941c-02602eaa9375 tempest-VolumesDeleteCascade-565550623 None] Acquiring lock "cinder-ee227842-1024-49a6-b10e-c083592b28e3-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:07 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3dfa6279-be78-441e-941c-02602eaa9375 tempest-VolumesDeleteCascade-565550623 None] Lock "cinder-ee227842-1024-49a6-b10e-c083592b28e3-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:07 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3dfa6279-be78-441e-941c-02602eaa9375 tempest-VolumesDeleteCascade-565550623 None] Acquiring lock "cinder-quobyte-ee227842-1024-49a6-b10e-c083592b28e3" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:07 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3dfa6279-be78-441e-941c-02602eaa9375 tempest-VolumesDeleteCascade-565550623 None] Lock "cinder-quobyte-ee227842-1024-49a6-b10e-c083592b28e3" acquired by "delete_volume" :: waited 0.026s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:07 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7656b2-a3ca-4938-9e6f-7de33be79d3e]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3dfa6279-be78-441e-941c-02602eaa9375 tempest-VolumesDeleteCascade-565550623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ee227842-1024-49a6-b10e-c083592b28e3 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:07 devstack sudo[102742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ee227842-1024-49a6-b10e-c083592b28e3 Sep 28 15:06:07 devstack sudo[102742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:07 devstack sudo[102742]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3dfa6279-be78-441e-941c-02602eaa9375 tempest-VolumesDeleteCascade-565550623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ee227842-1024-49a6-b10e-c083592b28e3" returned: 0 in 0.744s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3dfa6279-be78-441e-941c-02602eaa9375 tempest-VolumesDeleteCascade-565550623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ee227842-1024-49a6-b10e-c083592b28e3 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:07 devstack sudo[102747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ee227842-1024-49a6-b10e-c083592b28e3 Sep 28 15:06:07 devstack sudo[102747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:08 devstack sudo[102747]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3dfa6279-be78-441e-941c-02602eaa9375 tempest-VolumesDeleteCascade-565550623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ee227842-1024-49a6-b10e-c083592b28e3" returned: 0 in 0.477s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:08 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3dfa6279-be78-441e-941c-02602eaa9375 tempest-VolumesDeleteCascade-565550623 None] Lock "cinder-quobyte-ee227842-1024-49a6-b10e-c083592b28e3" released by "delete_volume" :: held 1.320s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:08 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-3dfa6279-be78-441e-941c-02602eaa9375 tempest-VolumesDeleteCascade-565550623 None] Created reservations ['d3ad7b53-b715-4623-9c9c-d891d8fd3218', 'a37853ed-9d5b-4cbe-9ac4-6ac378af65a2', '752e1032-70ae-43e2-b36b-e20c7e6679e0', '312fd8f8-4657-403c-b451-229e6323171f'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:06:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3dfa6279-be78-441e-941c-02602eaa9375 tempest-VolumesDeleteCascade-565550623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3dfa6279-be78-441e-941c-02602eaa9375 tempest-VolumesDeleteCascade-565550623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:08 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3dfa6279-be78-441e-941c-02602eaa9375 tempest-VolumesDeleteCascade-565550623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:06:08 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3dfa6279-be78-441e-941c-02602eaa9375 tempest-VolumesDeleteCascade-565550623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:06:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3dfa6279-be78-441e-941c-02602eaa9375 tempest-VolumesDeleteCascade-565550623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3dfa6279-be78-441e-941c-02602eaa9375 tempest-VolumesDeleteCascade-565550623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:08 devstack sudo[102750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:06:08 devstack sudo[102750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:09 devstack sudo[102750]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3dfa6279-be78-441e-941c-02602eaa9375 tempest-VolumesDeleteCascade-565550623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.303s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:09 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-3dfa6279-be78-441e-941c-02602eaa9375 tempest-VolumesDeleteCascade-565550623 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:06:09 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-3dfa6279-be78-441e-941c-02602eaa9375 tempest-VolumesDeleteCascade-565550623 None] Deleted volume successfully. Sep 28 15:06:09 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3dfa6279-be78-441e-941c-02602eaa9375 tempest-VolumesDeleteCascade-565550623 None] Lock "cinder-ee227842-1024-49a6-b10e-c083592b28e3-delete_volume" released by "delete_volume" :: held 2.009s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:14 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:06:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] Flow 'volume_create_manager' (1942093d-ec8d-4699-a189-6cffd4bc8074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ea3a953-f308-483f-870d-328e1ea98551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ea3a953-f308-483f-870d-328e1ea98551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1915847175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51fb72b4-5c6e-490a-b927-601d0d92380f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='802c404aade8407997285fe94046592b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:06:15Z,use_quota=True,user_id='71f890fbf06a48578d8ea25d7bbaa2f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cb9178f-3c8a-4e72-a62a-47c08d9ad72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cb9178f-3c8a-4e72-a62a-47c08d9ad72f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef71afda-fe29-4f0f-a471-f036d0bfa110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:15 devstack cinder-volume[87116]: DEBUG cinder.image.glance [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] Creating Keystone auth plugin from conf {{(pid=87116) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 15:06:15 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f8818e8-0f23-4b7d-9fb9-ae132198d143 tempest-VolumesCloneNegativeTest-637841748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:06:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9f8818e8-0f23-4b7d-9fb9-ae132198d143 tempest-VolumesCloneNegativeTest-637841748 None] Flow 'volume_create_manager' (a82ecbfa-e6e9-414f-8433-53e049d8bbb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9f8818e8-0f23-4b7d-9fb9-ae132198d143 tempest-VolumesCloneNegativeTest-637841748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6e3d160-6377-443e-9777-6da282adcb6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9f8818e8-0f23-4b7d-9fb9-ae132198d143 tempest-VolumesCloneNegativeTest-637841748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6e3d160-6377-443e-9777-6da282adcb6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:06:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-782450928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=637d70a4-38ab-4cf7-adb9-4c6d439a8ec7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0e9f34fe744f04b17b55faa1355ab6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:06:15Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:06:15Z,use_quota=True,user_id='e32a4b4557864db792cd3d6c97cfa976',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9f8818e8-0f23-4b7d-9fb9-ae132198d143 tempest-VolumesCloneNegativeTest-637841748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f7ea97f-bdce-44af-95b6-35383f939c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9f8818e8-0f23-4b7d-9fb9-ae132198d143 tempest-VolumesCloneNegativeTest-637841748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f7ea97f-bdce-44af-95b6-35383f939c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9f8818e8-0f23-4b7d-9fb9-ae132198d143 tempest-VolumesCloneNegativeTest-637841748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (715122ab-adcc-44d4-aaaa-8a410d215eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9f8818e8-0f23-4b7d-9fb9-ae132198d143 tempest-VolumesCloneNegativeTest-637841748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (715122ab-adcc-44d4-aaaa-8a410d215eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '637d70a4-38ab-4cf7-adb9-4c6d439a8ec7', 'volume_name': 'volume-637d70a4-38ab-4cf7-adb9-4c6d439a8ec7', 'volume_size': 2}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9f8818e8-0f23-4b7d-9fb9-ae132198d143 tempest-VolumesCloneNegativeTest-637841748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba2f3ee5-0c3d-4319-8696-7ba00108b58c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9f8818e8-0f23-4b7d-9fb9-ae132198d143 tempest-VolumesCloneNegativeTest-637841748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba2f3ee5-0c3d-4319-8696-7ba00108b58c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9f8818e8-0f23-4b7d-9fb9-ae132198d143 tempest-VolumesCloneNegativeTest-637841748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bb855a6-7470-4edd-a532-4ccfcb0b176a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:15 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-9f8818e8-0f23-4b7d-9fb9-ae132198d143 tempest-VolumesCloneNegativeTest-637841748 None] Volume 637d70a4-38ab-4cf7-adb9-4c6d439a8ec7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-637d70a4-38ab-4cf7-adb9-4c6d439a8ec7', 'volume_size': 2} Sep 28 15:06:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9f8818e8-0f23-4b7d-9fb9-ae132198d143 tempest-VolumesCloneNegativeTest-637841748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9f8818e8-0f23-4b7d-9fb9-ae132198d143 tempest-VolumesCloneNegativeTest-637841748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9f8818e8-0f23-4b7d-9fb9-ae132198d143 tempest-VolumesCloneNegativeTest-637841748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:06:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-782450928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=637d70a4-38ab-4cf7-adb9-4c6d439a8ec7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0e9f34fe744f04b17b55faa1355ab6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:06:15Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:06:15Z,use_quota=True,user_id='e32a4b4557864db792cd3d6c97cfa976',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:06:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-9f8818e8-0f23-4b7d-9fb9-ae132198d143 tempest-VolumesCloneNegativeTest-637841748 None] Creating volume 637d70a4-38ab-4cf7-adb9-4c6d439a8ec7 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:06:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9f8818e8-0f23-4b7d-9fb9-ae132198d143 tempest-VolumesCloneNegativeTest-637841748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9f8818e8-0f23-4b7d-9fb9-ae132198d143 tempest-VolumesCloneNegativeTest-637841748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9f8818e8-0f23-4b7d-9fb9-ae132198d143 tempest-VolumesCloneNegativeTest-637841748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:06:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9f8818e8-0f23-4b7d-9fb9-ae132198d143 tempest-VolumesCloneNegativeTest-637841748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:06:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9f8818e8-0f23-4b7d-9fb9-ae132198d143 tempest-VolumesCloneNegativeTest-637841748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9f8818e8-0f23-4b7d-9fb9-ae132198d143 tempest-VolumesCloneNegativeTest-637841748 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:06:15 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-9f8818e8-0f23-4b7d-9fb9-ae132198d143 tempest-VolumesCloneNegativeTest-637841748 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:06:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9f8818e8-0f23-4b7d-9fb9-ae132198d143 tempest-VolumesCloneNegativeTest-637841748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-637d70a4-38ab-4cf7-adb9-4c6d439a8ec7 2147483648 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:15 devstack sudo[102754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-637d70a4-38ab-4cf7-adb9-4c6d439a8ec7 2147483648 Sep 28 15:06:15 devstack sudo[102754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef71afda-fe29-4f0f-a471-f036d0bfa110) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '51fb72b4-5c6e-490a-b927-601d0d92380f', 'volume_name': 'volume-51fb72b4-5c6e-490a-b927-601d0d92380f', 'volume_size': 1, 'image_id': '660a4fad-84c6-40b7-a594-44d16c0701ee', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/660a4fad-84c6-40b7-a594-44d16c0701ee', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca088c9271854d40ba6017d33affee18', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '660a4fad-84c6-40b7-a594-44d16c0701ee', 'created_at': datetime.datetime(2026, 9, 28, 12, 47, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 47, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/660a4fad-84c6-40b7-a594-44d16c0701ee/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a96b88d8-af38-47a0-a0ba-baede9e56c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a96b88d8-af38-47a0-a0ba-baede9e56c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fda3c184-2737-4558-8aa0-80ee4e9a7878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:15 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] Volume 51fb72b4-5c6e-490a-b927-601d0d92380f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-51fb72b4-5c6e-490a-b927-601d0d92380f', 'volume_size': 1, 'image_id': '660a4fad-84c6-40b7-a594-44d16c0701ee', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/660a4fad-84c6-40b7-a594-44d16c0701ee', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca088c9271854d40ba6017d33affee18', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '660a4fad-84c6-40b7-a594-44d16c0701ee', 'created_at': datetime.datetime(2026, 9, 28, 12, 47, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 47, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/660a4fad-84c6-40b7-a594-44d16c0701ee/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 15:06:15 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] Trying to clone 51fb72b4-5c6e-490a-b927-601d0d92380f from image 660a4fad-84c6-40b7-a594-44d16c0701ee at location (None, [{'url': 'file:///opt/stack/data/glance/images/660a4fad-84c6-40b7-a594-44d16c0701ee', 'metadata': {}}]). {{(pid=87116) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 15:06:16 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_327gt2lldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87116) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 15:06:16 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] Image download 20.69 MB at 20.69 MB/s Sep 28 15:06:16 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e56c153-95a3-469b-a533-9616cad7d687]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_327gt2lldevstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:16 devstack sudo[102761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_327gt2lldevstack@QuobyteHD Sep 28 15:06:16 devstack sudo[102761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:16 devstack sudo[102754]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9f8818e8-0f23-4b7d-9fb9-ae132198d143 tempest-VolumesCloneNegativeTest-637841748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-637d70a4-38ab-4cf7-adb9-4c6d439a8ec7 2147483648" returned: 0 in 0.913s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9f8818e8-0f23-4b7d-9fb9-ae132198d143 tempest-VolumesCloneNegativeTest-637841748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-637d70a4-38ab-4cf7-adb9-4c6d439a8ec7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:16 devstack sudo[102763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-637d70a4-38ab-4cf7-adb9-4c6d439a8ec7 Sep 28 15:06:16 devstack sudo[102763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:16 devstack sudo[102761]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_327gt2lldevstack@QuobyteHD" returned: 0 in 0.444s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:16 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] Temporary image 660a4fad-84c6-40b7-a594-44d16c0701ee is fetched for user 71f890fbf06a48578d8ea25d7bbaa2f9. {{(pid=87116) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 15:06:16 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[c201db77-c809-4644-99cb-49b5d2f58674]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_327gt2lldevstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:16 devstack sudo[102763]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9f8818e8-0f23-4b7d-9fb9-ae132198d143 tempest-VolumesCloneNegativeTest-637841748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-637d70a4-38ab-4cf7-adb9-4c6d439a8ec7" returned: 0 in 0.394s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:16 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9f8818e8-0f23-4b7d-9fb9-ae132198d143 tempest-VolumesCloneNegativeTest-637841748 None] <== create_volume: return (1369ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:06:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9f8818e8-0f23-4b7d-9fb9-ae132198d143 tempest-VolumesCloneNegativeTest-637841748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.374s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:16 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9f8818e8-0f23-4b7d-9fb9-ae132198d143 tempest-VolumesCloneNegativeTest-637841748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bb855a6-7470-4edd-a532-4ccfcb0b176a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-637d70a4-38ab-4cf7-adb9-4c6d439a8ec7', 'volume_size': 2}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9f8818e8-0f23-4b7d-9fb9-ae132198d143 tempest-VolumesCloneNegativeTest-637841748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (217a69ca-f663-45b3-bb30-fae3d7dafce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:17 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:06:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:06:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:06:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:17 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-9f8818e8-0f23-4b7d-9fb9-ae132198d143 tempest-VolumesCloneNegativeTest-637841748 None] Volume volume-637d70a4-38ab-4cf7-adb9-4c6d439a8ec7 (637d70a4-38ab-4cf7-adb9-4c6d439a8ec7): created successfully Sep 28 15:06:17 devstack sudo[102769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_327gt2lldevstack@QuobyteHD Sep 28 15:06:17 devstack sudo[102769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9f8818e8-0f23-4b7d-9fb9-ae132198d143 tempest-VolumesCloneNegativeTest-637841748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (217a69ca-f663-45b3-bb30-fae3d7dafce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9f8818e8-0f23-4b7d-9fb9-ae132198d143 tempest-VolumesCloneNegativeTest-637841748 None] Flow 'volume_create_manager' (a82ecbfa-e6e9-414f-8433-53e049d8bbb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:17 devstack sudo[102771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:06:17 devstack sudo[102771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:17 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-9f8818e8-0f23-4b7d-9fb9-ae132198d143 tempest-VolumesCloneNegativeTest-637841748 None] Created volume successfully. Sep 28 15:06:17 devstack sudo[102769]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_327gt2lldevstack@QuobyteHD" returned: 0 in 0.490s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1915847175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51fb72b4-5c6e-490a-b927-601d0d92380f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='802c404aade8407997285fe94046592b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:06:15Z,use_quota=True,user_id='71f890fbf06a48578d8ea25d7bbaa2f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:06:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] Creating volume 51fb72b4-5c6e-490a-b927-601d0d92380f {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:06:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:06:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:06:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:06:17 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:06:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-51fb72b4-5c6e-490a-b927-601d0d92380f 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:17 devstack sudo[102771]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:17 devstack sudo[102778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-51fb72b4-5c6e-490a-b927-601d0d92380f 1073741824 Sep 28 15:06:17 devstack sudo[102778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.394s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:17 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:06:17 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running periodic task VolumeManager._thread_info {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:06:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] thread count: 28 {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:06:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] thread info: [<_MainThread(MainThread, started 135146735652992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:06:17 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3a602229-dca5-46d6-835c-15a6a6f00abd tempest-VolumesCloneNegativeTest-637841748 None] Acquiring lock "cinder-637d70a4-38ab-4cf7-adb9-4c6d439a8ec7-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:18 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3a602229-dca5-46d6-835c-15a6a6f00abd tempest-VolumesCloneNegativeTest-637841748 None] Lock "cinder-637d70a4-38ab-4cf7-adb9-4c6d439a8ec7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:18 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3a602229-dca5-46d6-835c-15a6a6f00abd tempest-VolumesCloneNegativeTest-637841748 None] Acquiring lock "cinder-quobyte-637d70a4-38ab-4cf7-adb9-4c6d439a8ec7" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:18 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3a602229-dca5-46d6-835c-15a6a6f00abd tempest-VolumesCloneNegativeTest-637841748 None] Lock "cinder-quobyte-637d70a4-38ab-4cf7-adb9-4c6d439a8ec7" acquired by "delete_volume" :: waited 0.033s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:18 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f6e4ac-dfd2-42d1-8b42-316235d279bf]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3a602229-dca5-46d6-835c-15a6a6f00abd tempest-VolumesCloneNegativeTest-637841748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-637d70a4-38ab-4cf7-adb9-4c6d439a8ec7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:18 devstack sudo[102778]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-51fb72b4-5c6e-490a-b927-601d0d92380f 1073741824" returned: 0 in 0.821s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-51fb72b4-5c6e-490a-b927-601d0d92380f {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:18 devstack sudo[102785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-51fb72b4-5c6e-490a-b927-601d0d92380f Sep 28 15:06:18 devstack sudo[102785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:18 devstack sudo[102784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-637d70a4-38ab-4cf7-adb9-4c6d439a8ec7 Sep 28 15:06:18 devstack sudo[102784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:18 devstack sudo[102785]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-51fb72b4-5c6e-490a-b927-601d0d92380f" returned: 0 in 0.315s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:06:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:18 devstack cinder-volume[87116]: DEBUG cinder.volume.volume_utils [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] Attempting download of 660a4fad-84c6-40b7-a594-44d16c0701ee ((None, [{'url': 'file:///opt/stack/data/glance/images/660a4fad-84c6-40b7-a594-44d16c0701ee', 'metadata': {}}])) to volume 51fb72b4-5c6e-490a-b927-601d0d92380f. {{(pid=87116) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1208}} Sep 28 15:06:18 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce8bc8a-d036-4cb3-b6ff-0e30c2351c2d]: (4, 'raw') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_660a4fad-84c6-40b7-a594-44d16c0701ee_uyecbdgf {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:18 devstack sudo[102784]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3a602229-dca5-46d6-835c-15a6a6f00abd tempest-VolumesCloneNegativeTest-637841748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-637d70a4-38ab-4cf7-adb9-4c6d439a8ec7" returned: 0 in 0.552s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3a602229-dca5-46d6-835c-15a6a6f00abd tempest-VolumesCloneNegativeTest-637841748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-637d70a4-38ab-4cf7-adb9-4c6d439a8ec7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:18 devstack sudo[102793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-637d70a4-38ab-4cf7-adb9-4c6d439a8ec7 Sep 28 15:06:18 devstack sudo[102793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:18 devstack sudo[102792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_660a4fad-84c6-40b7-a594-44d16c0701ee_uyecbdgf Sep 28 15:06:18 devstack sudo[102792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:19 devstack sudo[102793]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3a602229-dca5-46d6-835c-15a6a6f00abd tempest-VolumesCloneNegativeTest-637841748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-637d70a4-38ab-4cf7-adb9-4c6d439a8ec7" returned: 0 in 0.327s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:19 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3a602229-dca5-46d6-835c-15a6a6f00abd tempest-VolumesCloneNegativeTest-637841748 None] Lock "cinder-quobyte-637d70a4-38ab-4cf7-adb9-4c6d439a8ec7" released by "delete_volume" :: held 0.958s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:19 devstack sudo[102792]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_660a4fad-84c6-40b7-a594-44d16c0701ee_uyecbdgf" returned: 0 in 0.402s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_660a4fad-84c6-40b7-a594-44d16c0701ee_uyecbdgf {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:19 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-3a602229-dca5-46d6-835c-15a6a6f00abd tempest-VolumesCloneNegativeTest-637841748 None] Created reservations ['88ce74d0-fadc-4e5b-b90f-d76afdb71c99', 'c3cc7329-799f-4821-a943-958a0fddec34', '308776e8-217c-4cf5-93ec-a5dcd653224d', 'b4e70712-8a26-453d-8b42-578754051887'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:06:19 devstack sudo[102799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_660a4fad-84c6-40b7-a594-44d16c0701ee_uyecbdgf Sep 28 15:06:19 devstack sudo[102799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3a602229-dca5-46d6-835c-15a6a6f00abd tempest-VolumesCloneNegativeTest-637841748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3a602229-dca5-46d6-835c-15a6a6f00abd tempest-VolumesCloneNegativeTest-637841748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3a602229-dca5-46d6-835c-15a6a6f00abd tempest-VolumesCloneNegativeTest-637841748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:06:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3a602229-dca5-46d6-835c-15a6a6f00abd tempest-VolumesCloneNegativeTest-637841748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:06:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3a602229-dca5-46d6-835c-15a6a6f00abd tempest-VolumesCloneNegativeTest-637841748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3a602229-dca5-46d6-835c-15a6a6f00abd tempest-VolumesCloneNegativeTest-637841748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:19 devstack sudo[102801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:06:19 devstack sudo[102801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:19 devstack sudo[102799]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_660a4fad-84c6-40b7-a594-44d16c0701ee_uyecbdgf" returned: 1 in 0.412s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_660a4fad-84c6-40b7-a594-44d16c0701ee_uyecbdgf' failed. Not Retrying. {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:06:19 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[674bcdfe-edae-4460-abb6-d6afe00df3f7]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_327gt2lldevstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:19 devstack sudo[102801]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3a602229-dca5-46d6-835c-15a6a6f00abd tempest-VolumesCloneNegativeTest-637841748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.322s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:19 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-3a602229-dca5-46d6-835c-15a6a6f00abd tempest-VolumesCloneNegativeTest-637841748 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:06:19 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-3a602229-dca5-46d6-835c-15a6a6f00abd tempest-VolumesCloneNegativeTest-637841748 None] Deleted volume successfully. Sep 28 15:06:19 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3a602229-dca5-46d6-835c-15a6a6f00abd tempest-VolumesCloneNegativeTest-637841748 None] Lock "cinder-637d70a4-38ab-4cf7-adb9-4c6d439a8ec7-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:19 devstack sudo[102805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_327gt2lldevstack@QuobyteHD Sep 28 15:06:19 devstack sudo[102805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:19 devstack sudo[102805]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_327gt2lldevstack@QuobyteHD" returned: 0 in 0.392s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:19 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] 660a4fad-84c6-40b7-a594-44d16c0701ee was qcow2, converting to qcow2 {{(pid=87116) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 15:06:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_327gt2lldevstack@QuobyteHD /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-51fb72b4-5c6e-490a-b927-601d0d92380f {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:19 devstack sudo[102811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_327gt2lldevstack@QuobyteHD /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-51fb72b4-5c6e-490a-b927-601d0d92380f Sep 28 15:06:19 devstack sudo[102811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:22 devstack sudo[102811]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_327gt2lldevstack@QuobyteHD /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-51fb72b4-5c6e-490a-b927-601d0d92380f" returned: 0 in 2.954s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:22 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_327gt2lldevstack@QuobyteHD, size 112.00 MB, duration 2.96 sec, destination /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-51fb72b4-5c6e-490a-b927-601d0d92380f {{(pid=87116) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:06:22 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] Converted 112.00 MB image at 37.90 MB/s Sep 28 15:06:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-51fb72b4-5c6e-490a-b927-601d0d92380f 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:22 devstack sudo[102821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-51fb72b4-5c6e-490a-b927-601d0d92380f 1G Sep 28 15:06:22 devstack sudo[102821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:23 devstack sudo[102821]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-51fb72b4-5c6e-490a-b927-601d0d92380f 1G" returned: 0 in 0.521s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:23 devstack cinder-volume[87116]: DEBUG cinder.volume.volume_utils [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] Downloaded image 660a4fad-84c6-40b7-a594-44d16c0701ee ((None, [{'url': 'file:///opt/stack/data/glance/images/660a4fad-84c6-40b7-a594-44d16c0701ee', 'metadata': {}}])) to volume 51fb72b4-5c6e-490a-b927-601d0d92380f successfully. {{(pid=87116) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1253}} Sep 28 15:06:23 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] Temporary image 660a4fad-84c6-40b7-a594-44d16c0701ee for user 71f890fbf06a48578d8ea25d7bbaa2f9 is deleted. {{(pid=87116) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 15:06:23 devstack cinder-volume[87116]: DEBUG cinder.volume.volume_utils [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] Marking volume 51fb72b4-5c6e-490a-b927-601d0d92380f as bootable. {{(pid=87116) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1157}} Sep 28 15:06:23 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=95,cinder:INSERT=36,cinder:UPDATE=131,cinder:DELETE=8 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:06:23 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] Copying metadata from image 660a4fad-84c6-40b7-a594-44d16c0701ee to 51fb72b4-5c6e-490a-b927-601d0d92380f. {{(pid=87116) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 15:06:23 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] Creating volume glance metadata for volume 51fb72b4-5c6e-490a-b927-601d0d92380f backed by image 660a4fad-84c6-40b7-a594-44d16c0701ee with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '660a4fad-84c6-40b7-a594-44d16c0701ee', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87116) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 15:06:23 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:DELETE=11,cinder:SELECT=110,cinder:INSERT=31,cinder:UPDATE=119 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:06:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fda3c184-2737-4558-8aa0-80ee4e9a7878) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51fb72b4-5c6e-490a-b927-601d0d92380f', 'volume_size': 1, 'image_id': '660a4fad-84c6-40b7-a594-44d16c0701ee', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/660a4fad-84c6-40b7-a594-44d16c0701ee', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca088c9271854d40ba6017d33affee18', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '660a4fad-84c6-40b7-a594-44d16c0701ee', 'created_at': datetime.datetime(2026, 9, 28, 12, 47, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 47, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/660a4fad-84c6-40b7-a594-44d16c0701ee/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46d95fa0-c39e-46ce-b65b-5563b655e44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:23 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] Volume volume-51fb72b4-5c6e-490a-b927-601d0d92380f (51fb72b4-5c6e-490a-b927-601d0d92380f): created successfully Sep 28 15:06:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46d95fa0-c39e-46ce-b65b-5563b655e44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] Flow 'volume_create_manager' (1942093d-ec8d-4699-a189-6cffd4bc8074) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:23 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-7444043d-173c-4104-ada1-1fcca3aee370 tempest-TestShelveInstance-1773918598 None] Created volume successfully. Sep 28 15:06:26 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:06:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] Flow 'volume_create_manager' (bf6cd53b-bbc0-49f7-bc9d-0d92ba144f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4fdf566-0140-403c-988e-d9191729bce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4fdf566-0140-403c-988e-d9191729bce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-928721892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7c368f6-ae4a-4e3e-8dc4-765f10eb0174,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5b44ff005d040f28ecf227e77519917',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:06:27Z,use_quota=True,user_id='fa3d45ef6be14efd9ce6413764c46aaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac153c05-28ca-487c-874e-fb9c308fb684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac153c05-28ca-487c-874e-fb9c308fb684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ce38bb5-2b4f-4b79-b0e7-def4f2e38d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:26 devstack cinder-volume[87116]: DEBUG cinder.image.glance [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] Creating Keystone auth plugin from conf {{(pid=87116) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 15:06:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ce38bb5-2b4f-4b79-b0e7-def4f2e38d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a7c368f6-ae4a-4e3e-8dc4-765f10eb0174', 'volume_name': 'volume-a7c368f6-ae4a-4e3e-8dc4-765f10eb0174', 'volume_size': 1, 'image_id': '660a4fad-84c6-40b7-a594-44d16c0701ee', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/660a4fad-84c6-40b7-a594-44d16c0701ee', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca088c9271854d40ba6017d33affee18', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '660a4fad-84c6-40b7-a594-44d16c0701ee', 'created_at': datetime.datetime(2026, 9, 28, 12, 47, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 47, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/660a4fad-84c6-40b7-a594-44d16c0701ee/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88245cfe-b592-4c71-a664-91208e8bc85c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88245cfe-b592-4c71-a664-91208e8bc85c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd7be987-c4d4-47bf-91c2-a2222d9fe69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:27 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] Volume a7c368f6-ae4a-4e3e-8dc4-765f10eb0174: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a7c368f6-ae4a-4e3e-8dc4-765f10eb0174', 'volume_size': 1, 'image_id': '660a4fad-84c6-40b7-a594-44d16c0701ee', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/660a4fad-84c6-40b7-a594-44d16c0701ee', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca088c9271854d40ba6017d33affee18', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '660a4fad-84c6-40b7-a594-44d16c0701ee', 'created_at': datetime.datetime(2026, 9, 28, 12, 47, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 47, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/660a4fad-84c6-40b7-a594-44d16c0701ee/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 15:06:27 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] Trying to clone a7c368f6-ae4a-4e3e-8dc4-765f10eb0174 from image 660a4fad-84c6-40b7-a594-44d16c0701ee at location (None, [{'url': 'file:///opt/stack/data/glance/images/660a4fad-84c6-40b7-a594-44d16c0701ee', 'metadata': {}}]). {{(pid=87116) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 15:06:27 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_uvwm5pa3devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87116) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 15:06:27 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] Image download 20.69 MB at 20.69 MB/s Sep 28 15:06:27 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7d47a7-9737-4722-87bd-9856a188ee76]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_uvwm5pa3devstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:27 devstack sudo[102830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_uvwm5pa3devstack@QuobyteHD Sep 28 15:06:27 devstack sudo[102830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:28 devstack sudo[102830]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_uvwm5pa3devstack@QuobyteHD" returned: 0 in 0.688s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:28 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] Temporary image 660a4fad-84c6-40b7-a594-44d16c0701ee is fetched for user fa3d45ef6be14efd9ce6413764c46aaf. {{(pid=87116) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 15:06:28 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[2070876f-2285-418b-9617-65fc6f061f18]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_uvwm5pa3devstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:28 devstack sudo[102836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_uvwm5pa3devstack@QuobyteHD Sep 28 15:06:28 devstack sudo[102836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-f7f16be7-a793-4743-805f-f51f403c1553 req-45df471f-3bef-47ae-a606-5331269224a2 tempest-TestShelveInstance-1773918598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-f7f16be7-a793-4743-805f-f51f403c1553 req-45df471f-3bef-47ae-a606-5331269224a2 tempest-TestShelveInstance-1773918598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-f7f16be7-a793-4743-805f-f51f403c1553 req-45df471f-3bef-47ae-a606-5331269224a2 tempest-TestShelveInstance-1773918598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-f7f16be7-a793-4743-805f-f51f403c1553 req-45df471f-3bef-47ae-a606-5331269224a2 tempest-TestShelveInstance-1773918598 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1', 'name': 'volume-51fb72b4-5c6e-490a-b927-601d0d92380f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1c24b9af-456a-4f29-b51b-ca5a842135fd', 'enforce_multipath': True} {{(pid=87116) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:06:29 devstack sudo[102836]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_uvwm5pa3devstack@QuobyteHD" returned: 0 in 0.613s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:29 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-928721892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7c368f6-ae4a-4e3e-8dc4-765f10eb0174,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5b44ff005d040f28ecf227e77519917',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:06:27Z,use_quota=True,user_id='fa3d45ef6be14efd9ce6413764c46aaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:06:29 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] Creating volume a7c368f6-ae4a-4e3e-8dc4-765f10eb0174 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:06:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:29 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:06:29 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:06:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:29 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:06:29 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:06:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a7c368f6-ae4a-4e3e-8dc4-765f10eb0174 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:29 devstack sudo[102850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a7c368f6-ae4a-4e3e-8dc4-765f10eb0174 1073741824 Sep 28 15:06:29 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-f7f16be7-a793-4743-805f-f51f403c1553 req-45df471f-3bef-47ae-a606-5331269224a2 tempest-TestShelveInstance-1773918598 None] attachment_update completed successfully. Sep 28 15:06:29 devstack sudo[102850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:29 devstack sudo[102850]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a7c368f6-ae4a-4e3e-8dc4-765f10eb0174 1073741824" returned: 0 in 0.638s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a7c368f6-ae4a-4e3e-8dc4-765f10eb0174 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:29 devstack sudo[102856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a7c368f6-ae4a-4e3e-8dc4-765f10eb0174 Sep 28 15:06:29 devstack sudo[102856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:30 devstack sudo[102856]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a7c368f6-ae4a-4e3e-8dc4-765f10eb0174" returned: 0 in 0.369s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:06:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:30 devstack cinder-volume[87116]: DEBUG cinder.volume.volume_utils [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] Attempting download of 660a4fad-84c6-40b7-a594-44d16c0701ee ((None, [{'url': 'file:///opt/stack/data/glance/images/660a4fad-84c6-40b7-a594-44d16c0701ee', 'metadata': {}}])) to volume a7c368f6-ae4a-4e3e-8dc4-765f10eb0174. {{(pid=87116) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1208}} Sep 28 15:06:30 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f96e692-ed29-428f-8026-beb9c8f0c47e]: (4, 'raw') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_660a4fad-84c6-40b7-a594-44d16c0701ee_xk30gtti {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:30 devstack sudo[102859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_660a4fad-84c6-40b7-a594-44d16c0701ee_xk30gtti Sep 28 15:06:30 devstack sudo[102859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:30 devstack sudo[102859]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_660a4fad-84c6-40b7-a594-44d16c0701ee_xk30gtti" returned: 0 in 0.460s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_660a4fad-84c6-40b7-a594-44d16c0701ee_xk30gtti {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:31 devstack sudo[102864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_660a4fad-84c6-40b7-a594-44d16c0701ee_xk30gtti Sep 28 15:06:31 devstack sudo[102864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:31 devstack sudo[102864]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_660a4fad-84c6-40b7-a594-44d16c0701ee_xk30gtti" returned: 1 in 0.483s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_660a4fad-84c6-40b7-a594-44d16c0701ee_xk30gtti' failed. Not Retrying. {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:06:31 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef4cd4f-5a44-4202-a8d5-96eadb05eedc]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_uvwm5pa3devstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:31 devstack sudo[102870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_uvwm5pa3devstack@QuobyteHD Sep 28 15:06:31 devstack sudo[102870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:31 devstack sudo[102870]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_uvwm5pa3devstack@QuobyteHD" returned: 0 in 0.409s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:31 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] 660a4fad-84c6-40b7-a594-44d16c0701ee was qcow2, converting to qcow2 {{(pid=87116) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 15:06:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_uvwm5pa3devstack@QuobyteHD /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a7c368f6-ae4a-4e3e-8dc4-765f10eb0174 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:31 devstack sudo[102875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_uvwm5pa3devstack@QuobyteHD /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a7c368f6-ae4a-4e3e-8dc4-765f10eb0174 Sep 28 15:06:31 devstack sudo[102875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:34 devstack sudo[102875]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_uvwm5pa3devstack@QuobyteHD /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a7c368f6-ae4a-4e3e-8dc4-765f10eb0174" returned: 0 in 2.934s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:34 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_660a4fad-84c6-40b7-a594-44d16c0701ee_uvwm5pa3devstack@QuobyteHD, size 112.00 MB, duration 2.94 sec, destination /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a7c368f6-ae4a-4e3e-8dc4-765f10eb0174 {{(pid=87116) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:06:34 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] Converted 112.00 MB image at 38.16 MB/s Sep 28 15:06:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a7c368f6-ae4a-4e3e-8dc4-765f10eb0174 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:34 devstack sudo[102924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a7c368f6-ae4a-4e3e-8dc4-765f10eb0174 1G Sep 28 15:06:34 devstack sudo[102924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:35 devstack sudo[102924]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a7c368f6-ae4a-4e3e-8dc4-765f10eb0174 1G" returned: 0 in 0.660s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:35 devstack cinder-volume[87116]: DEBUG cinder.volume.volume_utils [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] Downloaded image 660a4fad-84c6-40b7-a594-44d16c0701ee ((None, [{'url': 'file:///opt/stack/data/glance/images/660a4fad-84c6-40b7-a594-44d16c0701ee', 'metadata': {}}])) to volume a7c368f6-ae4a-4e3e-8dc4-765f10eb0174 successfully. {{(pid=87116) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1253}} Sep 28 15:06:35 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] Temporary image 660a4fad-84c6-40b7-a594-44d16c0701ee for user fa3d45ef6be14efd9ce6413764c46aaf is deleted. {{(pid=87116) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 15:06:35 devstack cinder-volume[87116]: DEBUG cinder.volume.volume_utils [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] Marking volume a7c368f6-ae4a-4e3e-8dc4-765f10eb0174 as bootable. {{(pid=87116) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1157}} Sep 28 15:06:35 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] Copying metadata from image 660a4fad-84c6-40b7-a594-44d16c0701ee to a7c368f6-ae4a-4e3e-8dc4-765f10eb0174. {{(pid=87116) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 15:06:35 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] Creating volume glance metadata for volume a7c368f6-ae4a-4e3e-8dc4-765f10eb0174 backed by image 660a4fad-84c6-40b7-a594-44d16c0701ee with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '660a4fad-84c6-40b7-a594-44d16c0701ee', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87116) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 15:06:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd7be987-c4d4-47bf-91c2-a2222d9fe69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7c368f6-ae4a-4e3e-8dc4-765f10eb0174', 'volume_size': 1, 'image_id': '660a4fad-84c6-40b7-a594-44d16c0701ee', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/660a4fad-84c6-40b7-a594-44d16c0701ee', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca088c9271854d40ba6017d33affee18', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '660a4fad-84c6-40b7-a594-44d16c0701ee', 'created_at': datetime.datetime(2026, 9, 28, 12, 47, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 47, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/660a4fad-84c6-40b7-a594-44d16c0701ee/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6626e641-9f70-4c56-8c62-b4728e511708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:35 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] Volume volume-a7c368f6-ae4a-4e3e-8dc4-765f10eb0174 (a7c368f6-ae4a-4e3e-8dc4-765f10eb0174): created successfully Sep 28 15:06:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6626e641-9f70-4c56-8c62-b4728e511708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] Flow 'volume_create_manager' (bf6cd53b-bbc0-49f7-bc9d-0d92ba144f08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:35 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-6def8217-74d6-4e5c-aed2-a2ac924472e2 tempest-VolumesExtendTest-1736992305 None] Created volume successfully. Sep 28 15:06:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-988d7ad0-b905-447f-b261-f992188c5215 tempest-VolumesExtendTest-1736992305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-988d7ad0-b905-447f-b261-f992188c5215 tempest-VolumesExtendTest-1736992305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:37 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[abfc954f-da46-4188-a575-29645c3f2032]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-988d7ad0-b905-447f-b261-f992188c5215 tempest-VolumesExtendTest-1736992305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a7c368f6-ae4a-4e3e-8dc4-765f10eb0174 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:37 devstack sudo[103399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a7c368f6-ae4a-4e3e-8dc4-765f10eb0174 Sep 28 15:06:37 devstack sudo[103399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:37 devstack sudo[103399]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-988d7ad0-b905-447f-b261-f992188c5215 tempest-VolumesExtendTest-1736992305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a7c368f6-ae4a-4e3e-8dc4-765f10eb0174" returned: 0 in 0.671s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-988d7ad0-b905-447f-b261-f992188c5215 tempest-VolumesExtendTest-1736992305 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a7c368f6-ae4a-4e3e-8dc4-765f10eb0174 2G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-988d7ad0-b905-447f-b261-f992188c5215 tempest-VolumesExtendTest-1736992305 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a7c368f6-ae4a-4e3e-8dc4-765f10eb0174 2G" returned: 0 in 0.198s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-988d7ad0-b905-447f-b261-f992188c5215 tempest-VolumesExtendTest-1736992305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.919s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:38 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-988d7ad0-b905-447f-b261-f992188c5215 tempest-VolumesExtendTest-1736992305 None] Extend volume completed successfully. Sep 28 15:06:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-274ff0f2-b3f1-41e2-8823-fb2d9e9d3433 tempest-VolumesExtendTest-1736992305 None] Acquiring lock "cinder-a7c368f6-ae4a-4e3e-8dc4-765f10eb0174-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-274ff0f2-b3f1-41e2-8823-fb2d9e9d3433 tempest-VolumesExtendTest-1736992305 None] Lock "cinder-a7c368f6-ae4a-4e3e-8dc4-765f10eb0174-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-274ff0f2-b3f1-41e2-8823-fb2d9e9d3433 tempest-VolumesExtendTest-1736992305 None] Acquiring lock "cinder-quobyte-a7c368f6-ae4a-4e3e-8dc4-765f10eb0174" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-274ff0f2-b3f1-41e2-8823-fb2d9e9d3433 tempest-VolumesExtendTest-1736992305 None] Lock "cinder-quobyte-a7c368f6-ae4a-4e3e-8dc4-765f10eb0174" acquired by "delete_volume" :: waited 0.022s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:39 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f6efe0-2336-4d5c-8c7b-1a7b825f9a0e]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-274ff0f2-b3f1-41e2-8823-fb2d9e9d3433 tempest-VolumesExtendTest-1736992305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a7c368f6-ae4a-4e3e-8dc4-765f10eb0174 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:39 devstack sudo[103429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a7c368f6-ae4a-4e3e-8dc4-765f10eb0174 Sep 28 15:06:39 devstack sudo[103429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:39 devstack sudo[103429]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-274ff0f2-b3f1-41e2-8823-fb2d9e9d3433 tempest-VolumesExtendTest-1736992305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a7c368f6-ae4a-4e3e-8dc4-765f10eb0174" returned: 0 in 0.584s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-274ff0f2-b3f1-41e2-8823-fb2d9e9d3433 tempest-VolumesExtendTest-1736992305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a7c368f6-ae4a-4e3e-8dc4-765f10eb0174 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:39 devstack sudo[103436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a7c368f6-ae4a-4e3e-8dc4-765f10eb0174 Sep 28 15:06:39 devstack sudo[103436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:39 devstack sudo[103436]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-274ff0f2-b3f1-41e2-8823-fb2d9e9d3433 tempest-VolumesExtendTest-1736992305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a7c368f6-ae4a-4e3e-8dc4-765f10eb0174" returned: 0 in 0.343s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:39 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-274ff0f2-b3f1-41e2-8823-fb2d9e9d3433 tempest-VolumesExtendTest-1736992305 None] Lock "cinder-quobyte-a7c368f6-ae4a-4e3e-8dc4-765f10eb0174" released by "delete_volume" :: held 0.992s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:40 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-274ff0f2-b3f1-41e2-8823-fb2d9e9d3433 tempest-VolumesExtendTest-1736992305 None] Created reservations ['1e0bc82e-761f-4468-888b-81e9418c3e75', '68a4a589-d3a6-46e0-a717-93e7c6009e11', 'a3034c53-5207-4955-a4c4-b3eb07c48785', 'fa4ea5d2-4024-4c54-b258-f9a19fae5fde'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:06:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-274ff0f2-b3f1-41e2-8823-fb2d9e9d3433 tempest-VolumesExtendTest-1736992305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-274ff0f2-b3f1-41e2-8823-fb2d9e9d3433 tempest-VolumesExtendTest-1736992305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:40 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-274ff0f2-b3f1-41e2-8823-fb2d9e9d3433 tempest-VolumesExtendTest-1736992305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:06:40 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-274ff0f2-b3f1-41e2-8823-fb2d9e9d3433 tempest-VolumesExtendTest-1736992305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:06:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-274ff0f2-b3f1-41e2-8823-fb2d9e9d3433 tempest-VolumesExtendTest-1736992305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-274ff0f2-b3f1-41e2-8823-fb2d9e9d3433 tempest-VolumesExtendTest-1736992305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:40 devstack sudo[103439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:06:40 devstack sudo[103439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:40 devstack sudo[103439]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-274ff0f2-b3f1-41e2-8823-fb2d9e9d3433 tempest-VolumesExtendTest-1736992305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.344s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:40 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-274ff0f2-b3f1-41e2-8823-fb2d9e9d3433 tempest-VolumesExtendTest-1736992305 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:06:40 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-274ff0f2-b3f1-41e2-8823-fb2d9e9d3433 tempest-VolumesExtendTest-1736992305 None] Deleted volume successfully. Sep 28 15:06:40 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-274ff0f2-b3f1-41e2-8823-fb2d9e9d3433 tempest-VolumesExtendTest-1736992305 None] Lock "cinder-a7c368f6-ae4a-4e3e-8dc4-765f10eb0174-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:41 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-18d35297-5368-4c68-8004-1aead7d6ca27 tempest-VolumesExtendTest-1736992305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:06:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-18d35297-5368-4c68-8004-1aead7d6ca27 tempest-VolumesExtendTest-1736992305 None] Flow 'volume_create_manager' (2c4ab6c1-ac45-4a26-ae3d-6ade9e22b955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-18d35297-5368-4c68-8004-1aead7d6ca27 tempest-VolumesExtendTest-1736992305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5ba0d1c-6c07-440f-b41b-14ab08a0963b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-18d35297-5368-4c68-8004-1aead7d6ca27 tempest-VolumesExtendTest-1736992305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5ba0d1c-6c07-440f-b41b-14ab08a0963b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2070766813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22fb48cf-8974-4e45-9c93-0bee516e329d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5b44ff005d040f28ecf227e77519917',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:06:42Z,use_quota=True,user_id='fa3d45ef6be14efd9ce6413764c46aaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-18d35297-5368-4c68-8004-1aead7d6ca27 tempest-VolumesExtendTest-1736992305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb0c4e91-49fe-4f8f-afec-a57988cb08d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-18d35297-5368-4c68-8004-1aead7d6ca27 tempest-VolumesExtendTest-1736992305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb0c4e91-49fe-4f8f-afec-a57988cb08d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-18d35297-5368-4c68-8004-1aead7d6ca27 tempest-VolumesExtendTest-1736992305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02b8044e-04cc-4b0f-80a2-03da18161cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-18d35297-5368-4c68-8004-1aead7d6ca27 tempest-VolumesExtendTest-1736992305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02b8044e-04cc-4b0f-80a2-03da18161cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22fb48cf-8974-4e45-9c93-0bee516e329d', 'volume_name': 'volume-22fb48cf-8974-4e45-9c93-0bee516e329d', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-18d35297-5368-4c68-8004-1aead7d6ca27 tempest-VolumesExtendTest-1736992305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd2d2b8d-2555-4863-8195-947c378b40ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-18d35297-5368-4c68-8004-1aead7d6ca27 tempest-VolumesExtendTest-1736992305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd2d2b8d-2555-4863-8195-947c378b40ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-18d35297-5368-4c68-8004-1aead7d6ca27 tempest-VolumesExtendTest-1736992305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dade2b4a-e8d9-4f94-8093-ab0bc7dc5fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:42 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-18d35297-5368-4c68-8004-1aead7d6ca27 tempest-VolumesExtendTest-1736992305 None] Volume 22fb48cf-8974-4e45-9c93-0bee516e329d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22fb48cf-8974-4e45-9c93-0bee516e329d', 'volume_size': 1} Sep 28 15:06:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-18d35297-5368-4c68-8004-1aead7d6ca27 tempest-VolumesExtendTest-1736992305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-18d35297-5368-4c68-8004-1aead7d6ca27 tempest-VolumesExtendTest-1736992305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:42 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-18d35297-5368-4c68-8004-1aead7d6ca27 tempest-VolumesExtendTest-1736992305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2070766813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22fb48cf-8974-4e45-9c93-0bee516e329d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5b44ff005d040f28ecf227e77519917',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:06:42Z,use_quota=True,user_id='fa3d45ef6be14efd9ce6413764c46aaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:06:42 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-18d35297-5368-4c68-8004-1aead7d6ca27 tempest-VolumesExtendTest-1736992305 None] Creating volume 22fb48cf-8974-4e45-9c93-0bee516e329d {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:06:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-18d35297-5368-4c68-8004-1aead7d6ca27 tempest-VolumesExtendTest-1736992305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-18d35297-5368-4c68-8004-1aead7d6ca27 tempest-VolumesExtendTest-1736992305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:42 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-18d35297-5368-4c68-8004-1aead7d6ca27 tempest-VolumesExtendTest-1736992305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:06:42 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-18d35297-5368-4c68-8004-1aead7d6ca27 tempest-VolumesExtendTest-1736992305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:06:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-18d35297-5368-4c68-8004-1aead7d6ca27 tempest-VolumesExtendTest-1736992305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:42 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-18d35297-5368-4c68-8004-1aead7d6ca27 tempest-VolumesExtendTest-1736992305 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:06:42 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-18d35297-5368-4c68-8004-1aead7d6ca27 tempest-VolumesExtendTest-1736992305 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:06:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-18d35297-5368-4c68-8004-1aead7d6ca27 tempest-VolumesExtendTest-1736992305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-22fb48cf-8974-4e45-9c93-0bee516e329d 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:42 devstack sudo[103443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-22fb48cf-8974-4e45-9c93-0bee516e329d 1073741824 Sep 28 15:06:42 devstack sudo[103443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:43 devstack sudo[103443]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-18d35297-5368-4c68-8004-1aead7d6ca27 tempest-VolumesExtendTest-1736992305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-22fb48cf-8974-4e45-9c93-0bee516e329d 1073741824" returned: 0 in 0.925s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-18d35297-5368-4c68-8004-1aead7d6ca27 tempest-VolumesExtendTest-1736992305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-22fb48cf-8974-4e45-9c93-0bee516e329d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:43 devstack sudo[103448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-22fb48cf-8974-4e45-9c93-0bee516e329d Sep 28 15:06:43 devstack sudo[103448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:43 devstack sudo[103448]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-18d35297-5368-4c68-8004-1aead7d6ca27 tempest-VolumesExtendTest-1736992305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-22fb48cf-8974-4e45-9c93-0bee516e329d" returned: 0 in 0.420s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:43 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-18d35297-5368-4c68-8004-1aead7d6ca27 tempest-VolumesExtendTest-1736992305 None] <== create_volume: return (1423ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:06:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-18d35297-5368-4c68-8004-1aead7d6ca27 tempest-VolumesExtendTest-1736992305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.429s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:43 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-18d35297-5368-4c68-8004-1aead7d6ca27 tempest-VolumesExtendTest-1736992305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dade2b4a-e8d9-4f94-8093-ab0bc7dc5fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22fb48cf-8974-4e45-9c93-0bee516e329d', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:43 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-18d35297-5368-4c68-8004-1aead7d6ca27 tempest-VolumesExtendTest-1736992305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a21d30ab-c1d7-48d1-818f-781435cf5287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:43 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-18d35297-5368-4c68-8004-1aead7d6ca27 tempest-VolumesExtendTest-1736992305 None] Volume volume-22fb48cf-8974-4e45-9c93-0bee516e329d (22fb48cf-8974-4e45-9c93-0bee516e329d): created successfully Sep 28 15:06:43 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-18d35297-5368-4c68-8004-1aead7d6ca27 tempest-VolumesExtendTest-1736992305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a21d30ab-c1d7-48d1-818f-781435cf5287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:43 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-18d35297-5368-4c68-8004-1aead7d6ca27 tempest-VolumesExtendTest-1736992305 None] Flow 'volume_create_manager' (2c4ab6c1-ac45-4a26-ae3d-6ade9e22b955) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:43 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-18d35297-5368-4c68-8004-1aead7d6ca27 tempest-VolumesExtendTest-1736992305 None] Created volume successfully. Sep 28 15:06:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2502e2bd-d2f5-43fa-95c0-d91ab43f9d16 tempest-VolumesExtendTest-1736992305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2502e2bd-d2f5-43fa-95c0-d91ab43f9d16 tempest-VolumesExtendTest-1736992305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.016s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:45 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-2502e2bd-d2f5-43fa-95c0-d91ab43f9d16 tempest-VolumesExtendTest-1736992305 None] Creating offline snapshot b90223cb-8dc1-4af3-97c4-d31394d1e23b of volume 22fb48cf-8974-4e45-9c93-0bee516e329d {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:06:45 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-06d67aad-800f-4c11-8c15-6ec7e31a00f7 tempest-TestInstancesWithCinderVolumes-1943303254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:06:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-06d67aad-800f-4c11-8c15-6ec7e31a00f7 tempest-TestInstancesWithCinderVolumes-1943303254 None] Flow 'volume_create_manager' (a704b55f-3d6b-411c-8437-11b2abf53119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-06d67aad-800f-4c11-8c15-6ec7e31a00f7 tempest-TestInstancesWithCinderVolumes-1943303254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (966fcef7-41c9-4cb8-9af6-e778ce77afd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:45 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81cd868-8f26-4745-9d40-c53fdb903589]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2502e2bd-d2f5-43fa-95c0-d91ab43f9d16 tempest-VolumesExtendTest-1736992305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-22fb48cf-8974-4e45-9c93-0bee516e329d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-06d67aad-800f-4c11-8c15-6ec7e31a00f7 tempest-TestInstancesWithCinderVolumes-1943303254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (966fcef7-41c9-4cb8-9af6-e778ce77afd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:06:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-957549507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25cfb136-9561-40a5-a0db-a8ac689014dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbb2817809e84a7e848e8af455ddf683',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:06:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:06:45Z,use_quota=True,user_id='df648a79c85d4c69a644aca833a11c3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a92838c1-bcf2-4325-8399-1033504485a0),volume_type_id=a92838c1-bcf2-4325-8399-1033504485a0)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-06d67aad-800f-4c11-8c15-6ec7e31a00f7 tempest-TestInstancesWithCinderVolumes-1943303254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f9556bf-7467-4137-a131-ba7a8991bfe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-06d67aad-800f-4c11-8c15-6ec7e31a00f7 tempest-TestInstancesWithCinderVolumes-1943303254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f9556bf-7467-4137-a131-ba7a8991bfe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:45 devstack sudo[103454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-22fb48cf-8974-4e45-9c93-0bee516e329d Sep 28 15:06:45 devstack sudo[103454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-06d67aad-800f-4c11-8c15-6ec7e31a00f7 tempest-TestInstancesWithCinderVolumes-1943303254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7512955-874c-4926-8ac7-ba56a4afedf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-06d67aad-800f-4c11-8c15-6ec7e31a00f7 tempest-TestInstancesWithCinderVolumes-1943303254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7512955-874c-4926-8ac7-ba56a4afedf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25cfb136-9561-40a5-a0db-a8ac689014dd', 'volume_name': 'volume-25cfb136-9561-40a5-a0db-a8ac689014dd', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-06d67aad-800f-4c11-8c15-6ec7e31a00f7 tempest-TestInstancesWithCinderVolumes-1943303254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b8bcd05-801c-498e-ac14-1519f0d62d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-06d67aad-800f-4c11-8c15-6ec7e31a00f7 tempest-TestInstancesWithCinderVolumes-1943303254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b8bcd05-801c-498e-ac14-1519f0d62d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-06d67aad-800f-4c11-8c15-6ec7e31a00f7 tempest-TestInstancesWithCinderVolumes-1943303254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1d5ea8d-6a2e-4b63-8777-3ab1091d5194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:45 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-06d67aad-800f-4c11-8c15-6ec7e31a00f7 tempest-TestInstancesWithCinderVolumes-1943303254 None] Volume 25cfb136-9561-40a5-a0db-a8ac689014dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25cfb136-9561-40a5-a0db-a8ac689014dd', 'volume_size': 1} Sep 28 15:06:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-06d67aad-800f-4c11-8c15-6ec7e31a00f7 tempest-TestInstancesWithCinderVolumes-1943303254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:45 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb271aa2-4b99-4d93-9a1d-483be28b8eb0 tempest-TestInstancesWithCinderVolumes-1943303254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:06:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fb271aa2-4b99-4d93-9a1d-483be28b8eb0 tempest-TestInstancesWithCinderVolumes-1943303254 None] Flow 'volume_create_manager' (68284d15-37ce-4120-a72f-4ae67e281385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fb271aa2-4b99-4d93-9a1d-483be28b8eb0 tempest-TestInstancesWithCinderVolumes-1943303254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (070f9290-968e-49bb-ba3f-e10982b3ee06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fb271aa2-4b99-4d93-9a1d-483be28b8eb0 tempest-TestInstancesWithCinderVolumes-1943303254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (070f9290-968e-49bb-ba3f-e10982b3ee06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:06:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-556175892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e711b906-935d-4349-82db-bd7c9f1174d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbb2817809e84a7e848e8af455ddf683',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:06:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:06:45Z,use_quota=True,user_id='df648a79c85d4c69a644aca833a11c3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af3c7bc6-8c7d-4ead-b91b-5058e59115f6),volume_type_id=af3c7bc6-8c7d-4ead-b91b-5058e59115f6)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fb271aa2-4b99-4d93-9a1d-483be28b8eb0 tempest-TestInstancesWithCinderVolumes-1943303254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1507a79c-7ca6-4667-9aa7-713675b56352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fb271aa2-4b99-4d93-9a1d-483be28b8eb0 tempest-TestInstancesWithCinderVolumes-1943303254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1507a79c-7ca6-4667-9aa7-713675b56352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fb271aa2-4b99-4d93-9a1d-483be28b8eb0 tempest-TestInstancesWithCinderVolumes-1943303254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ad42f8b-2eff-4717-990d-085d69c559f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fb271aa2-4b99-4d93-9a1d-483be28b8eb0 tempest-TestInstancesWithCinderVolumes-1943303254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ad42f8b-2eff-4717-990d-085d69c559f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e711b906-935d-4349-82db-bd7c9f1174d5', 'volume_name': 'volume-e711b906-935d-4349-82db-bd7c9f1174d5', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fb271aa2-4b99-4d93-9a1d-483be28b8eb0 tempest-TestInstancesWithCinderVolumes-1943303254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b94958c-8f67-48f4-a8be-2213ba002e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fb271aa2-4b99-4d93-9a1d-483be28b8eb0 tempest-TestInstancesWithCinderVolumes-1943303254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b94958c-8f67-48f4-a8be-2213ba002e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fb271aa2-4b99-4d93-9a1d-483be28b8eb0 tempest-TestInstancesWithCinderVolumes-1943303254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6045dfb0-3b65-480d-a248-d297754f9211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:45 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-fb271aa2-4b99-4d93-9a1d-483be28b8eb0 tempest-TestInstancesWithCinderVolumes-1943303254 None] Volume e711b906-935d-4349-82db-bd7c9f1174d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e711b906-935d-4349-82db-bd7c9f1174d5', 'volume_size': 1} Sep 28 15:06:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-fb271aa2-4b99-4d93-9a1d-483be28b8eb0 tempest-TestInstancesWithCinderVolumes-1943303254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:46 devstack sudo[103454]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2502e2bd-d2f5-43fa-95c0-d91ab43f9d16 tempest-VolumesExtendTest-1736992305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-22fb48cf-8974-4e45-9c93-0bee516e329d" returned: 0 in 0.804s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2502e2bd-d2f5-43fa-95c0-d91ab43f9d16 tempest-VolumesExtendTest-1736992305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-22fb48cf-8974-4e45-9c93-0bee516e329d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-22fb48cf-8974-4e45-9c93-0bee516e329d.b90223cb-8dc1-4af3-97c4-d31394d1e23b 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:46 devstack sudo[103460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-22fb48cf-8974-4e45-9c93-0bee516e329d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-22fb48cf-8974-4e45-9c93-0bee516e329d.b90223cb-8dc1-4af3-97c4-d31394d1e23b 1G Sep 28 15:06:46 devstack sudo[103460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:46 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:06:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] Flow 'volume_create_manager' (bd11bb21-9da8-4524-b4db-4bfa45f556df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae142a70-addf-4792-9576-a39ded7889e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae142a70-addf-4792-9576-a39ded7889e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:06:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-123014469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=759e692f-1fd3-48ed-95f0-3f0738919a73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbb2817809e84a7e848e8af455ddf683',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:06:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:06:47Z,use_quota=True,user_id='df648a79c85d4c69a644aca833a11c3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(848b0169-f31e-4983-aa34-adb7f861d7ae),volume_type_id=848b0169-f31e-4983-aa34-adb7f861d7ae)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (369a5b27-8da2-4425-bde1-dd7a71f3a620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (369a5b27-8da2-4425-bde1-dd7a71f3a620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4454c6a6-bcfd-4878-a093-1df9d54050f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:46 devstack cinder-volume[87116]: DEBUG cinder.image.glance [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] Creating Keystone auth plugin from conf {{(pid=87116) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 15:06:46 devstack sudo[103460]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2502e2bd-d2f5-43fa-95c0-d91ab43f9d16 tempest-VolumesExtendTest-1736992305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-22fb48cf-8974-4e45-9c93-0bee516e329d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-22fb48cf-8974-4e45-9c93-0bee516e329d.b90223cb-8dc1-4af3-97c4-d31394d1e23b 1G" returned: 0 in 0.764s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2502e2bd-d2f5-43fa-95c0-d91ab43f9d16 tempest-VolumesExtendTest-1736992305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22fb48cf-8974-4e45-9c93-0bee516e329d -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-22fb48cf-8974-4e45-9c93-0bee516e329d.b90223cb-8dc1-4af3-97c4-d31394d1e23b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:46 devstack sudo[103466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22fb48cf-8974-4e45-9c93-0bee516e329d -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-22fb48cf-8974-4e45-9c93-0bee516e329d.b90223cb-8dc1-4af3-97c4-d31394d1e23b Sep 28 15:06:46 devstack sudo[103466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:47 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4454c6a6-bcfd-4878-a093-1df9d54050f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '759e692f-1fd3-48ed-95f0-3f0738919a73', 'volume_name': 'volume-759e692f-1fd3-48ed-95f0-3f0738919a73', 'volume_size': 1, 'image_id': '7ea3b8e6-a647-4c5e-b59a-0fc20cde91da', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7ea3b8e6-a647-4c5e-b59a-0fc20cde91da', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--412839233', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cbb2817809e84a7e848e8af455ddf683', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7ea3b8e6-a647-4c5e-b59a-0fc20cde91da', 'created_at': datetime.datetime(2026, 9, 28, 13, 6, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 6, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7ea3b8e6-a647-4c5e-b59a-0fc20cde91da/file', 'properties': {}}, 'image_service': }' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:47 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e939011-632b-4fed-891d-85baa56ecb28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:47 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e939011-632b-4fed-891d-85baa56ecb28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:47 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d37625fd-2675-4f4d-85ff-6dfe26714819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:47 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] Volume 759e692f-1fd3-48ed-95f0-3f0738919a73: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-759e692f-1fd3-48ed-95f0-3f0738919a73', 'volume_size': 1, 'image_id': '7ea3b8e6-a647-4c5e-b59a-0fc20cde91da', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7ea3b8e6-a647-4c5e-b59a-0fc20cde91da', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--412839233', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cbb2817809e84a7e848e8af455ddf683', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7ea3b8e6-a647-4c5e-b59a-0fc20cde91da', 'created_at': datetime.datetime(2026, 9, 28, 13, 6, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 6, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7ea3b8e6-a647-4c5e-b59a-0fc20cde91da/file', 'properties': {}}, 'image_service': } Sep 28 15:06:47 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] Trying to clone 759e692f-1fd3-48ed-95f0-3f0738919a73 from image 7ea3b8e6-a647-4c5e-b59a-0fc20cde91da at location (None, [{'url': 'file:///opt/stack/data/glance/images/7ea3b8e6-a647-4c5e-b59a-0fc20cde91da', 'metadata': {}}]). {{(pid=87116) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 15:06:47 devstack sudo[103466]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2502e2bd-d2f5-43fa-95c0-d91ab43f9d16 tempest-VolumesExtendTest-1736992305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22fb48cf-8974-4e45-9c93-0bee516e329d -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-22fb48cf-8974-4e45-9c93-0bee516e329d.b90223cb-8dc1-4af3-97c4-d31394d1e23b" returned: 0 in 0.432s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:47 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-2502e2bd-d2f5-43fa-95c0-d91ab43f9d16 tempest-VolumesExtendTest-1736992305 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-22fb48cf-8974-4e45-9c93-0bee516e329d.b90223cb-8dc1-4af3-97c4-d31394d1e23b is being set with open permissions: ugo+rw Sep 28 15:06:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2502e2bd-d2f5-43fa-95c0-d91ab43f9d16 tempest-VolumesExtendTest-1736992305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-22fb48cf-8974-4e45-9c93-0bee516e329d.b90223cb-8dc1-4af3-97c4-d31394d1e23b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:47 devstack sudo[103471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-22fb48cf-8974-4e45-9c93-0bee516e329d.b90223cb-8dc1-4af3-97c4-d31394d1e23b Sep 28 15:06:47 devstack sudo[103471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:47 devstack sudo[103471]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2502e2bd-d2f5-43fa-95c0-d91ab43f9d16 tempest-VolumesExtendTest-1736992305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-22fb48cf-8974-4e45-9c93-0bee516e329d.b90223cb-8dc1-4af3-97c4-d31394d1e23b" returned: 0 in 0.295s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2502e2bd-d2f5-43fa-95c0-d91ab43f9d16 tempest-VolumesExtendTest-1736992305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-22fb48cf-8974-4e45-9c93-0bee516e329d.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:47 devstack sudo[103474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-22fb48cf-8974-4e45-9c93-0bee516e329d.info Sep 28 15:06:47 devstack sudo[103474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:48 devstack sudo[103474]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2502e2bd-d2f5-43fa-95c0-d91ab43f9d16 tempest-VolumesExtendTest-1736992305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-22fb48cf-8974-4e45-9c93-0bee516e329d.info" returned: 0 in 0.441s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:48 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-2502e2bd-d2f5-43fa-95c0-d91ab43f9d16 tempest-VolumesExtendTest-1736992305 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-22fb48cf-8974-4e45-9c93-0bee516e329d.info is being set with open permissions: ugo+rw Sep 28 15:06:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2502e2bd-d2f5-43fa-95c0-d91ab43f9d16 tempest-VolumesExtendTest-1736992305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-22fb48cf-8974-4e45-9c93-0bee516e329d.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:48 devstack sudo[103477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-22fb48cf-8974-4e45-9c93-0bee516e329d.info Sep 28 15:06:48 devstack sudo[103477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:48 devstack sudo[103477]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2502e2bd-d2f5-43fa-95c0-d91ab43f9d16 tempest-VolumesExtendTest-1736992305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-22fb48cf-8974-4e45-9c93-0bee516e329d.info" returned: 0 in 0.349s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2502e2bd-d2f5-43fa-95c0-d91ab43f9d16 tempest-VolumesExtendTest-1736992305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.430s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-06d67aad-800f-4c11-8c15-6ec7e31a00f7 tempest-TestInstancesWithCinderVolumes-1943303254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.958s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:48 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-06d67aad-800f-4c11-8c15-6ec7e31a00f7 tempest-TestInstancesWithCinderVolumes-1943303254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:06:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-957549507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25cfb136-9561-40a5-a0db-a8ac689014dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbb2817809e84a7e848e8af455ddf683',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:06:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:06:45Z,use_quota=True,user_id='df648a79c85d4c69a644aca833a11c3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a92838c1-bcf2-4325-8399-1033504485a0),volume_type_id=a92838c1-bcf2-4325-8399-1033504485a0)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:06:48 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-06d67aad-800f-4c11-8c15-6ec7e31a00f7 tempest-TestInstancesWithCinderVolumes-1943303254 None] Creating volume 25cfb136-9561-40a5-a0db-a8ac689014dd {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:06:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-06d67aad-800f-4c11-8c15-6ec7e31a00f7 tempest-TestInstancesWithCinderVolumes-1943303254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-06d67aad-800f-4c11-8c15-6ec7e31a00f7 tempest-TestInstancesWithCinderVolumes-1943303254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:48 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-06d67aad-800f-4c11-8c15-6ec7e31a00f7 tempest-TestInstancesWithCinderVolumes-1943303254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:06:48 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-06d67aad-800f-4c11-8c15-6ec7e31a00f7 tempest-TestInstancesWithCinderVolumes-1943303254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:06:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-06d67aad-800f-4c11-8c15-6ec7e31a00f7 tempest-TestInstancesWithCinderVolumes-1943303254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:48 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-06d67aad-800f-4c11-8c15-6ec7e31a00f7 tempest-TestInstancesWithCinderVolumes-1943303254 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:06:48 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-06d67aad-800f-4c11-8c15-6ec7e31a00f7 tempest-TestInstancesWithCinderVolumes-1943303254 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:06:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-06d67aad-800f-4c11-8c15-6ec7e31a00f7 tempest-TestInstancesWithCinderVolumes-1943303254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-25cfb136-9561-40a5-a0db-a8ac689014dd 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:48 devstack sudo[103482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-25cfb136-9561-40a5-a0db-a8ac689014dd 1073741824 Sep 28 15:06:48 devstack sudo[103482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:48 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-2502e2bd-d2f5-43fa-95c0-d91ab43f9d16 tempest-VolumesExtendTest-1736992305 None] Create snapshot completed successfully Sep 28 15:06:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9a8039a0-171e-4a16-b3b4-f9a1e7a9dadd tempest-VolumesExtendTest-1736992305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:49 devstack sudo[103482]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-06d67aad-800f-4c11-8c15-6ec7e31a00f7 tempest-TestInstancesWithCinderVolumes-1943303254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-25cfb136-9561-40a5-a0db-a8ac689014dd 1073741824" returned: 0 in 0.740s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-06d67aad-800f-4c11-8c15-6ec7e31a00f7 tempest-TestInstancesWithCinderVolumes-1943303254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-25cfb136-9561-40a5-a0db-a8ac689014dd {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:49 devstack sudo[103488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-25cfb136-9561-40a5-a0db-a8ac689014dd Sep 28 15:06:49 devstack sudo[103488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:49 devstack sudo[103488]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-06d67aad-800f-4c11-8c15-6ec7e31a00f7 tempest-TestInstancesWithCinderVolumes-1943303254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-25cfb136-9561-40a5-a0db-a8ac689014dd" returned: 0 in 0.319s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-06d67aad-800f-4c11-8c15-6ec7e31a00f7 tempest-TestInstancesWithCinderVolumes-1943303254 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:06:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-06d67aad-800f-4c11-8c15-6ec7e31a00f7 tempest-TestInstancesWithCinderVolumes-1943303254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-fb271aa2-4b99-4d93-9a1d-483be28b8eb0 tempest-TestInstancesWithCinderVolumes-1943303254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.833s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-fb271aa2-4b99-4d93-9a1d-483be28b8eb0 tempest-TestInstancesWithCinderVolumes-1943303254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:06:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-556175892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e711b906-935d-4349-82db-bd7c9f1174d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbb2817809e84a7e848e8af455ddf683',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:06:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:06:45Z,use_quota=True,user_id='df648a79c85d4c69a644aca833a11c3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af3c7bc6-8c7d-4ead-b91b-5058e59115f6),volume_type_id=af3c7bc6-8c7d-4ead-b91b-5058e59115f6)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:06:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-fb271aa2-4b99-4d93-9a1d-483be28b8eb0 tempest-TestInstancesWithCinderVolumes-1943303254 None] Creating volume e711b906-935d-4349-82db-bd7c9f1174d5 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:06:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-fb271aa2-4b99-4d93-9a1d-483be28b8eb0 tempest-TestInstancesWithCinderVolumes-1943303254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-fb271aa2-4b99-4d93-9a1d-483be28b8eb0 tempest-TestInstancesWithCinderVolumes-1943303254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-fb271aa2-4b99-4d93-9a1d-483be28b8eb0 tempest-TestInstancesWithCinderVolumes-1943303254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:06:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-fb271aa2-4b99-4d93-9a1d-483be28b8eb0 tempest-TestInstancesWithCinderVolumes-1943303254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:06:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-fb271aa2-4b99-4d93-9a1d-483be28b8eb0 tempest-TestInstancesWithCinderVolumes-1943303254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-fb271aa2-4b99-4d93-9a1d-483be28b8eb0 tempest-TestInstancesWithCinderVolumes-1943303254 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:06:49 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-fb271aa2-4b99-4d93-9a1d-483be28b8eb0 tempest-TestInstancesWithCinderVolumes-1943303254 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:06:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fb271aa2-4b99-4d93-9a1d-483be28b8eb0 tempest-TestInstancesWithCinderVolumes-1943303254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e711b906-935d-4349-82db-bd7c9f1174d5 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:49 devstack sudo[103491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e711b906-935d-4349-82db-bd7c9f1174d5 1073741824 Sep 28 15:06:49 devstack sudo[103491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-06d67aad-800f-4c11-8c15-6ec7e31a00f7 tempest-TestInstancesWithCinderVolumes-1943303254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1d5ea8d-6a2e-4b63-8777-3ab1091d5194) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25cfb136-9561-40a5-a0db-a8ac689014dd', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-06d67aad-800f-4c11-8c15-6ec7e31a00f7 tempest-TestInstancesWithCinderVolumes-1943303254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6849f835-f101-4a21-b9a5-18ca8fff2440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:49 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-06d67aad-800f-4c11-8c15-6ec7e31a00f7 tempest-TestInstancesWithCinderVolumes-1943303254 None] Volume volume-25cfb136-9561-40a5-a0db-a8ac689014dd (25cfb136-9561-40a5-a0db-a8ac689014dd): created successfully Sep 28 15:06:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-06d67aad-800f-4c11-8c15-6ec7e31a00f7 tempest-TestInstancesWithCinderVolumes-1943303254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6849f835-f101-4a21-b9a5-18ca8fff2440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-06d67aad-800f-4c11-8c15-6ec7e31a00f7 tempest-TestInstancesWithCinderVolumes-1943303254 None] Flow 'volume_create_manager' (a704b55f-3d6b-411c-8437-11b2abf53119) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:49 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-06d67aad-800f-4c11-8c15-6ec7e31a00f7 tempest-TestInstancesWithCinderVolumes-1943303254 None] Created volume successfully. Sep 28 15:06:50 devstack sudo[103491]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fb271aa2-4b99-4d93-9a1d-483be28b8eb0 tempest-TestInstancesWithCinderVolumes-1943303254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e711b906-935d-4349-82db-bd7c9f1174d5 1073741824" returned: 0 in 0.684s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fb271aa2-4b99-4d93-9a1d-483be28b8eb0 tempest-TestInstancesWithCinderVolumes-1943303254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e711b906-935d-4349-82db-bd7c9f1174d5 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:50 devstack sudo[103497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e711b906-935d-4349-82db-bd7c9f1174d5 Sep 28 15:06:50 devstack sudo[103497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:50 devstack sudo[103497]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fb271aa2-4b99-4d93-9a1d-483be28b8eb0 tempest-TestInstancesWithCinderVolumes-1943303254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e711b906-935d-4349-82db-bd7c9f1174d5" returned: 0 in 0.386s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:50 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-fb271aa2-4b99-4d93-9a1d-483be28b8eb0 tempest-TestInstancesWithCinderVolumes-1943303254 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:06:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-fb271aa2-4b99-4d93-9a1d-483be28b8eb0 tempest-TestInstancesWithCinderVolumes-1943303254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9a8039a0-171e-4a16-b3b4-f9a1e7a9dadd tempest-VolumesExtendTest-1736992305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.641s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fb271aa2-4b99-4d93-9a1d-483be28b8eb0 tempest-TestInstancesWithCinderVolumes-1943303254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6045dfb0-3b65-480d-a248-d297754f9211) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e711b906-935d-4349-82db-bd7c9f1174d5', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fb271aa2-4b99-4d93-9a1d-483be28b8eb0 tempest-TestInstancesWithCinderVolumes-1943303254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfa4386d-9eda-49d6-a60f-c13b2d670b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:50 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaff0638-19c5-459f-9f12-d8632119dd79]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9a8039a0-171e-4a16-b3b4-f9a1e7a9dadd tempest-VolumesExtendTest-1736992305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-22fb48cf-8974-4e45-9c93-0bee516e329d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:50 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-fb271aa2-4b99-4d93-9a1d-483be28b8eb0 tempest-TestInstancesWithCinderVolumes-1943303254 None] Volume volume-e711b906-935d-4349-82db-bd7c9f1174d5 (e711b906-935d-4349-82db-bd7c9f1174d5): created successfully Sep 28 15:06:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fb271aa2-4b99-4d93-9a1d-483be28b8eb0 tempest-TestInstancesWithCinderVolumes-1943303254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfa4386d-9eda-49d6-a60f-c13b2d670b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fb271aa2-4b99-4d93-9a1d-483be28b8eb0 tempest-TestInstancesWithCinderVolumes-1943303254 None] Flow 'volume_create_manager' (68284d15-37ce-4120-a72f-4ae67e281385) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:50 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-fb271aa2-4b99-4d93-9a1d-483be28b8eb0 tempest-TestInstancesWithCinderVolumes-1943303254 None] Created volume successfully. Sep 28 15:06:50 devstack sudo[103500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-22fb48cf-8974-4e45-9c93-0bee516e329d Sep 28 15:06:50 devstack sudo[103500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:51 devstack sudo[103500]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9a8039a0-171e-4a16-b3b4-f9a1e7a9dadd tempest-VolumesExtendTest-1736992305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-22fb48cf-8974-4e45-9c93-0bee516e329d" returned: 0 in 0.439s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9a8039a0-171e-4a16-b3b4-f9a1e7a9dadd tempest-VolumesExtendTest-1736992305 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-22fb48cf-8974-4e45-9c93-0bee516e329d.b90223cb-8dc1-4af3-97c4-d31394d1e23b 2G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9a8039a0-171e-4a16-b3b4-f9a1e7a9dadd tempest-VolumesExtendTest-1736992305 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-22fb48cf-8974-4e45-9c93-0bee516e329d.b90223cb-8dc1-4af3-97c4-d31394d1e23b 2G" returned: 0 in 0.204s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9a8039a0-171e-4a16-b3b4-f9a1e7a9dadd tempest-VolumesExtendTest-1736992305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.710s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:51 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-9a8039a0-171e-4a16-b3b4-f9a1e7a9dadd tempest-VolumesExtendTest-1736992305 None] Extend volume completed successfully. Sep 28 15:06:51 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7ea3b8e6-a647-4c5e-b59a-0fc20cde91da_ytpk8wcmdevstack@QuobyteHD, size 20.69 MB, duration 4.57 sec {{(pid=87116) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 15:06:51 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] Image download 20.69 MB at 4.53 MB/s Sep 28 15:06:51 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[2549c89e-ac6f-4cb7-84c3-a95b6fec5e63]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ea3b8e6-a647-4c5e-b59a-0fc20cde91da_ytpk8wcmdevstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:51 devstack sudo[103510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ea3b8e6-a647-4c5e-b59a-0fc20cde91da_ytpk8wcmdevstack@QuobyteHD Sep 28 15:06:51 devstack sudo[103510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:52 devstack sudo[103510]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ea3b8e6-a647-4c5e-b59a-0fc20cde91da_ytpk8wcmdevstack@QuobyteHD" returned: 0 in 0.377s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:52 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] Temporary image 7ea3b8e6-a647-4c5e-b59a-0fc20cde91da is fetched for user df648a79c85d4c69a644aca833a11c3d. {{(pid=87116) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 15:06:52 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[f866e077-3e6f-49ec-b45e-a8347cc97e57]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ea3b8e6-a647-4c5e-b59a-0fc20cde91da_ytpk8wcmdevstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:52 devstack sudo[103515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ea3b8e6-a647-4c5e-b59a-0fc20cde91da_ytpk8wcmdevstack@QuobyteHD Sep 28 15:06:52 devstack sudo[103515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:52 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ead52dbf-ad1e-49c8-ac36-5ffa7f6b1400 tempest-VolumesExtendTest-1736992305 None] Acquiring lock "cinder-b90223cb-8dc1-4af3-97c4-d31394d1e23b-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:52 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ead52dbf-ad1e-49c8-ac36-5ffa7f6b1400 tempest-VolumesExtendTest-1736992305 None] Lock "cinder-b90223cb-8dc1-4af3-97c4-d31394d1e23b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:52 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ead52dbf-ad1e-49c8-ac36-5ffa7f6b1400 tempest-VolumesExtendTest-1736992305 None] Acquiring lock "cinder-quobyte-22fb48cf-8974-4e45-9c93-0bee516e329d" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:52 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ead52dbf-ad1e-49c8-ac36-5ffa7f6b1400 tempest-VolumesExtendTest-1736992305 None] Lock "cinder-quobyte-22fb48cf-8974-4e45-9c93-0bee516e329d" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:52 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ead52dbf-ad1e-49c8-ac36-5ffa7f6b1400 tempest-VolumesExtendTest-1736992305 None] Acquiring lock "cinder-quobyte-b90223cb-8dc1-4af3-97c4-d31394d1e23b" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:52 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ead52dbf-ad1e-49c8-ac36-5ffa7f6b1400 tempest-VolumesExtendTest-1736992305 None] Lock "cinder-quobyte-b90223cb-8dc1-4af3-97c4-d31394d1e23b" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-ead52dbf-ad1e-49c8-ac36-5ffa7f6b1400 tempest-VolumesExtendTest-1736992305 None] Deleting offline snapshot b90223cb-8dc1-4af3-97c4-d31394d1e23b of volume 22fb48cf-8974-4e45-9c93-0bee516e329d {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:06:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-ead52dbf-ad1e-49c8-ac36-5ffa7f6b1400 tempest-VolumesExtendTest-1736992305 None] snapshot_file for this snap is: volume-22fb48cf-8974-4e45-9c93-0bee516e329d.b90223cb-8dc1-4af3-97c4-d31394d1e23b {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:06:52 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e9d2ec-af5d-4780-b5ff-c0804003c751]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ead52dbf-ad1e-49c8-ac36-5ffa7f6b1400 tempest-VolumesExtendTest-1736992305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-22fb48cf-8974-4e45-9c93-0bee516e329d.b90223cb-8dc1-4af3-97c4-d31394d1e23b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:52 devstack sudo[103515]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ea3b8e6-a647-4c5e-b59a-0fc20cde91da_ytpk8wcmdevstack@QuobyteHD" returned: 0 in 0.523s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:06:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-123014469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=759e692f-1fd3-48ed-95f0-3f0738919a73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbb2817809e84a7e848e8af455ddf683',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:06:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:06:47Z,use_quota=True,user_id='df648a79c85d4c69a644aca833a11c3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(848b0169-f31e-4983-aa34-adb7f861d7ae),volume_type_id=848b0169-f31e-4983-aa34-adb7f861d7ae)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:06:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] Creating volume 759e692f-1fd3-48ed-95f0-3f0738919a73 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:06:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:06:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:06:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:06:52 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:06:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-759e692f-1fd3-48ed-95f0-3f0738919a73 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:52 devstack sudo[103521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-759e692f-1fd3-48ed-95f0-3f0738919a73 1073741824 Sep 28 15:06:52 devstack sudo[103521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:52 devstack sudo[103520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-22fb48cf-8974-4e45-9c93-0bee516e329d.b90223cb-8dc1-4af3-97c4-d31394d1e23b Sep 28 15:06:52 devstack sudo[103520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:53 devstack sudo[103520]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ead52dbf-ad1e-49c8-ac36-5ffa7f6b1400 tempest-VolumesExtendTest-1736992305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-22fb48cf-8974-4e45-9c93-0bee516e329d.b90223cb-8dc1-4af3-97c4-d31394d1e23b" returned: 0 in 0.560s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:53 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-ead52dbf-ad1e-49c8-ac36-5ffa7f6b1400 tempest-VolumesExtendTest-1736992305 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22fb48cf-8974-4e45-9c93-0bee516e329d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:06:53 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ed667f-ff54-41e9-a48b-8600bdd2d654]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ead52dbf-ad1e-49c8-ac36-5ffa7f6b1400 tempest-VolumesExtendTest-1736992305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-22fb48cf-8974-4e45-9c93-0bee516e329d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:53 devstack sudo[103521]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-759e692f-1fd3-48ed-95f0-3f0738919a73 1073741824" returned: 0 in 0.609s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-759e692f-1fd3-48ed-95f0-3f0738919a73 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:53 devstack sudo[103532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-759e692f-1fd3-48ed-95f0-3f0738919a73 Sep 28 15:06:53 devstack sudo[103532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:53 devstack sudo[103531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-22fb48cf-8974-4e45-9c93-0bee516e329d Sep 28 15:06:53 devstack sudo[103531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:53 devstack sudo[103532]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-759e692f-1fd3-48ed-95f0-3f0738919a73" returned: 0 in 0.310s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:53 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:06:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:53 devstack cinder-volume[87116]: DEBUG cinder.volume.volume_utils [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] Attempting download of 7ea3b8e6-a647-4c5e-b59a-0fc20cde91da ((None, [{'url': 'file:///opt/stack/data/glance/images/7ea3b8e6-a647-4c5e-b59a-0fc20cde91da', 'metadata': {}}])) to volume 759e692f-1fd3-48ed-95f0-3f0738919a73. {{(pid=87116) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1208}} Sep 28 15:06:53 devstack sudo[103531]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ead52dbf-ad1e-49c8-ac36-5ffa7f6b1400 tempest-VolumesExtendTest-1736992305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-22fb48cf-8974-4e45-9c93-0bee516e329d" returned: 0 in 0.495s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ead52dbf-ad1e-49c8-ac36-5ffa7f6b1400 tempest-VolumesExtendTest-1736992305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-22fb48cf-8974-4e45-9c93-0bee516e329d.b90223cb-8dc1-4af3-97c4-d31394d1e23b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:53 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[7155c907-fc7d-400d-80d6-1a7f484dafc8]: (4, 'raw') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7ea3b8e6-a647-4c5e-b59a-0fc20cde91da_5vomqnj3 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:53 devstack sudo[103539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-22fb48cf-8974-4e45-9c93-0bee516e329d.b90223cb-8dc1-4af3-97c4-d31394d1e23b Sep 28 15:06:53 devstack sudo[103539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:54 devstack sudo[103541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7ea3b8e6-a647-4c5e-b59a-0fc20cde91da_5vomqnj3 Sep 28 15:06:54 devstack sudo[103541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:54 devstack sudo[103539]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ead52dbf-ad1e-49c8-ac36-5ffa7f6b1400 tempest-VolumesExtendTest-1736992305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-22fb48cf-8974-4e45-9c93-0bee516e329d.b90223cb-8dc1-4af3-97c4-d31394d1e23b" returned: 0 in 0.461s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ead52dbf-ad1e-49c8-ac36-5ffa7f6b1400 tempest-VolumesExtendTest-1736992305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-22fb48cf-8974-4e45-9c93-0bee516e329d.b90223cb-8dc1-4af3-97c4-d31394d1e23b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:54 devstack sudo[103549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-22fb48cf-8974-4e45-9c93-0bee516e329d.b90223cb-8dc1-4af3-97c4-d31394d1e23b Sep 28 15:06:54 devstack sudo[103549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:54 devstack sudo[103541]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7ea3b8e6-a647-4c5e-b59a-0fc20cde91da_5vomqnj3" returned: 0 in 0.478s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ea3b8e6-a647-4c5e-b59a-0fc20cde91da_5vomqnj3 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:54 devstack sudo[103551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ea3b8e6-a647-4c5e-b59a-0fc20cde91da_5vomqnj3 Sep 28 15:06:54 devstack sudo[103551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:54 devstack sudo[103549]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ead52dbf-ad1e-49c8-ac36-5ffa7f6b1400 tempest-VolumesExtendTest-1736992305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-22fb48cf-8974-4e45-9c93-0bee516e329d.b90223cb-8dc1-4af3-97c4-d31394d1e23b" returned: 0 in 0.302s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:54 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ead52dbf-ad1e-49c8-ac36-5ffa7f6b1400 tempest-VolumesExtendTest-1736992305 None] Lock "cinder-quobyte-b90223cb-8dc1-4af3-97c4-d31394d1e23b" released by "_delete_snapshot" :: held 1.985s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:54 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ead52dbf-ad1e-49c8-ac36-5ffa7f6b1400 tempest-VolumesExtendTest-1736992305 None] Lock "cinder-quobyte-22fb48cf-8974-4e45-9c93-0bee516e329d" released by "delete_snapshot" :: held 2.028s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:54 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-ead52dbf-ad1e-49c8-ac36-5ffa7f6b1400 tempest-VolumesExtendTest-1736992305 None] Created reservations ['256b50b8-c700-4acd-a2d3-4a52e95a1f02', 'e4918755-2ede-4c01-a3f9-d926d30c8fc5', 'd687364d-2269-4945-9ac4-df52a0ef5f9b', 'c5532b9c-733c-4b50-a30e-cee81908ee8f'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:06:54 devstack sudo[103551]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ea3b8e6-a647-4c5e-b59a-0fc20cde91da_5vomqnj3" returned: 1 in 0.483s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7ea3b8e6-a647-4c5e-b59a-0fc20cde91da_5vomqnj3' failed. Not Retrying. {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:06:54 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3bfb3e-08a5-4378-9304-5e40bd0716ea]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ea3b8e6-a647-4c5e-b59a-0fc20cde91da_ytpk8wcmdevstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:54 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-ead52dbf-ad1e-49c8-ac36-5ffa7f6b1400 tempest-VolumesExtendTest-1736992305 None] Delete snapshot completed successfully. Sep 28 15:06:54 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ead52dbf-ad1e-49c8-ac36-5ffa7f6b1400 tempest-VolumesExtendTest-1736992305 None] Lock "cinder-b90223cb-8dc1-4af3-97c4-d31394d1e23b-delete_snapshot" released by "delete_snapshot" :: held 2.304s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:54 devstack sudo[103556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ea3b8e6-a647-4c5e-b59a-0fc20cde91da_ytpk8wcmdevstack@QuobyteHD Sep 28 15:06:54 devstack sudo[103556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:55 devstack sudo[103556]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7ea3b8e6-a647-4c5e-b59a-0fc20cde91da_ytpk8wcmdevstack@QuobyteHD" returned: 0 in 0.370s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:55 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] 7ea3b8e6-a647-4c5e-b59a-0fc20cde91da was qcow2, converting to qcow2 {{(pid=87116) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 15:06:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7ea3b8e6-a647-4c5e-b59a-0fc20cde91da_ytpk8wcmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-759e692f-1fd3-48ed-95f0-3f0738919a73 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:55 devstack sudo[103561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7ea3b8e6-a647-4c5e-b59a-0fc20cde91da_ytpk8wcmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-759e692f-1fd3-48ed-95f0-3f0738919a73 Sep 28 15:06:55 devstack sudo[103561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:55 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4a721b5d-834d-4ad7-a1b5-2b1c1afb8cc0 tempest-VolumesExtendTest-1736992305 None] Acquiring lock "cinder-22fb48cf-8974-4e45-9c93-0bee516e329d-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:55 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4a721b5d-834d-4ad7-a1b5-2b1c1afb8cc0 tempest-VolumesExtendTest-1736992305 None] Lock "cinder-22fb48cf-8974-4e45-9c93-0bee516e329d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:56 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4a721b5d-834d-4ad7-a1b5-2b1c1afb8cc0 tempest-VolumesExtendTest-1736992305 None] Acquiring lock "cinder-quobyte-22fb48cf-8974-4e45-9c93-0bee516e329d" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:56 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4a721b5d-834d-4ad7-a1b5-2b1c1afb8cc0 tempest-VolumesExtendTest-1736992305 None] Lock "cinder-quobyte-22fb48cf-8974-4e45-9c93-0bee516e329d" acquired by "delete_volume" :: waited 0.028s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:56 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5a925f-8983-49f7-a79a-a5c19fbc49dc]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4a721b5d-834d-4ad7-a1b5-2b1c1afb8cc0 tempest-VolumesExtendTest-1736992305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-22fb48cf-8974-4e45-9c93-0bee516e329d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:56 devstack sudo[103597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-22fb48cf-8974-4e45-9c93-0bee516e329d Sep 28 15:06:56 devstack sudo[103597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:56 devstack sudo[103597]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4a721b5d-834d-4ad7-a1b5-2b1c1afb8cc0 tempest-VolumesExtendTest-1736992305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-22fb48cf-8974-4e45-9c93-0bee516e329d" returned: 0 in 0.517s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4a721b5d-834d-4ad7-a1b5-2b1c1afb8cc0 tempest-VolumesExtendTest-1736992305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-22fb48cf-8974-4e45-9c93-0bee516e329d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:56 devstack sudo[103602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-22fb48cf-8974-4e45-9c93-0bee516e329d Sep 28 15:06:56 devstack sudo[103602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:56 devstack sudo[103602]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4a721b5d-834d-4ad7-a1b5-2b1c1afb8cc0 tempest-VolumesExtendTest-1736992305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-22fb48cf-8974-4e45-9c93-0bee516e329d" returned: 0 in 0.309s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:56 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4a721b5d-834d-4ad7-a1b5-2b1c1afb8cc0 tempest-VolumesExtendTest-1736992305 None] Lock "cinder-quobyte-22fb48cf-8974-4e45-9c93-0bee516e329d" released by "delete_volume" :: held 0.918s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:57 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-4a721b5d-834d-4ad7-a1b5-2b1c1afb8cc0 tempest-VolumesExtendTest-1736992305 None] Created reservations ['8779fc3d-1624-4628-b16c-878d1a8559ed', 'c81d0c07-3ac1-4e24-b6b5-04cb3f0e626c', 'cc219b84-41cd-4785-b407-944b9656a296', '6463b82c-150e-4cb0-8408-46ed16c606e1'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:06:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4a721b5d-834d-4ad7-a1b5-2b1c1afb8cc0 tempest-VolumesExtendTest-1736992305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4a721b5d-834d-4ad7-a1b5-2b1c1afb8cc0 tempest-VolumesExtendTest-1736992305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4a721b5d-834d-4ad7-a1b5-2b1c1afb8cc0 tempest-VolumesExtendTest-1736992305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:06:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4a721b5d-834d-4ad7-a1b5-2b1c1afb8cc0 tempest-VolumesExtendTest-1736992305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:06:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4a721b5d-834d-4ad7-a1b5-2b1c1afb8cc0 tempest-VolumesExtendTest-1736992305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4a721b5d-834d-4ad7-a1b5-2b1c1afb8cc0 tempest-VolumesExtendTest-1736992305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:57 devstack sudo[103609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:06:57 devstack sudo[103609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:57 devstack sudo[103609]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4a721b5d-834d-4ad7-a1b5-2b1c1afb8cc0 tempest-VolumesExtendTest-1736992305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.430s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:57 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-4a721b5d-834d-4ad7-a1b5-2b1c1afb8cc0 tempest-VolumesExtendTest-1736992305 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:06:57 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-4a721b5d-834d-4ad7-a1b5-2b1c1afb8cc0 tempest-VolumesExtendTest-1736992305 None] Deleted volume successfully. Sep 28 15:06:57 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4a721b5d-834d-4ad7-a1b5-2b1c1afb8cc0 tempest-VolumesExtendTest-1736992305 None] Lock "cinder-22fb48cf-8974-4e45-9c93-0bee516e329d-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:57 devstack sudo[103561]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7ea3b8e6-a647-4c5e-b59a-0fc20cde91da_ytpk8wcmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-759e692f-1fd3-48ed-95f0-3f0738919a73" returned: 0 in 2.496s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:57 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7ea3b8e6-a647-4c5e-b59a-0fc20cde91da_ytpk8wcmdevstack@QuobyteHD, size 112.00 MB, duration 2.50 sec, destination /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-759e692f-1fd3-48ed-95f0-3f0738919a73 {{(pid=87116) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:06:57 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] Converted 112.00 MB image at 44.86 MB/s Sep 28 15:06:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-759e692f-1fd3-48ed-95f0-3f0738919a73 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:57 devstack sudo[103615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-759e692f-1fd3-48ed-95f0-3f0738919a73 1G Sep 28 15:06:57 devstack sudo[103615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:58 devstack sudo[103615]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-759e692f-1fd3-48ed-95f0-3f0738919a73 1G" returned: 0 in 0.407s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:58 devstack cinder-volume[87116]: DEBUG cinder.volume.volume_utils [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] Downloaded image 7ea3b8e6-a647-4c5e-b59a-0fc20cde91da ((None, [{'url': 'file:///opt/stack/data/glance/images/7ea3b8e6-a647-4c5e-b59a-0fc20cde91da', 'metadata': {}}])) to volume 759e692f-1fd3-48ed-95f0-3f0738919a73 successfully. {{(pid=87116) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1253}} Sep 28 15:06:58 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] Temporary image 7ea3b8e6-a647-4c5e-b59a-0fc20cde91da for user df648a79c85d4c69a644aca833a11c3d is deleted. {{(pid=87116) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 15:06:58 devstack cinder-volume[87116]: DEBUG cinder.volume.volume_utils [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] Marking volume 759e692f-1fd3-48ed-95f0-3f0738919a73 as bootable. {{(pid=87116) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1157}} Sep 28 15:06:58 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] Copying metadata from image 7ea3b8e6-a647-4c5e-b59a-0fc20cde91da to 759e692f-1fd3-48ed-95f0-3f0738919a73. {{(pid=87116) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 15:06:58 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] Creating volume glance metadata for volume 759e692f-1fd3-48ed-95f0-3f0738919a73 backed by image 7ea3b8e6-a647-4c5e-b59a-0fc20cde91da with: {'image_id': '7ea3b8e6-a647-4c5e-b59a-0fc20cde91da', 'image_name': 'tempest-scenario-img--412839233', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87116) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 15:06:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d37625fd-2675-4f4d-85ff-6dfe26714819) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-759e692f-1fd3-48ed-95f0-3f0738919a73', 'volume_size': 1, 'image_id': '7ea3b8e6-a647-4c5e-b59a-0fc20cde91da', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7ea3b8e6-a647-4c5e-b59a-0fc20cde91da', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--412839233', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cbb2817809e84a7e848e8af455ddf683', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7ea3b8e6-a647-4c5e-b59a-0fc20cde91da', 'created_at': datetime.datetime(2026, 9, 28, 13, 6, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 6, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7ea3b8e6-a647-4c5e-b59a-0fc20cde91da/file', 'properties': {}}, 'image_service': }' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a40cd0f6-d09e-4290-a078-485663d4ddeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:58 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] Volume volume-759e692f-1fd3-48ed-95f0-3f0738919a73 (759e692f-1fd3-48ed-95f0-3f0738919a73): created successfully Sep 28 15:06:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a40cd0f6-d09e-4290-a078-485663d4ddeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] Flow 'volume_create_manager' (bd11bb21-9da8-4524-b4db-4bfa45f556df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:58 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-d8dff31c-251f-4713-8f7a-77b86cc3f487 tempest-TestInstancesWithCinderVolumes-1943303254 None] Created volume successfully. Sep 28 15:07:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-1eced2e3-1d77-492c-af77-a3ac97e7fdab req-7e675c18-9b54-4357-b770-203c48ebe160 tempest-TestInstancesWithCinderVolumes-1943303254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-1eced2e3-1d77-492c-af77-a3ac97e7fdab req-7e675c18-9b54-4357-b770-203c48ebe160 tempest-TestInstancesWithCinderVolumes-1943303254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-1eced2e3-1d77-492c-af77-a3ac97e7fdab req-7e675c18-9b54-4357-b770-203c48ebe160 tempest-TestInstancesWithCinderVolumes-1943303254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-1eced2e3-1d77-492c-af77-a3ac97e7fdab req-7e675c18-9b54-4357-b770-203c48ebe160 tempest-TestInstancesWithCinderVolumes-1943303254 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1', 'name': 'volume-759e692f-1fd3-48ed-95f0-3f0738919a73', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c9f44f06-644a-463e-b1b7-0fed78bae144', 'enforce_multipath': True} {{(pid=87116) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:07:02 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-1eced2e3-1d77-492c-af77-a3ac97e7fdab req-7e675c18-9b54-4357-b770-203c48ebe160 tempest-TestInstancesWithCinderVolumes-1943303254 None] attachment_update completed successfully. Sep 28 15:07:12 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:INSERT=21,cinder:SELECT=64,cinder:UPDATE=55,cinder:DELETE=6 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:07:12 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=64,cinder:INSERT=31,cinder:UPDATE=46,cinder:DELETE=3 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:07:17 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:07:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:07:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:07:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:17 devstack sudo[103732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:07:17 devstack sudo[103732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:17 devstack sudo[103732]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.451s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:17 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:07:17 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running periodic task VolumeManager._thread_info {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:07:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] thread count: 28 {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:07:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] thread info: [<_MainThread(MainThread, started 135146735652992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:07:26 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-241208ac-f3c5-425f-adfa-f90dc406150c req-da14e1a4-2ee3-494d-a7c8-459d284ac4e6 tempest-TestShelveInstance-1773918598 None] Terminate volume connection completed successfully. Sep 28 15:07:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-241208ac-f3c5-425f-adfa-f90dc406150c req-da14e1a4-2ee3-494d-a7c8-459d284ac4e6 tempest-TestShelveInstance-1773918598 None] Deleting attachment 1c24b9af-456a-4f29-b51b-ca5a842135fd. {{(pid=87116) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:07:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-2b1ad44a-c1b6-4271-a212-17e6b65092c4 req-dda07a78-c945-4b4f-9819-c8f43ac6652e tempest-TestShelveInstance-1773918598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-2b1ad44a-c1b6-4271-a212-17e6b65092c4 req-dda07a78-c945-4b4f-9819-c8f43ac6652e tempest-TestShelveInstance-1773918598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-2b1ad44a-c1b6-4271-a212-17e6b65092c4 req-dda07a78-c945-4b4f-9819-c8f43ac6652e tempest-TestShelveInstance-1773918598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-2b1ad44a-c1b6-4271-a212-17e6b65092c4 req-dda07a78-c945-4b4f-9819-c8f43ac6652e tempest-TestShelveInstance-1773918598 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1', 'name': 'volume-51fb72b4-5c6e-490a-b927-601d0d92380f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ab2e60f7-7d21-4b3d-abc6-54797a276103', 'enforce_multipath': True} {{(pid=87116) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:07:31 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-2b1ad44a-c1b6-4271-a212-17e6b65092c4 req-dda07a78-c945-4b4f-9819-c8f43ac6652e tempest-TestShelveInstance-1773918598 None] attachment_update completed successfully. Sep 28 15:07:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-29abf7e5-ce12-4c29-816d-d1e51a7d6368 req-c30fa13c-24e5-4b31-9f7a-5b86788880cf tempest-TestInstancesWithCinderVolumes-1943303254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-29abf7e5-ce12-4c29-816d-d1e51a7d6368 req-c30fa13c-24e5-4b31-9f7a-5b86788880cf tempest-TestInstancesWithCinderVolumes-1943303254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-29abf7e5-ce12-4c29-816d-d1e51a7d6368 req-c30fa13c-24e5-4b31-9f7a-5b86788880cf tempest-TestInstancesWithCinderVolumes-1943303254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.061s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-29abf7e5-ce12-4c29-816d-d1e51a7d6368 req-c30fa13c-24e5-4b31-9f7a-5b86788880cf tempest-TestInstancesWithCinderVolumes-1943303254 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1', 'name': 'volume-25cfb136-9561-40a5-a0db-a8ac689014dd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bf48a1f4-9c09-4b82-93a7-97879e52d160', 'enforce_multipath': True} {{(pid=87116) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:07:42 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-29abf7e5-ce12-4c29-816d-d1e51a7d6368 req-c30fa13c-24e5-4b31-9f7a-5b86788880cf tempest-TestInstancesWithCinderVolumes-1943303254 None] attachment_update completed successfully. Sep 28 15:07:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-de17139b-9ff2-4d63-985e-f17f17e1042c req-d848eec0-b077-4de4-b910-e5cf1a59dc02 tempest-TestInstancesWithCinderVolumes-1943303254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-de17139b-9ff2-4d63-985e-f17f17e1042c req-d848eec0-b077-4de4-b910-e5cf1a59dc02 tempest-TestInstancesWithCinderVolumes-1943303254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-de17139b-9ff2-4d63-985e-f17f17e1042c req-d848eec0-b077-4de4-b910-e5cf1a59dc02 tempest-TestInstancesWithCinderVolumes-1943303254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.083s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:47 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-de17139b-9ff2-4d63-985e-f17f17e1042c req-d848eec0-b077-4de4-b910-e5cf1a59dc02 tempest-TestInstancesWithCinderVolumes-1943303254 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1', 'name': 'volume-e711b906-935d-4349-82db-bd7c9f1174d5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '31e410cb-f2e8-4036-8a86-1f4ca0548a01', 'enforce_multipath': True} {{(pid=87116) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:07:47 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-de17139b-9ff2-4d63-985e-f17f17e1042c req-d848eec0-b077-4de4-b910-e5cf1a59dc02 tempest-TestInstancesWithCinderVolumes-1943303254 None] attachment_update completed successfully. Sep 28 15:07:52 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-35d228a1-71bf-4b1c-bd0d-0345da619b0e tempest-TestMinimumBasicScenario-1546684596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:07:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-35d228a1-71bf-4b1c-bd0d-0345da619b0e tempest-TestMinimumBasicScenario-1546684596 None] Flow 'volume_create_manager' (cff9b6d8-c5e1-48e7-8172-b7e50ddd1ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:07:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-35d228a1-71bf-4b1c-bd0d-0345da619b0e tempest-TestMinimumBasicScenario-1546684596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22b9f434-c705-4e96-bc47-34d989dd5b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-35d228a1-71bf-4b1c-bd0d-0345da619b0e tempest-TestMinimumBasicScenario-1546684596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22b9f434-c705-4e96-bc47-34d989dd5b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:07:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-770994801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84955917-c572-4297-98c7-e17bdafc941b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91ff5855212348d9978e2fd200ad0b26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:07:52Z,use_quota=True,user_id='29cb7e1bd94a4471af5ccbe06961bf09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-35d228a1-71bf-4b1c-bd0d-0345da619b0e tempest-TestMinimumBasicScenario-1546684596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ca21b6b-93a3-4137-8097-b8ab0447bd47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-35d228a1-71bf-4b1c-bd0d-0345da619b0e tempest-TestMinimumBasicScenario-1546684596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ca21b6b-93a3-4137-8097-b8ab0447bd47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-35d228a1-71bf-4b1c-bd0d-0345da619b0e tempest-TestMinimumBasicScenario-1546684596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47d3bd39-b6ed-4411-ac34-38716a5abc1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-35d228a1-71bf-4b1c-bd0d-0345da619b0e tempest-TestMinimumBasicScenario-1546684596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47d3bd39-b6ed-4411-ac34-38716a5abc1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84955917-c572-4297-98c7-e17bdafc941b', 'volume_name': 'volume-84955917-c572-4297-98c7-e17bdafc941b', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-35d228a1-71bf-4b1c-bd0d-0345da619b0e tempest-TestMinimumBasicScenario-1546684596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b245a26c-3246-4f00-b10b-58b8cc2d9429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-35d228a1-71bf-4b1c-bd0d-0345da619b0e tempest-TestMinimumBasicScenario-1546684596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b245a26c-3246-4f00-b10b-58b8cc2d9429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-35d228a1-71bf-4b1c-bd0d-0345da619b0e tempest-TestMinimumBasicScenario-1546684596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be34d3d1-3be0-4ad8-a677-39110a6bb648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:52 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-35d228a1-71bf-4b1c-bd0d-0345da619b0e tempest-TestMinimumBasicScenario-1546684596 None] Volume 84955917-c572-4297-98c7-e17bdafc941b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84955917-c572-4297-98c7-e17bdafc941b', 'volume_size': 1} Sep 28 15:07:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-35d228a1-71bf-4b1c-bd0d-0345da619b0e tempest-TestMinimumBasicScenario-1546684596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-35d228a1-71bf-4b1c-bd0d-0345da619b0e tempest-TestMinimumBasicScenario-1546684596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-35d228a1-71bf-4b1c-bd0d-0345da619b0e tempest-TestMinimumBasicScenario-1546684596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:07:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-770994801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84955917-c572-4297-98c7-e17bdafc941b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91ff5855212348d9978e2fd200ad0b26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:07:52Z,use_quota=True,user_id='29cb7e1bd94a4471af5ccbe06961bf09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:07:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-35d228a1-71bf-4b1c-bd0d-0345da619b0e tempest-TestMinimumBasicScenario-1546684596 None] Creating volume 84955917-c572-4297-98c7-e17bdafc941b {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:07:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-35d228a1-71bf-4b1c-bd0d-0345da619b0e tempest-TestMinimumBasicScenario-1546684596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-35d228a1-71bf-4b1c-bd0d-0345da619b0e tempest-TestMinimumBasicScenario-1546684596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-35d228a1-71bf-4b1c-bd0d-0345da619b0e tempest-TestMinimumBasicScenario-1546684596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:07:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-35d228a1-71bf-4b1c-bd0d-0345da619b0e tempest-TestMinimumBasicScenario-1546684596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:07:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-35d228a1-71bf-4b1c-bd0d-0345da619b0e tempest-TestMinimumBasicScenario-1546684596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-35d228a1-71bf-4b1c-bd0d-0345da619b0e tempest-TestMinimumBasicScenario-1546684596 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:07:52 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-35d228a1-71bf-4b1c-bd0d-0345da619b0e tempest-TestMinimumBasicScenario-1546684596 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:07:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-35d228a1-71bf-4b1c-bd0d-0345da619b0e tempest-TestMinimumBasicScenario-1546684596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-84955917-c572-4297-98c7-e17bdafc941b 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:52 devstack sudo[104099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-84955917-c572-4297-98c7-e17bdafc941b 1073741824 Sep 28 15:07:52 devstack sudo[104099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:52 devstack sudo[104099]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-35d228a1-71bf-4b1c-bd0d-0345da619b0e tempest-TestMinimumBasicScenario-1546684596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-84955917-c572-4297-98c7-e17bdafc941b 1073741824" returned: 0 in 0.676s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-35d228a1-71bf-4b1c-bd0d-0345da619b0e tempest-TestMinimumBasicScenario-1546684596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-84955917-c572-4297-98c7-e17bdafc941b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:52 devstack sudo[104118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-84955917-c572-4297-98c7-e17bdafc941b Sep 28 15:07:52 devstack sudo[104118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:53 devstack sudo[104118]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-35d228a1-71bf-4b1c-bd0d-0345da619b0e tempest-TestMinimumBasicScenario-1546684596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-84955917-c572-4297-98c7-e17bdafc941b" returned: 0 in 0.353s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:53 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-35d228a1-71bf-4b1c-bd0d-0345da619b0e tempest-TestMinimumBasicScenario-1546684596 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:07:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-35d228a1-71bf-4b1c-bd0d-0345da619b0e tempest-TestMinimumBasicScenario-1546684596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:53 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-35d228a1-71bf-4b1c-bd0d-0345da619b0e tempest-TestMinimumBasicScenario-1546684596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be34d3d1-3be0-4ad8-a677-39110a6bb648) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84955917-c572-4297-98c7-e17bdafc941b', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:53 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-35d228a1-71bf-4b1c-bd0d-0345da619b0e tempest-TestMinimumBasicScenario-1546684596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cca844de-cd54-41ee-a79d-6d9445cf3fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:53 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-35d228a1-71bf-4b1c-bd0d-0345da619b0e tempest-TestMinimumBasicScenario-1546684596 None] Volume volume-84955917-c572-4297-98c7-e17bdafc941b (84955917-c572-4297-98c7-e17bdafc941b): created successfully Sep 28 15:07:53 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-35d228a1-71bf-4b1c-bd0d-0345da619b0e tempest-TestMinimumBasicScenario-1546684596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cca844de-cd54-41ee-a79d-6d9445cf3fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:53 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-35d228a1-71bf-4b1c-bd0d-0345da619b0e tempest-TestMinimumBasicScenario-1546684596 None] Flow 'volume_create_manager' (cff9b6d8-c5e1-48e7-8172-b7e50ddd1ea9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:07:53 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-35d228a1-71bf-4b1c-bd0d-0345da619b0e tempest-TestMinimumBasicScenario-1546684596 None] Created volume successfully. Sep 28 15:07:54 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-1ad30873-7897-4cd3-bd28-553a4b44b7c8 req-335f5de7-f6dc-4f34-bb1f-18dc6ab1a393 tempest-TestInstancesWithCinderVolumes-1943303254 None] Terminate volume connection completed successfully. Sep 28 15:07:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-1ad30873-7897-4cd3-bd28-553a4b44b7c8 req-335f5de7-f6dc-4f34-bb1f-18dc6ab1a393 tempest-TestInstancesWithCinderVolumes-1943303254 None] Deleting attachment bf48a1f4-9c09-4b82-93a7-97879e52d160. {{(pid=87116) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:07:55 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2a1e38b1-32c1-4747-bf8c-a0a329e01505 tempest-TestInstancesWithCinderVolumes-1943303254 None] Acquiring lock "cinder-25cfb136-9561-40a5-a0db-a8ac689014dd-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:55 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2a1e38b1-32c1-4747-bf8c-a0a329e01505 tempest-TestInstancesWithCinderVolumes-1943303254 None] Lock "cinder-25cfb136-9561-40a5-a0db-a8ac689014dd-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:55 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2a1e38b1-32c1-4747-bf8c-a0a329e01505 tempest-TestInstancesWithCinderVolumes-1943303254 None] Acquiring lock "cinder-quobyte-25cfb136-9561-40a5-a0db-a8ac689014dd" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:55 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2a1e38b1-32c1-4747-bf8c-a0a329e01505 tempest-TestInstancesWithCinderVolumes-1943303254 None] Lock "cinder-quobyte-25cfb136-9561-40a5-a0db-a8ac689014dd" acquired by "delete_volume" :: waited 0.021s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:55 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5a814a-135c-4512-8595-277491f08588]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2a1e38b1-32c1-4747-bf8c-a0a329e01505 tempest-TestInstancesWithCinderVolumes-1943303254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-25cfb136-9561-40a5-a0db-a8ac689014dd {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:55 devstack sudo[104148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-25cfb136-9561-40a5-a0db-a8ac689014dd Sep 28 15:07:55 devstack sudo[104148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-f59aef78-c17c-49fc-89b5-1f6a516f779f req-3a4693ae-2bec-46c4-90a0-e70505c30f90 tempest-TestMinimumBasicScenario-1546684596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-f59aef78-c17c-49fc-89b5-1f6a516f779f req-3a4693ae-2bec-46c4-90a0-e70505c30f90 tempest-TestMinimumBasicScenario-1546684596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-f59aef78-c17c-49fc-89b5-1f6a516f779f req-3a4693ae-2bec-46c4-90a0-e70505c30f90 tempest-TestMinimumBasicScenario-1546684596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-f59aef78-c17c-49fc-89b5-1f6a516f779f req-3a4693ae-2bec-46c4-90a0-e70505c30f90 tempest-TestMinimumBasicScenario-1546684596 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1', 'name': 'volume-84955917-c572-4297-98c7-e17bdafc941b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9a7b5694-8f1f-4e96-acb0-65af99ed8731', 'enforce_multipath': True} {{(pid=87116) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:07:56 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-f59aef78-c17c-49fc-89b5-1f6a516f779f req-3a4693ae-2bec-46c4-90a0-e70505c30f90 tempest-TestMinimumBasicScenario-1546684596 None] attachment_update completed successfully. Sep 28 15:07:56 devstack sudo[104148]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2a1e38b1-32c1-4747-bf8c-a0a329e01505 tempest-TestInstancesWithCinderVolumes-1943303254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-25cfb136-9561-40a5-a0db-a8ac689014dd" returned: 0 in 0.722s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2a1e38b1-32c1-4747-bf8c-a0a329e01505 tempest-TestInstancesWithCinderVolumes-1943303254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-25cfb136-9561-40a5-a0db-a8ac689014dd {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:56 devstack sudo[104156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-25cfb136-9561-40a5-a0db-a8ac689014dd Sep 28 15:07:56 devstack sudo[104156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:56 devstack sudo[104156]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2a1e38b1-32c1-4747-bf8c-a0a329e01505 tempest-TestInstancesWithCinderVolumes-1943303254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-25cfb136-9561-40a5-a0db-a8ac689014dd" returned: 0 in 0.467s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:56 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2a1e38b1-32c1-4747-bf8c-a0a329e01505 tempest-TestInstancesWithCinderVolumes-1943303254 None] Lock "cinder-quobyte-25cfb136-9561-40a5-a0db-a8ac689014dd" released by "delete_volume" :: held 1.258s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:56 devstack cinder-volume[87116]: WARNING cinder.quota [None req-2a1e38b1-32c1-4747-bf8c-a0a329e01505 tempest-TestInstancesWithCinderVolumes-1943303254 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-717246457-17026092 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-717246457-17026092, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:07:56 devstack cinder-volume[87116]: WARNING cinder.quota [None req-2a1e38b1-32c1-4747-bf8c-a0a329e01505 tempest-TestInstancesWithCinderVolumes-1943303254 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-717246457-17026092 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-717246457-17026092, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:07:56 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-2a1e38b1-32c1-4747-bf8c-a0a329e01505 tempest-TestInstancesWithCinderVolumes-1943303254 None] Created reservations ['62fca852-3624-4093-913c-6b4a609dcc77', 'd639f8ab-1fb3-4fbb-af41-8720b3b57af9', 'caee1a07-e06e-40d3-b691-9f1f3b86facf', 'b3296879-adc7-4983-b89f-a48cd5fdb370'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:07:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2a1e38b1-32c1-4747-bf8c-a0a329e01505 tempest-TestInstancesWithCinderVolumes-1943303254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2a1e38b1-32c1-4747-bf8c-a0a329e01505 tempest-TestInstancesWithCinderVolumes-1943303254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2a1e38b1-32c1-4747-bf8c-a0a329e01505 tempest-TestInstancesWithCinderVolumes-1943303254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:07:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2a1e38b1-32c1-4747-bf8c-a0a329e01505 tempest-TestInstancesWithCinderVolumes-1943303254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:07:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2a1e38b1-32c1-4747-bf8c-a0a329e01505 tempest-TestInstancesWithCinderVolumes-1943303254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2a1e38b1-32c1-4747-bf8c-a0a329e01505 tempest-TestInstancesWithCinderVolumes-1943303254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:57 devstack sudo[104164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:07:57 devstack sudo[104164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:57 devstack sudo[104164]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2a1e38b1-32c1-4747-bf8c-a0a329e01505 tempest-TestInstancesWithCinderVolumes-1943303254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.586s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:57 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-2a1e38b1-32c1-4747-bf8c-a0a329e01505 tempest-TestInstancesWithCinderVolumes-1943303254 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:07:57 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-2a1e38b1-32c1-4747-bf8c-a0a329e01505 tempest-TestInstancesWithCinderVolumes-1943303254 None] Deleted volume successfully. Sep 28 15:07:57 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2a1e38b1-32c1-4747-bf8c-a0a329e01505 tempest-TestInstancesWithCinderVolumes-1943303254 None] Lock "cinder-25cfb136-9561-40a5-a0db-a8ac689014dd-delete_volume" released by "delete_volume" :: held 2.243s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:01 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-089afbf5-17eb-44ba-973a-c93a53a6d5b8 req-0963d473-3cd1-4156-8407-b3e5e2a39558 tempest-TestInstancesWithCinderVolumes-1943303254 None] Terminate volume connection completed successfully. Sep 28 15:08:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-089afbf5-17eb-44ba-973a-c93a53a6d5b8 req-0963d473-3cd1-4156-8407-b3e5e2a39558 tempest-TestInstancesWithCinderVolumes-1943303254 None] Deleting attachment 31e410cb-f2e8-4036-8a86-1f4ca0548a01. {{(pid=87116) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:08:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-28d885e3-e814-451f-8dec-32714ab30ebe tempest-TestInstancesWithCinderVolumes-1943303254 None] Acquiring lock "cinder-e711b906-935d-4349-82db-bd7c9f1174d5-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-28d885e3-e814-451f-8dec-32714ab30ebe tempest-TestInstancesWithCinderVolumes-1943303254 None] Lock "cinder-e711b906-935d-4349-82db-bd7c9f1174d5-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-28d885e3-e814-451f-8dec-32714ab30ebe tempest-TestInstancesWithCinderVolumes-1943303254 None] Acquiring lock "cinder-quobyte-e711b906-935d-4349-82db-bd7c9f1174d5" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-28d885e3-e814-451f-8dec-32714ab30ebe tempest-TestInstancesWithCinderVolumes-1943303254 None] Lock "cinder-quobyte-e711b906-935d-4349-82db-bd7c9f1174d5" acquired by "delete_volume" :: waited 0.040s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:02 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d060de-f170-4a04-b649-b6bc116cb0be]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-28d885e3-e814-451f-8dec-32714ab30ebe tempest-TestInstancesWithCinderVolumes-1943303254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e711b906-935d-4349-82db-bd7c9f1174d5 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:02 devstack sudo[104197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e711b906-935d-4349-82db-bd7c9f1174d5 Sep 28 15:08:02 devstack sudo[104197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:03 devstack sudo[104197]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-28d885e3-e814-451f-8dec-32714ab30ebe tempest-TestInstancesWithCinderVolumes-1943303254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e711b906-935d-4349-82db-bd7c9f1174d5" returned: 0 in 0.643s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-28d885e3-e814-451f-8dec-32714ab30ebe tempest-TestInstancesWithCinderVolumes-1943303254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e711b906-935d-4349-82db-bd7c9f1174d5 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:03 devstack sudo[104203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e711b906-935d-4349-82db-bd7c9f1174d5 Sep 28 15:08:03 devstack sudo[104203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:03 devstack sudo[104203]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-28d885e3-e814-451f-8dec-32714ab30ebe tempest-TestInstancesWithCinderVolumes-1943303254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e711b906-935d-4349-82db-bd7c9f1174d5" returned: 0 in 0.431s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:03 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-28d885e3-e814-451f-8dec-32714ab30ebe tempest-TestInstancesWithCinderVolumes-1943303254 None] Lock "cinder-quobyte-e711b906-935d-4349-82db-bd7c9f1174d5" released by "delete_volume" :: held 1.226s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:03 devstack cinder-volume[87116]: WARNING cinder.quota [None req-28d885e3-e814-451f-8dec-32714ab30ebe tempest-TestInstancesWithCinderVolumes-1943303254 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-831420009-89342478 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-831420009-89342478, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:08:03 devstack cinder-volume[87116]: WARNING cinder.quota [None req-28d885e3-e814-451f-8dec-32714ab30ebe tempest-TestInstancesWithCinderVolumes-1943303254 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-831420009-89342478 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-831420009-89342478, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:08:03 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-28d885e3-e814-451f-8dec-32714ab30ebe tempest-TestInstancesWithCinderVolumes-1943303254 None] Created reservations ['36660082-cad1-4802-967d-73cdcdb7d753', '1688cbbc-c120-43b4-9ef7-9f75383d7934', 'ea633cf9-8486-4b21-bf66-e2bf9ce35114', '57b3ba72-a4fb-4886-89ef-797b26414f19'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:08:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-28d885e3-e814-451f-8dec-32714ab30ebe tempest-TestInstancesWithCinderVolumes-1943303254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-28d885e3-e814-451f-8dec-32714ab30ebe tempest-TestInstancesWithCinderVolumes-1943303254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-28d885e3-e814-451f-8dec-32714ab30ebe tempest-TestInstancesWithCinderVolumes-1943303254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-28d885e3-e814-451f-8dec-32714ab30ebe tempest-TestInstancesWithCinderVolumes-1943303254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-28d885e3-e814-451f-8dec-32714ab30ebe tempest-TestInstancesWithCinderVolumes-1943303254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-28d885e3-e814-451f-8dec-32714ab30ebe tempest-TestInstancesWithCinderVolumes-1943303254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:03 devstack sudo[104219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:08:03 devstack sudo[104219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:04 devstack sudo[104219]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-28d885e3-e814-451f-8dec-32714ab30ebe tempest-TestInstancesWithCinderVolumes-1943303254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.370s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:04 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-28d885e3-e814-451f-8dec-32714ab30ebe tempest-TestInstancesWithCinderVolumes-1943303254 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:08:04 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-28d885e3-e814-451f-8dec-32714ab30ebe tempest-TestInstancesWithCinderVolumes-1943303254 None] Deleted volume successfully. Sep 28 15:08:04 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-28d885e3-e814-451f-8dec-32714ab30ebe tempest-TestInstancesWithCinderVolumes-1943303254 None] Lock "cinder-e711b906-935d-4349-82db-bd7c9f1174d5-delete_volume" released by "delete_volume" :: held 2.090s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:08 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-e4fc4097-be2c-4446-8133-d5e336d097de req-1d3628ae-7ec3-4740-96ee-140f45634902 tempest-TestInstancesWithCinderVolumes-1943303254 None] Terminate volume connection completed successfully. Sep 28 15:08:08 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-e4fc4097-be2c-4446-8133-d5e336d097de req-1d3628ae-7ec3-4740-96ee-140f45634902 tempest-TestInstancesWithCinderVolumes-1943303254 None] Deleting attachment c9f44f06-644a-463e-b1b7-0fed78bae144. {{(pid=87116) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:08:09 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-31933794-848c-4779-ab12-7853e47fdff7 tempest-TestInstancesWithCinderVolumes-1943303254 None] Acquiring lock "cinder-759e692f-1fd3-48ed-95f0-3f0738919a73-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:09 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-31933794-848c-4779-ab12-7853e47fdff7 tempest-TestInstancesWithCinderVolumes-1943303254 None] Lock "cinder-759e692f-1fd3-48ed-95f0-3f0738919a73-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:09 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-31933794-848c-4779-ab12-7853e47fdff7 tempest-TestInstancesWithCinderVolumes-1943303254 None] Acquiring lock "cinder-quobyte-759e692f-1fd3-48ed-95f0-3f0738919a73" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:09 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-31933794-848c-4779-ab12-7853e47fdff7 tempest-TestInstancesWithCinderVolumes-1943303254 None] Lock "cinder-quobyte-759e692f-1fd3-48ed-95f0-3f0738919a73" acquired by "delete_volume" :: waited 0.024s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:09 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95b355b-e75a-4ab9-9926-766b96dfb447]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-31933794-848c-4779-ab12-7853e47fdff7 tempest-TestInstancesWithCinderVolumes-1943303254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-759e692f-1fd3-48ed-95f0-3f0738919a73 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:09 devstack sudo[104261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-759e692f-1fd3-48ed-95f0-3f0738919a73 Sep 28 15:08:09 devstack sudo[104261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:10 devstack sudo[104261]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-31933794-848c-4779-ab12-7853e47fdff7 tempest-TestInstancesWithCinderVolumes-1943303254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-759e692f-1fd3-48ed-95f0-3f0738919a73" returned: 0 in 0.411s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-31933794-848c-4779-ab12-7853e47fdff7 tempest-TestInstancesWithCinderVolumes-1943303254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-759e692f-1fd3-48ed-95f0-3f0738919a73 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:10 devstack sudo[104266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-759e692f-1fd3-48ed-95f0-3f0738919a73 Sep 28 15:08:10 devstack sudo[104266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:10 devstack sudo[104266]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-31933794-848c-4779-ab12-7853e47fdff7 tempest-TestInstancesWithCinderVolumes-1943303254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-759e692f-1fd3-48ed-95f0-3f0738919a73" returned: 0 in 0.278s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:10 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-31933794-848c-4779-ab12-7853e47fdff7 tempest-TestInstancesWithCinderVolumes-1943303254 None] Lock "cinder-quobyte-759e692f-1fd3-48ed-95f0-3f0738919a73" released by "delete_volume" :: held 0.738s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:10 devstack cinder-volume[87116]: WARNING cinder.quota [None req-31933794-848c-4779-ab12-7853e47fdff7 tempest-TestInstancesWithCinderVolumes-1943303254 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-386745929-1381089415 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-386745929-1381089415, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:08:10 devstack cinder-volume[87116]: WARNING cinder.quota [None req-31933794-848c-4779-ab12-7853e47fdff7 tempest-TestInstancesWithCinderVolumes-1943303254 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-386745929-1381089415 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-386745929-1381089415, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:08:10 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-31933794-848c-4779-ab12-7853e47fdff7 tempest-TestInstancesWithCinderVolumes-1943303254 None] Created reservations ['40b43848-ffa0-4cd8-b3d7-29eebb936c6a', 'b0273aa4-9df1-43cb-877d-1696c241022b', '8262dc13-f35a-42dd-84b7-f784f0838ba3', 'd7fdc98c-82c6-4e2f-a349-3330e6bf24cc'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:08:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-31933794-848c-4779-ab12-7853e47fdff7 tempest-TestInstancesWithCinderVolumes-1943303254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-31933794-848c-4779-ab12-7853e47fdff7 tempest-TestInstancesWithCinderVolumes-1943303254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:10 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-31933794-848c-4779-ab12-7853e47fdff7 tempest-TestInstancesWithCinderVolumes-1943303254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:10 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-31933794-848c-4779-ab12-7853e47fdff7 tempest-TestInstancesWithCinderVolumes-1943303254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-31933794-848c-4779-ab12-7853e47fdff7 tempest-TestInstancesWithCinderVolumes-1943303254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-31933794-848c-4779-ab12-7853e47fdff7 tempest-TestInstancesWithCinderVolumes-1943303254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:10 devstack sudo[104269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:08:10 devstack sudo[104269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:10 devstack sudo[104269]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-31933794-848c-4779-ab12-7853e47fdff7 tempest-TestInstancesWithCinderVolumes-1943303254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.292s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:10 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-31933794-848c-4779-ab12-7853e47fdff7 tempest-TestInstancesWithCinderVolumes-1943303254 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:08:10 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-31933794-848c-4779-ab12-7853e47fdff7 tempest-TestInstancesWithCinderVolumes-1943303254 None] Deleted volume successfully. Sep 28 15:08:10 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-31933794-848c-4779-ab12-7853e47fdff7 tempest-TestInstancesWithCinderVolumes-1943303254 None] Lock "cinder-759e692f-1fd3-48ed-95f0-3f0738919a73-delete_volume" released by "delete_volume" :: held 1.295s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:17 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:08:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:17 devstack sudo[104286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:08:17 devstack sudo[104286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:17 devstack sudo[104286]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.595s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:17 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:08:17 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running periodic task VolumeManager._thread_info {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:08:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] thread count: 28 {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:08:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] thread info: [<_MainThread(MainThread, started 135146735652992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:08:19 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-fbf90668-659d-4a15-b2fc-c06ff315d1cb req-b03087c9-3b8c-4424-8cf8-32cb8b58b27d tempest-TestShelveInstance-1773918598 None] Terminate volume connection completed successfully. Sep 28 15:08:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-fbf90668-659d-4a15-b2fc-c06ff315d1cb req-b03087c9-3b8c-4424-8cf8-32cb8b58b27d tempest-TestShelveInstance-1773918598 None] Deleting attachment ab2e60f7-7d21-4b3d-abc6-54797a276103. {{(pid=87116) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:08:19 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-fbf90668-659d-4a15-b2fc-c06ff315d1cb req-1db91041-37c5-4be9-9f85-be695d5e8ac2 tempest-TestShelveInstance-1773918598 None] Acquiring lock "cinder-51fb72b4-5c6e-490a-b927-601d0d92380f-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:19 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-fbf90668-659d-4a15-b2fc-c06ff315d1cb req-1db91041-37c5-4be9-9f85-be695d5e8ac2 tempest-TestShelveInstance-1773918598 None] Lock "cinder-51fb72b4-5c6e-490a-b927-601d0d92380f-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:19 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-fbf90668-659d-4a15-b2fc-c06ff315d1cb req-1db91041-37c5-4be9-9f85-be695d5e8ac2 tempest-TestShelveInstance-1773918598 None] Acquiring lock "cinder-quobyte-51fb72b4-5c6e-490a-b927-601d0d92380f" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:19 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-fbf90668-659d-4a15-b2fc-c06ff315d1cb req-1db91041-37c5-4be9-9f85-be695d5e8ac2 tempest-TestShelveInstance-1773918598 None] Lock "cinder-quobyte-51fb72b4-5c6e-490a-b927-601d0d92380f" acquired by "delete_volume" :: waited 0.021s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:19 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c93e52-90d5-4248-b88f-aab4aac4cb9a]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-fbf90668-659d-4a15-b2fc-c06ff315d1cb req-1db91041-37c5-4be9-9f85-be695d5e8ac2 tempest-TestShelveInstance-1773918598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-51fb72b4-5c6e-490a-b927-601d0d92380f {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:19 devstack sudo[104330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-51fb72b4-5c6e-490a-b927-601d0d92380f Sep 28 15:08:19 devstack sudo[104330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:19 devstack sudo[104330]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-fbf90668-659d-4a15-b2fc-c06ff315d1cb req-1db91041-37c5-4be9-9f85-be695d5e8ac2 tempest-TestShelveInstance-1773918598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-51fb72b4-5c6e-490a-b927-601d0d92380f" returned: 0 in 0.522s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-fbf90668-659d-4a15-b2fc-c06ff315d1cb req-1db91041-37c5-4be9-9f85-be695d5e8ac2 tempest-TestShelveInstance-1773918598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-51fb72b4-5c6e-490a-b927-601d0d92380f {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:20 devstack sudo[104346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-51fb72b4-5c6e-490a-b927-601d0d92380f Sep 28 15:08:20 devstack sudo[104346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:20 devstack sudo[104346]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-fbf90668-659d-4a15-b2fc-c06ff315d1cb req-1db91041-37c5-4be9-9f85-be695d5e8ac2 tempest-TestShelveInstance-1773918598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-51fb72b4-5c6e-490a-b927-601d0d92380f" returned: 0 in 0.430s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:20 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-fbf90668-659d-4a15-b2fc-c06ff315d1cb req-1db91041-37c5-4be9-9f85-be695d5e8ac2 tempest-TestShelveInstance-1773918598 None] Lock "cinder-quobyte-51fb72b4-5c6e-490a-b927-601d0d92380f" released by "delete_volume" :: held 1.034s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:20 devstack cinder-volume[87116]: DEBUG cinder.quota [req-fbf90668-659d-4a15-b2fc-c06ff315d1cb req-1db91041-37c5-4be9-9f85-be695d5e8ac2 tempest-TestShelveInstance-1773918598 None] Created reservations ['b987ed06-dbf1-4914-af1f-8c62fc52eca4', 'fb5515ea-7c91-4274-9007-31501ce02043', '35265dd1-a61d-42cc-ad4e-8a8bd98a3a15', '119e3479-9e9a-4c50-8552-5be4271ff44e'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:08:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-fbf90668-659d-4a15-b2fc-c06ff315d1cb req-1db91041-37c5-4be9-9f85-be695d5e8ac2 tempest-TestShelveInstance-1773918598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-fbf90668-659d-4a15-b2fc-c06ff315d1cb req-1db91041-37c5-4be9-9f85-be695d5e8ac2 tempest-TestShelveInstance-1773918598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:20 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [req-fbf90668-659d-4a15-b2fc-c06ff315d1cb req-1db91041-37c5-4be9-9f85-be695d5e8ac2 tempest-TestShelveInstance-1773918598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:20 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [req-fbf90668-659d-4a15-b2fc-c06ff315d1cb req-1db91041-37c5-4be9-9f85-be695d5e8ac2 tempest-TestShelveInstance-1773918598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-fbf90668-659d-4a15-b2fc-c06ff315d1cb req-1db91041-37c5-4be9-9f85-be695d5e8ac2 tempest-TestShelveInstance-1773918598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-fbf90668-659d-4a15-b2fc-c06ff315d1cb req-1db91041-37c5-4be9-9f85-be695d5e8ac2 tempest-TestShelveInstance-1773918598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:20 devstack sudo[104365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:08:20 devstack sudo[104365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:21 devstack sudo[104365]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-fbf90668-659d-4a15-b2fc-c06ff315d1cb req-1db91041-37c5-4be9-9f85-be695d5e8ac2 tempest-TestShelveInstance-1773918598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.400s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:21 devstack cinder-volume[87116]: DEBUG cinder.manager [req-fbf90668-659d-4a15-b2fc-c06ff315d1cb req-1db91041-37c5-4be9-9f85-be695d5e8ac2 tempest-TestShelveInstance-1773918598 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:08:21 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-fbf90668-659d-4a15-b2fc-c06ff315d1cb req-1db91041-37c5-4be9-9f85-be695d5e8ac2 tempest-TestShelveInstance-1773918598 None] Deleted volume successfully. Sep 28 15:08:21 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-fbf90668-659d-4a15-b2fc-c06ff315d1cb req-1db91041-37c5-4be9-9f85-be695d5e8ac2 tempest-TestShelveInstance-1773918598 None] Lock "cinder-51fb72b4-5c6e-490a-b927-601d0d92380f-delete_volume" released by "delete_volume" :: held 1.821s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:29 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=52,cinder:UPDATE=42,cinder:DELETE=3,cinder:INSERT=6 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:08:29 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=56,cinder:UPDATE=42,cinder:INSERT=11,cinder:DELETE=2 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:08:29 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-aefc3e02-74dc-472b-b345-d61bd30eb808 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:08:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-aefc3e02-74dc-472b-b345-d61bd30eb808 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Flow 'volume_create_manager' (3eb32643-89e4-466b-a82a-85ecbd1a325b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-aefc3e02-74dc-472b-b345-d61bd30eb808 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40a6390d-4083-4091-8452-73a6a4a9712c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-aefc3e02-74dc-472b-b345-d61bd30eb808 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40a6390d-4083-4091-8452-73a6a4a9712c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1164029267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c6a82cf-7b38-45bf-a72d-a3e04dd9c7e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f4c243665d94cc29cf3dfbc9f0d9797',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:29Z,use_quota=True,user_id='f186107d083045b49afd3573cf6c9bd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-aefc3e02-74dc-472b-b345-d61bd30eb808 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d461c0be-ae44-4666-83a3-0cd9ad2deb56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-aefc3e02-74dc-472b-b345-d61bd30eb808 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d461c0be-ae44-4666-83a3-0cd9ad2deb56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-aefc3e02-74dc-472b-b345-d61bd30eb808 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eb202d6-6e9a-4dd5-bf29-741fffd57695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-aefc3e02-74dc-472b-b345-d61bd30eb808 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eb202d6-6e9a-4dd5-bf29-741fffd57695) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c6a82cf-7b38-45bf-a72d-a3e04dd9c7e4', 'volume_name': 'volume-8c6a82cf-7b38-45bf-a72d-a3e04dd9c7e4', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-aefc3e02-74dc-472b-b345-d61bd30eb808 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1c75f15-d239-446d-bfdc-52791f76d558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-aefc3e02-74dc-472b-b345-d61bd30eb808 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1c75f15-d239-446d-bfdc-52791f76d558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-aefc3e02-74dc-472b-b345-d61bd30eb808 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc360786-01ab-4a62-89c5-d3d541f46b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:29 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-aefc3e02-74dc-472b-b345-d61bd30eb808 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Volume 8c6a82cf-7b38-45bf-a72d-a3e04dd9c7e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c6a82cf-7b38-45bf-a72d-a3e04dd9c7e4', 'volume_size': 1} Sep 28 15:08:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-aefc3e02-74dc-472b-b345-d61bd30eb808 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-aefc3e02-74dc-472b-b345-d61bd30eb808 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:29 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-aefc3e02-74dc-472b-b345-d61bd30eb808 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1164029267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c6a82cf-7b38-45bf-a72d-a3e04dd9c7e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f4c243665d94cc29cf3dfbc9f0d9797',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:29Z,use_quota=True,user_id='f186107d083045b49afd3573cf6c9bd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:08:29 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-aefc3e02-74dc-472b-b345-d61bd30eb808 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Creating volume 8c6a82cf-7b38-45bf-a72d-a3e04dd9c7e4 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:08:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-aefc3e02-74dc-472b-b345-d61bd30eb808 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-aefc3e02-74dc-472b-b345-d61bd30eb808 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:29 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-aefc3e02-74dc-472b-b345-d61bd30eb808 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:29 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-aefc3e02-74dc-472b-b345-d61bd30eb808 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-aefc3e02-74dc-472b-b345-d61bd30eb808 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:29 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-aefc3e02-74dc-472b-b345-d61bd30eb808 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:08:29 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-aefc3e02-74dc-472b-b345-d61bd30eb808 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:08:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-aefc3e02-74dc-472b-b345-d61bd30eb808 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8c6a82cf-7b38-45bf-a72d-a3e04dd9c7e4 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:29 devstack sudo[104376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8c6a82cf-7b38-45bf-a72d-a3e04dd9c7e4 1073741824 Sep 28 15:08:29 devstack sudo[104376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:30 devstack sudo[104376]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-aefc3e02-74dc-472b-b345-d61bd30eb808 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8c6a82cf-7b38-45bf-a72d-a3e04dd9c7e4 1073741824" returned: 0 in 0.655s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-aefc3e02-74dc-472b-b345-d61bd30eb808 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8c6a82cf-7b38-45bf-a72d-a3e04dd9c7e4 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:30 devstack sudo[104383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8c6a82cf-7b38-45bf-a72d-a3e04dd9c7e4 Sep 28 15:08:30 devstack sudo[104383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:30 devstack sudo[104383]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-aefc3e02-74dc-472b-b345-d61bd30eb808 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8c6a82cf-7b38-45bf-a72d-a3e04dd9c7e4" returned: 0 in 0.368s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-aefc3e02-74dc-472b-b345-d61bd30eb808 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:08:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-aefc3e02-74dc-472b-b345-d61bd30eb808 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-aefc3e02-74dc-472b-b345-d61bd30eb808 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc360786-01ab-4a62-89c5-d3d541f46b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c6a82cf-7b38-45bf-a72d-a3e04dd9c7e4', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-aefc3e02-74dc-472b-b345-d61bd30eb808 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9a4f278-32ef-49c0-9ce1-b5d1d52dc70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:30 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-aefc3e02-74dc-472b-b345-d61bd30eb808 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Volume volume-8c6a82cf-7b38-45bf-a72d-a3e04dd9c7e4 (8c6a82cf-7b38-45bf-a72d-a3e04dd9c7e4): created successfully Sep 28 15:08:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-aefc3e02-74dc-472b-b345-d61bd30eb808 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9a4f278-32ef-49c0-9ce1-b5d1d52dc70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-aefc3e02-74dc-472b-b345-d61bd30eb808 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Flow 'volume_create_manager' (3eb32643-89e4-466b-a82a-85ecbd1a325b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:30 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-aefc3e02-74dc-472b-b345-d61bd30eb808 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Created volume successfully. Sep 28 15:08:32 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d008673-233d-4873-bb2c-2be259942e94 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:08:32 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9d008673-233d-4873-bb2c-2be259942e94 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Flow 'volume_create_manager' (3f13eb04-cf0c-4062-b240-ff65e327125c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:32 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9d008673-233d-4873-bb2c-2be259942e94 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4feab24-2624-46b1-a279-24f6647cd59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:32 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9d008673-233d-4873-bb2c-2be259942e94 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4feab24-2624-46b1-a279-24f6647cd59f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-476617194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13e25b9a-c561-4335-909c-8cbea6403924,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f4c243665d94cc29cf3dfbc9f0d9797',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:32Z,use_quota=True,user_id='f186107d083045b49afd3573cf6c9bd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:32 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9d008673-233d-4873-bb2c-2be259942e94 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42ab15c1-76c0-49c8-ac89-9f646ab0666d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:32 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9d008673-233d-4873-bb2c-2be259942e94 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42ab15c1-76c0-49c8-ac89-9f646ab0666d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:32 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9d008673-233d-4873-bb2c-2be259942e94 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b023fcc-7282-4bda-a21c-b6940769f681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:32 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9d008673-233d-4873-bb2c-2be259942e94 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b023fcc-7282-4bda-a21c-b6940769f681) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13e25b9a-c561-4335-909c-8cbea6403924', 'volume_name': 'volume-13e25b9a-c561-4335-909c-8cbea6403924', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:32 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9d008673-233d-4873-bb2c-2be259942e94 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86e7ae98-2445-4f9b-b449-8ec132abf9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:32 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9d008673-233d-4873-bb2c-2be259942e94 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86e7ae98-2445-4f9b-b449-8ec132abf9a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:32 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9d008673-233d-4873-bb2c-2be259942e94 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcb0b508-442e-4a69-b8d8-2e1c96c8661e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:32 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-9d008673-233d-4873-bb2c-2be259942e94 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Volume 13e25b9a-c561-4335-909c-8cbea6403924: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13e25b9a-c561-4335-909c-8cbea6403924', 'volume_size': 1} Sep 28 15:08:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9d008673-233d-4873-bb2c-2be259942e94 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9d008673-233d-4873-bb2c-2be259942e94 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:32 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9d008673-233d-4873-bb2c-2be259942e94 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-476617194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13e25b9a-c561-4335-909c-8cbea6403924,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f4c243665d94cc29cf3dfbc9f0d9797',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:32Z,use_quota=True,user_id='f186107d083045b49afd3573cf6c9bd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:08:32 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-9d008673-233d-4873-bb2c-2be259942e94 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Creating volume 13e25b9a-c561-4335-909c-8cbea6403924 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:08:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9d008673-233d-4873-bb2c-2be259942e94 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9d008673-233d-4873-bb2c-2be259942e94 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:32 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9d008673-233d-4873-bb2c-2be259942e94 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:32 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9d008673-233d-4873-bb2c-2be259942e94 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9d008673-233d-4873-bb2c-2be259942e94 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:32 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9d008673-233d-4873-bb2c-2be259942e94 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:08:32 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-9d008673-233d-4873-bb2c-2be259942e94 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:08:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9d008673-233d-4873-bb2c-2be259942e94 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-13e25b9a-c561-4335-909c-8cbea6403924 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:32 devstack sudo[104389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-13e25b9a-c561-4335-909c-8cbea6403924 1073741824 Sep 28 15:08:32 devstack sudo[104389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:33 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-34e09f98-fc7b-46e4-87cc-c2cbe55da57c tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:08:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-34e09f98-fc7b-46e4-87cc-c2cbe55da57c tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Flow 'volume_create_manager' (167ee3de-89d6-4237-9c18-aa35b9a979fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-34e09f98-fc7b-46e4-87cc-c2cbe55da57c tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8218ec0-d24d-47a6-a937-f0b5c985db74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-34e09f98-fc7b-46e4-87cc-c2cbe55da57c tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8218ec0-d24d-47a6-a937-f0b5c985db74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-843019729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfef2722-763c-494d-acca-b9f3726a98fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f4c243665d94cc29cf3dfbc9f0d9797',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:33Z,use_quota=True,user_id='f186107d083045b49afd3573cf6c9bd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-34e09f98-fc7b-46e4-87cc-c2cbe55da57c tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bff9597-cf23-458e-a817-4918fa3dc1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-34e09f98-fc7b-46e4-87cc-c2cbe55da57c tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bff9597-cf23-458e-a817-4918fa3dc1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-34e09f98-fc7b-46e4-87cc-c2cbe55da57c tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1663ca1d-cf85-4d15-91c5-42d65eaf33e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-34e09f98-fc7b-46e4-87cc-c2cbe55da57c tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1663ca1d-cf85-4d15-91c5-42d65eaf33e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfef2722-763c-494d-acca-b9f3726a98fa', 'volume_name': 'volume-cfef2722-763c-494d-acca-b9f3726a98fa', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-34e09f98-fc7b-46e4-87cc-c2cbe55da57c tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2accfa5e-36d8-452f-aca8-027defcb76b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-34e09f98-fc7b-46e4-87cc-c2cbe55da57c tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2accfa5e-36d8-452f-aca8-027defcb76b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-34e09f98-fc7b-46e4-87cc-c2cbe55da57c tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d4c91d7-de7e-4b50-8e54-3fc741b6b9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:33 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-34e09f98-fc7b-46e4-87cc-c2cbe55da57c tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Volume cfef2722-763c-494d-acca-b9f3726a98fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfef2722-763c-494d-acca-b9f3726a98fa', 'volume_size': 1} Sep 28 15:08:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-34e09f98-fc7b-46e4-87cc-c2cbe55da57c tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:33 devstack sudo[104389]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9d008673-233d-4873-bb2c-2be259942e94 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-13e25b9a-c561-4335-909c-8cbea6403924 1073741824" returned: 0 in 0.921s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9d008673-233d-4873-bb2c-2be259942e94 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-13e25b9a-c561-4335-909c-8cbea6403924 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:33 devstack sudo[104401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-13e25b9a-c561-4335-909c-8cbea6403924 Sep 28 15:08:33 devstack sudo[104401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:33 devstack sudo[104401]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9d008673-233d-4873-bb2c-2be259942e94 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-13e25b9a-c561-4335-909c-8cbea6403924" returned: 0 in 0.522s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:33 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9d008673-233d-4873-bb2c-2be259942e94 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] <== create_volume: return (1508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:08:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9d008673-233d-4873-bb2c-2be259942e94 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.518s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-34e09f98-fc7b-46e4-87cc-c2cbe55da57c tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.665s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:33 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-34e09f98-fc7b-46e4-87cc-c2cbe55da57c tempest-CreateVolumesFromSourceVolumeTest-876782771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-843019729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfef2722-763c-494d-acca-b9f3726a98fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f4c243665d94cc29cf3dfbc9f0d9797',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:33Z,use_quota=True,user_id='f186107d083045b49afd3573cf6c9bd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:08:33 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-34e09f98-fc7b-46e4-87cc-c2cbe55da57c tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Creating volume cfef2722-763c-494d-acca-b9f3726a98fa {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:08:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-34e09f98-fc7b-46e4-87cc-c2cbe55da57c tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-34e09f98-fc7b-46e4-87cc-c2cbe55da57c tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:33 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-34e09f98-fc7b-46e4-87cc-c2cbe55da57c tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:33 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-34e09f98-fc7b-46e4-87cc-c2cbe55da57c tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-34e09f98-fc7b-46e4-87cc-c2cbe55da57c tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:33 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-34e09f98-fc7b-46e4-87cc-c2cbe55da57c tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:08:33 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-34e09f98-fc7b-46e4-87cc-c2cbe55da57c tempest-CreateVolumesFromSourceVolumeTest-876782771 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:08:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-34e09f98-fc7b-46e4-87cc-c2cbe55da57c tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cfef2722-763c-494d-acca-b9f3726a98fa 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:33 devstack sudo[104404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cfef2722-763c-494d-acca-b9f3726a98fa 1073741824 Sep 28 15:08:33 devstack sudo[104404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9d008673-233d-4873-bb2c-2be259942e94 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcb0b508-442e-4a69-b8d8-2e1c96c8661e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13e25b9a-c561-4335-909c-8cbea6403924', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:34 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9d008673-233d-4873-bb2c-2be259942e94 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f22856d-aa02-412e-9b9a-ed3548ba0b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:34 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec4f34f0-4ea5-412c-ad33-f0ad35515d91 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:08:34 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ec4f34f0-4ea5-412c-ad33-f0ad35515d91 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Flow 'volume_create_manager' (09bf2c65-2ab4-4af5-9a2c-6467623a59bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:34 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ec4f34f0-4ea5-412c-ad33-f0ad35515d91 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c20c55ea-6040-40d9-9fb7-7e1691f1296f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:34 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ec4f34f0-4ea5-412c-ad33-f0ad35515d91 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c20c55ea-6040-40d9-9fb7-7e1691f1296f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-531136449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a90a6f41-2bdc-48ec-95ed-187b1c37610a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f4c243665d94cc29cf3dfbc9f0d9797',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:34Z,use_quota=True,user_id='f186107d083045b49afd3573cf6c9bd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:34 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ec4f34f0-4ea5-412c-ad33-f0ad35515d91 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a81422b1-4b53-48e7-b48c-be5a627b044c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:34 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ec4f34f0-4ea5-412c-ad33-f0ad35515d91 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a81422b1-4b53-48e7-b48c-be5a627b044c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:34 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ec4f34f0-4ea5-412c-ad33-f0ad35515d91 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69baf4dc-e67c-49e0-b7cd-6f499d83af91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:34 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ec4f34f0-4ea5-412c-ad33-f0ad35515d91 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69baf4dc-e67c-49e0-b7cd-6f499d83af91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a90a6f41-2bdc-48ec-95ed-187b1c37610a', 'volume_name': 'volume-a90a6f41-2bdc-48ec-95ed-187b1c37610a', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:34 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ec4f34f0-4ea5-412c-ad33-f0ad35515d91 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f68cd730-7b46-400b-954e-789e79d776c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:34 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ec4f34f0-4ea5-412c-ad33-f0ad35515d91 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f68cd730-7b46-400b-954e-789e79d776c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:34 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ec4f34f0-4ea5-412c-ad33-f0ad35515d91 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68bb03ad-a1b5-41f0-8657-59b181596d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:34 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-ec4f34f0-4ea5-412c-ad33-f0ad35515d91 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Volume a90a6f41-2bdc-48ec-95ed-187b1c37610a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a90a6f41-2bdc-48ec-95ed-187b1c37610a', 'volume_size': 1} Sep 28 15:08:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ec4f34f0-4ea5-412c-ad33-f0ad35515d91 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:34 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-9d008673-233d-4873-bb2c-2be259942e94 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Volume volume-13e25b9a-c561-4335-909c-8cbea6403924 (13e25b9a-c561-4335-909c-8cbea6403924): created successfully Sep 28 15:08:34 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9d008673-233d-4873-bb2c-2be259942e94 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f22856d-aa02-412e-9b9a-ed3548ba0b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:34 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9d008673-233d-4873-bb2c-2be259942e94 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Flow 'volume_create_manager' (3f13eb04-cf0c-4062-b240-ff65e327125c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:34 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-9d008673-233d-4873-bb2c-2be259942e94 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Created volume successfully. Sep 28 15:08:34 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-007fa9a7-eb4a-4ddf-b4d7-0925dac5f7bd tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:08:34 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-007fa9a7-eb4a-4ddf-b4d7-0925dac5f7bd tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Flow 'volume_create_manager' (41df90e9-f76a-4e76-837c-12750b37eb58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:34 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-007fa9a7-eb4a-4ddf-b4d7-0925dac5f7bd tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (657462da-7c08-407e-9f1b-36f47f24ee8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:34 devstack sudo[104404]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:34 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-007fa9a7-eb4a-4ddf-b4d7-0925dac5f7bd tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (657462da-7c08-407e-9f1b-36f47f24ee8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1512281989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea6b6d38-5313-425b-b412-74028339ed87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f4c243665d94cc29cf3dfbc9f0d9797',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:35Z,use_quota=True,user_id='f186107d083045b49afd3573cf6c9bd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:34 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-007fa9a7-eb4a-4ddf-b4d7-0925dac5f7bd tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9556bb2-5b2e-4344-acf4-92abc8227cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:34 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-007fa9a7-eb4a-4ddf-b4d7-0925dac5f7bd tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9556bb2-5b2e-4344-acf4-92abc8227cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:34 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-007fa9a7-eb4a-4ddf-b4d7-0925dac5f7bd tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1677ce2-5c73-4998-a95c-a6673d7d7500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:34 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-007fa9a7-eb4a-4ddf-b4d7-0925dac5f7bd tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1677ce2-5c73-4998-a95c-a6673d7d7500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea6b6d38-5313-425b-b412-74028339ed87', 'volume_name': 'volume-ea6b6d38-5313-425b-b412-74028339ed87', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:34 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-007fa9a7-eb4a-4ddf-b4d7-0925dac5f7bd tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eae887d-bd0b-4663-bf6f-5e739b755ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:34 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-007fa9a7-eb4a-4ddf-b4d7-0925dac5f7bd tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eae887d-bd0b-4663-bf6f-5e739b755ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:34 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-007fa9a7-eb4a-4ddf-b4d7-0925dac5f7bd tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52205f7c-dfa6-4bba-9256-f75919e61294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:34 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-007fa9a7-eb4a-4ddf-b4d7-0925dac5f7bd tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Volume ea6b6d38-5313-425b-b412-74028339ed87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea6b6d38-5313-425b-b412-74028339ed87', 'volume_size': 1} Sep 28 15:08:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-007fa9a7-eb4a-4ddf-b4d7-0925dac5f7bd tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-34e09f98-fc7b-46e4-87cc-c2cbe55da57c tempest-CreateVolumesFromSourceVolumeTest-876782771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cfef2722-763c-494d-acca-b9f3726a98fa 1073741824" returned: 0 in 1.072s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-34e09f98-fc7b-46e4-87cc-c2cbe55da57c tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cfef2722-763c-494d-acca-b9f3726a98fa {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:35 devstack sudo[104410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cfef2722-763c-494d-acca-b9f3726a98fa Sep 28 15:08:35 devstack sudo[104410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:35 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-c13204ce-eed9-4afd-8afc-f95ec9cc4b41 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:08:35 devstack sudo[104410]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c13204ce-eed9-4afd-8afc-f95ec9cc4b41 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Flow 'volume_create_manager' (6ef18c50-c898-46fd-bb45-a411cfaac618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c13204ce-eed9-4afd-8afc-f95ec9cc4b41 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a401f4d0-4222-42c6-8b7b-6b780f1e76a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-34e09f98-fc7b-46e4-87cc-c2cbe55da57c tempest-CreateVolumesFromSourceVolumeTest-876782771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cfef2722-763c-494d-acca-b9f3726a98fa" returned: 0 in 0.573s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-34e09f98-fc7b-46e4-87cc-c2cbe55da57c tempest-CreateVolumesFromSourceVolumeTest-876782771 None] <== create_volume: return (1708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:08:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-34e09f98-fc7b-46e4-87cc-c2cbe55da57c tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.712s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ec4f34f0-4ea5-412c-ad33-f0ad35515d91 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.319s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ec4f34f0-4ea5-412c-ad33-f0ad35515d91 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-531136449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a90a6f41-2bdc-48ec-95ed-187b1c37610a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f4c243665d94cc29cf3dfbc9f0d9797',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:34Z,use_quota=True,user_id='f186107d083045b49afd3573cf6c9bd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:08:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-ec4f34f0-4ea5-412c-ad33-f0ad35515d91 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Creating volume a90a6f41-2bdc-48ec-95ed-187b1c37610a {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:08:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ec4f34f0-4ea5-412c-ad33-f0ad35515d91 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ec4f34f0-4ea5-412c-ad33-f0ad35515d91 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ec4f34f0-4ea5-412c-ad33-f0ad35515d91 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ec4f34f0-4ea5-412c-ad33-f0ad35515d91 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ec4f34f0-4ea5-412c-ad33-f0ad35515d91 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ec4f34f0-4ea5-412c-ad33-f0ad35515d91 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:08:35 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-ec4f34f0-4ea5-412c-ad33-f0ad35515d91 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:08:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ec4f34f0-4ea5-412c-ad33-f0ad35515d91 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a90a6f41-2bdc-48ec-95ed-187b1c37610a 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-34e09f98-fc7b-46e4-87cc-c2cbe55da57c tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d4c91d7-de7e-4b50-8e54-3fc741b6b9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfef2722-763c-494d-acca-b9f3726a98fa', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-34e09f98-fc7b-46e4-87cc-c2cbe55da57c tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56699624-3db0-4847-944e-a22433a86369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:35 devstack sudo[104413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a90a6f41-2bdc-48ec-95ed-187b1c37610a 1073741824 Sep 28 15:08:35 devstack sudo[104413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c13204ce-eed9-4afd-8afc-f95ec9cc4b41 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a401f4d0-4222-42c6-8b7b-6b780f1e76a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-157620131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1039a60a-8847-41fd-94cf-327c87743f9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f4c243665d94cc29cf3dfbc9f0d9797',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:35Z,use_quota=True,user_id='f186107d083045b49afd3573cf6c9bd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c13204ce-eed9-4afd-8afc-f95ec9cc4b41 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acbc0f83-41ea-460c-9013-fca9b96da380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c13204ce-eed9-4afd-8afc-f95ec9cc4b41 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acbc0f83-41ea-460c-9013-fca9b96da380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c13204ce-eed9-4afd-8afc-f95ec9cc4b41 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2caf8a2d-63b3-4b06-8593-dba4ca03c58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c13204ce-eed9-4afd-8afc-f95ec9cc4b41 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2caf8a2d-63b3-4b06-8593-dba4ca03c58f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1039a60a-8847-41fd-94cf-327c87743f9a', 'volume_name': 'volume-1039a60a-8847-41fd-94cf-327c87743f9a', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c13204ce-eed9-4afd-8afc-f95ec9cc4b41 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (431edae8-8a00-4997-82ea-442eaab32659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c13204ce-eed9-4afd-8afc-f95ec9cc4b41 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (431edae8-8a00-4997-82ea-442eaab32659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c13204ce-eed9-4afd-8afc-f95ec9cc4b41 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54e2ff3e-5c35-4617-81e2-945eb8cd09a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:35 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-c13204ce-eed9-4afd-8afc-f95ec9cc4b41 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Volume 1039a60a-8847-41fd-94cf-327c87743f9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1039a60a-8847-41fd-94cf-327c87743f9a', 'volume_size': 1} Sep 28 15:08:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c13204ce-eed9-4afd-8afc-f95ec9cc4b41 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:35 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-34e09f98-fc7b-46e4-87cc-c2cbe55da57c tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Volume volume-cfef2722-763c-494d-acca-b9f3726a98fa (cfef2722-763c-494d-acca-b9f3726a98fa): created successfully Sep 28 15:08:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-34e09f98-fc7b-46e4-87cc-c2cbe55da57c tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56699624-3db0-4847-944e-a22433a86369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-34e09f98-fc7b-46e4-87cc-c2cbe55da57c tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Flow 'volume_create_manager' (167ee3de-89d6-4237-9c18-aa35b9a979fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:35 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-34e09f98-fc7b-46e4-87cc-c2cbe55da57c tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Created volume successfully. Sep 28 15:08:36 devstack sudo[104413]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ec4f34f0-4ea5-412c-ad33-f0ad35515d91 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a90a6f41-2bdc-48ec-95ed-187b1c37610a 1073741824" returned: 0 in 0.683s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ec4f34f0-4ea5-412c-ad33-f0ad35515d91 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a90a6f41-2bdc-48ec-95ed-187b1c37610a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:36 devstack sudo[104430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a90a6f41-2bdc-48ec-95ed-187b1c37610a Sep 28 15:08:36 devstack sudo[104430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:36 devstack sudo[104430]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ec4f34f0-4ea5-412c-ad33-f0ad35515d91 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a90a6f41-2bdc-48ec-95ed-187b1c37610a" returned: 0 in 0.521s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:36 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ec4f34f0-4ea5-412c-ad33-f0ad35515d91 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] <== create_volume: return (1291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:08:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ec4f34f0-4ea5-412c-ad33-f0ad35515d91 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.294s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-007fa9a7-eb4a-4ddf-b4d7-0925dac5f7bd tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.945s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:36 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-007fa9a7-eb4a-4ddf-b4d7-0925dac5f7bd tempest-CreateVolumesFromSourceVolumeTest-876782771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1512281989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea6b6d38-5313-425b-b412-74028339ed87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f4c243665d94cc29cf3dfbc9f0d9797',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:35Z,use_quota=True,user_id='f186107d083045b49afd3573cf6c9bd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:08:36 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-007fa9a7-eb4a-4ddf-b4d7-0925dac5f7bd tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Creating volume ea6b6d38-5313-425b-b412-74028339ed87 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:08:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-007fa9a7-eb4a-4ddf-b4d7-0925dac5f7bd tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-007fa9a7-eb4a-4ddf-b4d7-0925dac5f7bd tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:36 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-007fa9a7-eb4a-4ddf-b4d7-0925dac5f7bd tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:36 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-007fa9a7-eb4a-4ddf-b4d7-0925dac5f7bd tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-007fa9a7-eb4a-4ddf-b4d7-0925dac5f7bd tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:36 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-007fa9a7-eb4a-4ddf-b4d7-0925dac5f7bd tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:08:36 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-007fa9a7-eb4a-4ddf-b4d7-0925dac5f7bd tempest-CreateVolumesFromSourceVolumeTest-876782771 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:08:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-007fa9a7-eb4a-4ddf-b4d7-0925dac5f7bd tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ea6b6d38-5313-425b-b412-74028339ed87 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:36 devstack sudo[104464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ea6b6d38-5313-425b-b412-74028339ed87 1073741824 Sep 28 15:08:36 devstack sudo[104464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ec4f34f0-4ea5-412c-ad33-f0ad35515d91 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68bb03ad-a1b5-41f0-8657-59b181596d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a90a6f41-2bdc-48ec-95ed-187b1c37610a', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ec4f34f0-4ea5-412c-ad33-f0ad35515d91 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c3f66d0-2887-41ee-9ba0-44dc4c5379c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:37 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-ec4f34f0-4ea5-412c-ad33-f0ad35515d91 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Volume volume-a90a6f41-2bdc-48ec-95ed-187b1c37610a (a90a6f41-2bdc-48ec-95ed-187b1c37610a): created successfully Sep 28 15:08:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ec4f34f0-4ea5-412c-ad33-f0ad35515d91 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c3f66d0-2887-41ee-9ba0-44dc4c5379c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ec4f34f0-4ea5-412c-ad33-f0ad35515d91 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Flow 'volume_create_manager' (09bf2c65-2ab4-4af5-9a2c-6467623a59bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:37 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-ec4f34f0-4ea5-412c-ad33-f0ad35515d91 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Created volume successfully. Sep 28 15:08:37 devstack sudo[104464]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-007fa9a7-eb4a-4ddf-b4d7-0925dac5f7bd tempest-CreateVolumesFromSourceVolumeTest-876782771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ea6b6d38-5313-425b-b412-74028339ed87 1073741824" returned: 0 in 0.534s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-007fa9a7-eb4a-4ddf-b4d7-0925dac5f7bd tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ea6b6d38-5313-425b-b412-74028339ed87 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:37 devstack sudo[104470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ea6b6d38-5313-425b-b412-74028339ed87 Sep 28 15:08:37 devstack sudo[104470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:37 devstack sudo[104470]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-007fa9a7-eb4a-4ddf-b4d7-0925dac5f7bd tempest-CreateVolumesFromSourceVolumeTest-876782771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ea6b6d38-5313-425b-b412-74028339ed87" returned: 0 in 0.273s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:37 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-007fa9a7-eb4a-4ddf-b4d7-0925dac5f7bd tempest-CreateVolumesFromSourceVolumeTest-876782771 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:08:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-007fa9a7-eb4a-4ddf-b4d7-0925dac5f7bd tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c13204ce-eed9-4afd-8afc-f95ec9cc4b41 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.077s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:37 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c13204ce-eed9-4afd-8afc-f95ec9cc4b41 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-157620131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1039a60a-8847-41fd-94cf-327c87743f9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f4c243665d94cc29cf3dfbc9f0d9797',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:35Z,use_quota=True,user_id='f186107d083045b49afd3573cf6c9bd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:08:37 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-c13204ce-eed9-4afd-8afc-f95ec9cc4b41 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Creating volume 1039a60a-8847-41fd-94cf-327c87743f9a {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:08:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c13204ce-eed9-4afd-8afc-f95ec9cc4b41 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c13204ce-eed9-4afd-8afc-f95ec9cc4b41 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:37 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c13204ce-eed9-4afd-8afc-f95ec9cc4b41 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:37 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c13204ce-eed9-4afd-8afc-f95ec9cc4b41 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c13204ce-eed9-4afd-8afc-f95ec9cc4b41 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:37 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c13204ce-eed9-4afd-8afc-f95ec9cc4b41 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:08:37 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-c13204ce-eed9-4afd-8afc-f95ec9cc4b41 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:08:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c13204ce-eed9-4afd-8afc-f95ec9cc4b41 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1039a60a-8847-41fd-94cf-327c87743f9a 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-007fa9a7-eb4a-4ddf-b4d7-0925dac5f7bd tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52205f7c-dfa6-4bba-9256-f75919e61294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea6b6d38-5313-425b-b412-74028339ed87', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:37 devstack sudo[104473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1039a60a-8847-41fd-94cf-327c87743f9a 1073741824 Sep 28 15:08:37 devstack sudo[104473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-007fa9a7-eb4a-4ddf-b4d7-0925dac5f7bd tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdc84386-34ce-4f91-b925-b1481bcac81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:37 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-007fa9a7-eb4a-4ddf-b4d7-0925dac5f7bd tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Volume volume-ea6b6d38-5313-425b-b412-74028339ed87 (ea6b6d38-5313-425b-b412-74028339ed87): created successfully Sep 28 15:08:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-007fa9a7-eb4a-4ddf-b4d7-0925dac5f7bd tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdc84386-34ce-4f91-b925-b1481bcac81d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-007fa9a7-eb4a-4ddf-b4d7-0925dac5f7bd tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Flow 'volume_create_manager' (41df90e9-f76a-4e76-837c-12750b37eb58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:37 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-007fa9a7-eb4a-4ddf-b4d7-0925dac5f7bd tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Created volume successfully. Sep 28 15:08:38 devstack sudo[104473]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c13204ce-eed9-4afd-8afc-f95ec9cc4b41 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1039a60a-8847-41fd-94cf-327c87743f9a 1073741824" returned: 0 in 0.615s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c13204ce-eed9-4afd-8afc-f95ec9cc4b41 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1039a60a-8847-41fd-94cf-327c87743f9a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:38 devstack sudo[104479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1039a60a-8847-41fd-94cf-327c87743f9a Sep 28 15:08:38 devstack sudo[104479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:38 devstack sudo[104479]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c13204ce-eed9-4afd-8afc-f95ec9cc4b41 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1039a60a-8847-41fd-94cf-327c87743f9a" returned: 0 in 0.314s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:38 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c13204ce-eed9-4afd-8afc-f95ec9cc4b41 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:08:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c13204ce-eed9-4afd-8afc-f95ec9cc4b41 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c13204ce-eed9-4afd-8afc-f95ec9cc4b41 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54e2ff3e-5c35-4617-81e2-945eb8cd09a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1039a60a-8847-41fd-94cf-327c87743f9a', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c13204ce-eed9-4afd-8afc-f95ec9cc4b41 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62733da4-5f09-4a0a-8665-2d283e6c3e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:38 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-c13204ce-eed9-4afd-8afc-f95ec9cc4b41 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Volume volume-1039a60a-8847-41fd-94cf-327c87743f9a (1039a60a-8847-41fd-94cf-327c87743f9a): created successfully Sep 28 15:08:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c13204ce-eed9-4afd-8afc-f95ec9cc4b41 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62733da4-5f09-4a0a-8665-2d283e6c3e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c13204ce-eed9-4afd-8afc-f95ec9cc4b41 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Flow 'volume_create_manager' (6ef18c50-c898-46fd-bb45-a411cfaac618) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:38 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-c13204ce-eed9-4afd-8afc-f95ec9cc4b41 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Created volume successfully. Sep 28 15:08:39 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-631b11d9-6c03-4ad3-aec6-f671bbdbf7e8 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Acquiring lock "cinder-1039a60a-8847-41fd-94cf-327c87743f9a-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:39 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-631b11d9-6c03-4ad3-aec6-f671bbdbf7e8 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Lock "cinder-1039a60a-8847-41fd-94cf-327c87743f9a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:39 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-631b11d9-6c03-4ad3-aec6-f671bbdbf7e8 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Acquiring lock "cinder-quobyte-1039a60a-8847-41fd-94cf-327c87743f9a" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:39 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-631b11d9-6c03-4ad3-aec6-f671bbdbf7e8 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Lock "cinder-quobyte-1039a60a-8847-41fd-94cf-327c87743f9a" acquired by "delete_volume" :: waited 0.018s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:39 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dea0b97-e49a-4387-9788-fa58fd96ca45]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-631b11d9-6c03-4ad3-aec6-f671bbdbf7e8 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1039a60a-8847-41fd-94cf-327c87743f9a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:39 devstack sudo[104482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1039a60a-8847-41fd-94cf-327c87743f9a Sep 28 15:08:39 devstack sudo[104482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:39 devstack sudo[104482]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-631b11d9-6c03-4ad3-aec6-f671bbdbf7e8 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1039a60a-8847-41fd-94cf-327c87743f9a" returned: 0 in 0.451s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-631b11d9-6c03-4ad3-aec6-f671bbdbf7e8 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1039a60a-8847-41fd-94cf-327c87743f9a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:39 devstack sudo[104488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1039a60a-8847-41fd-94cf-327c87743f9a Sep 28 15:08:39 devstack sudo[104488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:40 devstack sudo[104488]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-631b11d9-6c03-4ad3-aec6-f671bbdbf7e8 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1039a60a-8847-41fd-94cf-327c87743f9a" returned: 0 in 0.317s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:40 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-631b11d9-6c03-4ad3-aec6-f671bbdbf7e8 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Lock "cinder-quobyte-1039a60a-8847-41fd-94cf-327c87743f9a" released by "delete_volume" :: held 0.822s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:40 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-631b11d9-6c03-4ad3-aec6-f671bbdbf7e8 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Created reservations ['61f27ae9-22f5-4b17-bc38-4979a9c4c8a1', '75ac29d9-6839-4dde-8acb-936a223f9ffa', 'c5bc86ce-e00d-4dbe-bcac-667fc82b967c', 'dd7dcca6-47a5-481d-b409-b955d4ad6478'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:08:40 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b661686-157b-43bb-a9e2-62d6188d0ef1 tempest-CreateVolumesFromImageTest-1417987421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:08:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5b661686-157b-43bb-a9e2-62d6188d0ef1 tempest-CreateVolumesFromImageTest-1417987421 None] Flow 'volume_create_manager' (215bc8bd-a515-49d2-b79e-baf38fa33f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5b661686-157b-43bb-a9e2-62d6188d0ef1 tempest-CreateVolumesFromImageTest-1417987421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f7f709c-656a-44f8-af51-aed21cf59dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5b661686-157b-43bb-a9e2-62d6188d0ef1 tempest-CreateVolumesFromImageTest-1417987421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f7f709c-656a-44f8-af51-aed21cf59dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-34692752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5b2919f-d1e6-426a-b0d2-671aded91a31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7c700de903e48c3ad0332374d8bbc29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:40Z,use_quota=True,user_id='e48c335cfd9e482085a690a223f288da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5b661686-157b-43bb-a9e2-62d6188d0ef1 tempest-CreateVolumesFromImageTest-1417987421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6512f42a-3595-478b-a10b-538f09a61816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5b661686-157b-43bb-a9e2-62d6188d0ef1 tempest-CreateVolumesFromImageTest-1417987421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6512f42a-3595-478b-a10b-538f09a61816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5b661686-157b-43bb-a9e2-62d6188d0ef1 tempest-CreateVolumesFromImageTest-1417987421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (797600b2-0269-4923-ab6c-660f331def23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5b661686-157b-43bb-a9e2-62d6188d0ef1 tempest-CreateVolumesFromImageTest-1417987421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (797600b2-0269-4923-ab6c-660f331def23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5b2919f-d1e6-426a-b0d2-671aded91a31', 'volume_name': 'volume-f5b2919f-d1e6-426a-b0d2-671aded91a31', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5b661686-157b-43bb-a9e2-62d6188d0ef1 tempest-CreateVolumesFromImageTest-1417987421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08100ecd-8452-430f-8dbf-826cd109ff04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5b661686-157b-43bb-a9e2-62d6188d0ef1 tempest-CreateVolumesFromImageTest-1417987421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08100ecd-8452-430f-8dbf-826cd109ff04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5b661686-157b-43bb-a9e2-62d6188d0ef1 tempest-CreateVolumesFromImageTest-1417987421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d2d2ed7-5d5b-4303-8c21-445a6f14e0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:40 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-5b661686-157b-43bb-a9e2-62d6188d0ef1 tempest-CreateVolumesFromImageTest-1417987421 None] Volume f5b2919f-d1e6-426a-b0d2-671aded91a31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5b2919f-d1e6-426a-b0d2-671aded91a31', 'volume_size': 1} Sep 28 15:08:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5b661686-157b-43bb-a9e2-62d6188d0ef1 tempest-CreateVolumesFromImageTest-1417987421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5b661686-157b-43bb-a9e2-62d6188d0ef1 tempest-CreateVolumesFromImageTest-1417987421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:40 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5b661686-157b-43bb-a9e2-62d6188d0ef1 tempest-CreateVolumesFromImageTest-1417987421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-34692752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5b2919f-d1e6-426a-b0d2-671aded91a31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7c700de903e48c3ad0332374d8bbc29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:40Z,use_quota=True,user_id='e48c335cfd9e482085a690a223f288da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:08:40 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-5b661686-157b-43bb-a9e2-62d6188d0ef1 tempest-CreateVolumesFromImageTest-1417987421 None] Creating volume f5b2919f-d1e6-426a-b0d2-671aded91a31 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:08:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5b661686-157b-43bb-a9e2-62d6188d0ef1 tempest-CreateVolumesFromImageTest-1417987421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5b661686-157b-43bb-a9e2-62d6188d0ef1 tempest-CreateVolumesFromImageTest-1417987421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:40 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5b661686-157b-43bb-a9e2-62d6188d0ef1 tempest-CreateVolumesFromImageTest-1417987421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:40 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5b661686-157b-43bb-a9e2-62d6188d0ef1 tempest-CreateVolumesFromImageTest-1417987421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5b661686-157b-43bb-a9e2-62d6188d0ef1 tempest-CreateVolumesFromImageTest-1417987421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:40 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5b661686-157b-43bb-a9e2-62d6188d0ef1 tempest-CreateVolumesFromImageTest-1417987421 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:08:40 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-5b661686-157b-43bb-a9e2-62d6188d0ef1 tempest-CreateVolumesFromImageTest-1417987421 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:08:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5b661686-157b-43bb-a9e2-62d6188d0ef1 tempest-CreateVolumesFromImageTest-1417987421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f5b2919f-d1e6-426a-b0d2-671aded91a31 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:40 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2c05119b-77a7-48e3-a7bd-d7e382a44aaa tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Acquiring lock "cinder-ea6b6d38-5313-425b-b412-74028339ed87-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:40 devstack sudo[104492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f5b2919f-d1e6-426a-b0d2-671aded91a31 1073741824 Sep 28 15:08:40 devstack sudo[104492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:40 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2c05119b-77a7-48e3-a7bd-d7e382a44aaa tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Lock "cinder-ea6b6d38-5313-425b-b412-74028339ed87-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-631b11d9-6c03-4ad3-aec6-f671bbdbf7e8 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-631b11d9-6c03-4ad3-aec6-f671bbdbf7e8 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:40 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-631b11d9-6c03-4ad3-aec6-f671bbdbf7e8 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:40 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-631b11d9-6c03-4ad3-aec6-f671bbdbf7e8 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-631b11d9-6c03-4ad3-aec6-f671bbdbf7e8 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-631b11d9-6c03-4ad3-aec6-f671bbdbf7e8 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:40 devstack sudo[104494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:08:40 devstack sudo[104494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:40 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2c05119b-77a7-48e3-a7bd-d7e382a44aaa tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Acquiring lock "cinder-quobyte-ea6b6d38-5313-425b-b412-74028339ed87" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:40 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2c05119b-77a7-48e3-a7bd-d7e382a44aaa tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Lock "cinder-quobyte-ea6b6d38-5313-425b-b412-74028339ed87" acquired by "delete_volume" :: waited 0.023s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:40 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d53ee84-445d-49e9-bef7-b8c1f5038a17]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2c05119b-77a7-48e3-a7bd-d7e382a44aaa tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ea6b6d38-5313-425b-b412-74028339ed87 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:40 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-e955fbaf-af78-466b-a2c2-7bc59666048d tempest-CreateVolumesFromImageTest-1417987421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:08:40 devstack sudo[104496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ea6b6d38-5313-425b-b412-74028339ed87 Sep 28 15:08:40 devstack sudo[104496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e955fbaf-af78-466b-a2c2-7bc59666048d tempest-CreateVolumesFromImageTest-1417987421 None] Flow 'volume_create_manager' (f46506ce-59bd-4e0d-a195-4d294425bafa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e955fbaf-af78-466b-a2c2-7bc59666048d tempest-CreateVolumesFromImageTest-1417987421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7af6d9a9-41dc-48a5-9289-0e362d1d8b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:40 devstack sudo[104494]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-631b11d9-6c03-4ad3-aec6-f671bbdbf7e8 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.371s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:40 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-631b11d9-6c03-4ad3-aec6-f671bbdbf7e8 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:08:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e955fbaf-af78-466b-a2c2-7bc59666048d tempest-CreateVolumesFromImageTest-1417987421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7af6d9a9-41dc-48a5-9289-0e362d1d8b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-714865066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fdae31d-29a5-4bb5-9cca-16c7c15c5466,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7c700de903e48c3ad0332374d8bbc29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:41Z,use_quota=True,user_id='e48c335cfd9e482085a690a223f288da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e955fbaf-af78-466b-a2c2-7bc59666048d tempest-CreateVolumesFromImageTest-1417987421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28a747a0-44d2-4fa6-9f18-99f93787b22f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e955fbaf-af78-466b-a2c2-7bc59666048d tempest-CreateVolumesFromImageTest-1417987421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28a747a0-44d2-4fa6-9f18-99f93787b22f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e955fbaf-af78-466b-a2c2-7bc59666048d tempest-CreateVolumesFromImageTest-1417987421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32a56295-ea71-4a0f-8f8b-cdcdf71090cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e955fbaf-af78-466b-a2c2-7bc59666048d tempest-CreateVolumesFromImageTest-1417987421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32a56295-ea71-4a0f-8f8b-cdcdf71090cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fdae31d-29a5-4bb5-9cca-16c7c15c5466', 'volume_name': 'volume-2fdae31d-29a5-4bb5-9cca-16c7c15c5466', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e955fbaf-af78-466b-a2c2-7bc59666048d tempest-CreateVolumesFromImageTest-1417987421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89a74cd9-8733-4d21-89bf-d4e644e4cea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e955fbaf-af78-466b-a2c2-7bc59666048d tempest-CreateVolumesFromImageTest-1417987421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89a74cd9-8733-4d21-89bf-d4e644e4cea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e955fbaf-af78-466b-a2c2-7bc59666048d tempest-CreateVolumesFromImageTest-1417987421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adfe1882-e143-4531-b542-a2946f9c45b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:40 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-e955fbaf-af78-466b-a2c2-7bc59666048d tempest-CreateVolumesFromImageTest-1417987421 None] Volume 2fdae31d-29a5-4bb5-9cca-16c7c15c5466: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fdae31d-29a5-4bb5-9cca-16c7c15c5466', 'volume_size': 1} Sep 28 15:08:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e955fbaf-af78-466b-a2c2-7bc59666048d tempest-CreateVolumesFromImageTest-1417987421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:40 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-631b11d9-6c03-4ad3-aec6-f671bbdbf7e8 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Deleted volume successfully. Sep 28 15:08:40 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-631b11d9-6c03-4ad3-aec6-f671bbdbf7e8 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Lock "cinder-1039a60a-8847-41fd-94cf-327c87743f9a-delete_volume" released by "delete_volume" :: held 1.784s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:41 devstack sudo[104492]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5b661686-157b-43bb-a9e2-62d6188d0ef1 tempest-CreateVolumesFromImageTest-1417987421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f5b2919f-d1e6-426a-b0d2-671aded91a31 1073741824" returned: 0 in 0.748s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5b661686-157b-43bb-a9e2-62d6188d0ef1 tempest-CreateVolumesFromImageTest-1417987421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f5b2919f-d1e6-426a-b0d2-671aded91a31 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:41 devstack sudo[104506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f5b2919f-d1e6-426a-b0d2-671aded91a31 Sep 28 15:08:41 devstack sudo[104506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:41 devstack sudo[104496]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2c05119b-77a7-48e3-a7bd-d7e382a44aaa tempest-CreateVolumesFromSourceVolumeTest-876782771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ea6b6d38-5313-425b-b412-74028339ed87" returned: 0 in 0.658s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2c05119b-77a7-48e3-a7bd-d7e382a44aaa tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ea6b6d38-5313-425b-b412-74028339ed87 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:41 devstack sudo[104509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ea6b6d38-5313-425b-b412-74028339ed87 Sep 28 15:08:41 devstack sudo[104509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:41 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7038a81-cb83-426c-89e0-71fbb161bf80 tempest-CreateVolumesFromImageTest-1417987421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:08:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b7038a81-cb83-426c-89e0-71fbb161bf80 tempest-CreateVolumesFromImageTest-1417987421 None] Flow 'volume_create_manager' (ff871969-785e-4846-a40a-18e0131bb530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:41 devstack sudo[104506]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b7038a81-cb83-426c-89e0-71fbb161bf80 tempest-CreateVolumesFromImageTest-1417987421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eb68db4-8a30-4f1d-bfd0-edf3b6045927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5b661686-157b-43bb-a9e2-62d6188d0ef1 tempest-CreateVolumesFromImageTest-1417987421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f5b2919f-d1e6-426a-b0d2-671aded91a31" returned: 0 in 0.375s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:41 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5b661686-157b-43bb-a9e2-62d6188d0ef1 tempest-CreateVolumesFromImageTest-1417987421 None] <== create_volume: return (1188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:08:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5b661686-157b-43bb-a9e2-62d6188d0ef1 tempest-CreateVolumesFromImageTest-1417987421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.196s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e955fbaf-af78-466b-a2c2-7bc59666048d tempest-CreateVolumesFromImageTest-1417987421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.581s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:41 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e955fbaf-af78-466b-a2c2-7bc59666048d tempest-CreateVolumesFromImageTest-1417987421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-714865066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fdae31d-29a5-4bb5-9cca-16c7c15c5466,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7c700de903e48c3ad0332374d8bbc29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:41Z,use_quota=True,user_id='e48c335cfd9e482085a690a223f288da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:08:41 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-e955fbaf-af78-466b-a2c2-7bc59666048d tempest-CreateVolumesFromImageTest-1417987421 None] Creating volume 2fdae31d-29a5-4bb5-9cca-16c7c15c5466 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:08:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e955fbaf-af78-466b-a2c2-7bc59666048d tempest-CreateVolumesFromImageTest-1417987421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e955fbaf-af78-466b-a2c2-7bc59666048d tempest-CreateVolumesFromImageTest-1417987421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:41 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e955fbaf-af78-466b-a2c2-7bc59666048d tempest-CreateVolumesFromImageTest-1417987421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:41 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e955fbaf-af78-466b-a2c2-7bc59666048d tempest-CreateVolumesFromImageTest-1417987421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e955fbaf-af78-466b-a2c2-7bc59666048d tempest-CreateVolumesFromImageTest-1417987421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:41 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e955fbaf-af78-466b-a2c2-7bc59666048d tempest-CreateVolumesFromImageTest-1417987421 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:08:41 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-e955fbaf-af78-466b-a2c2-7bc59666048d tempest-CreateVolumesFromImageTest-1417987421 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:08:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e955fbaf-af78-466b-a2c2-7bc59666048d tempest-CreateVolumesFromImageTest-1417987421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2fdae31d-29a5-4bb5-9cca-16c7c15c5466 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b7038a81-cb83-426c-89e0-71fbb161bf80 tempest-CreateVolumesFromImageTest-1417987421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eb68db4-8a30-4f1d-bfd0-edf3b6045927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1004526745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1ab656f-be28-4a56-b360-8297c21de2b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7c700de903e48c3ad0332374d8bbc29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:41Z,use_quota=True,user_id='e48c335cfd9e482085a690a223f288da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b7038a81-cb83-426c-89e0-71fbb161bf80 tempest-CreateVolumesFromImageTest-1417987421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bb5e362-f13f-4b50-a526-a32b229d592f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b7038a81-cb83-426c-89e0-71fbb161bf80 tempest-CreateVolumesFromImageTest-1417987421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bb5e362-f13f-4b50-a526-a32b229d592f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b7038a81-cb83-426c-89e0-71fbb161bf80 tempest-CreateVolumesFromImageTest-1417987421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (991a2dec-8732-4a62-8c1c-f2dab8635a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:41 devstack sudo[104512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2fdae31d-29a5-4bb5-9cca-16c7c15c5466 1073741824 Sep 28 15:08:41 devstack sudo[104512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b7038a81-cb83-426c-89e0-71fbb161bf80 tempest-CreateVolumesFromImageTest-1417987421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (991a2dec-8732-4a62-8c1c-f2dab8635a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1ab656f-be28-4a56-b360-8297c21de2b3', 'volume_name': 'volume-d1ab656f-be28-4a56-b360-8297c21de2b3', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b7038a81-cb83-426c-89e0-71fbb161bf80 tempest-CreateVolumesFromImageTest-1417987421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58a23b23-1d74-4d40-9629-9e545647fda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b7038a81-cb83-426c-89e0-71fbb161bf80 tempest-CreateVolumesFromImageTest-1417987421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58a23b23-1d74-4d40-9629-9e545647fda9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b7038a81-cb83-426c-89e0-71fbb161bf80 tempest-CreateVolumesFromImageTest-1417987421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49ae4399-3fa5-4cf1-85f2-617284dc6013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:41 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-b7038a81-cb83-426c-89e0-71fbb161bf80 tempest-CreateVolumesFromImageTest-1417987421 None] Volume d1ab656f-be28-4a56-b360-8297c21de2b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1ab656f-be28-4a56-b360-8297c21de2b3', 'volume_size': 1} Sep 28 15:08:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b7038a81-cb83-426c-89e0-71fbb161bf80 tempest-CreateVolumesFromImageTest-1417987421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5b661686-157b-43bb-a9e2-62d6188d0ef1 tempest-CreateVolumesFromImageTest-1417987421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d2d2ed7-5d5b-4303-8c21-445a6f14e0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5b2919f-d1e6-426a-b0d2-671aded91a31', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5b661686-157b-43bb-a9e2-62d6188d0ef1 tempest-CreateVolumesFromImageTest-1417987421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a0f7e5d-9cb9-469a-ae79-6d0527cc5598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:41 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-5b661686-157b-43bb-a9e2-62d6188d0ef1 tempest-CreateVolumesFromImageTest-1417987421 None] Volume volume-f5b2919f-d1e6-426a-b0d2-671aded91a31 (f5b2919f-d1e6-426a-b0d2-671aded91a31): created successfully Sep 28 15:08:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5b661686-157b-43bb-a9e2-62d6188d0ef1 tempest-CreateVolumesFromImageTest-1417987421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a0f7e5d-9cb9-469a-ae79-6d0527cc5598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:41 devstack sudo[104509]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5b661686-157b-43bb-a9e2-62d6188d0ef1 tempest-CreateVolumesFromImageTest-1417987421 None] Flow 'volume_create_manager' (215bc8bd-a515-49d2-b79e-baf38fa33f84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2c05119b-77a7-48e3-a7bd-d7e382a44aaa tempest-CreateVolumesFromSourceVolumeTest-876782771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ea6b6d38-5313-425b-b412-74028339ed87" returned: 0 in 0.435s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2c05119b-77a7-48e3-a7bd-d7e382a44aaa tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Lock "cinder-quobyte-ea6b6d38-5313-425b-b412-74028339ed87" released by "delete_volume" :: held 1.178s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:41 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-5b661686-157b-43bb-a9e2-62d6188d0ef1 tempest-CreateVolumesFromImageTest-1417987421 None] Created volume successfully. Sep 28 15:08:41 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-2c05119b-77a7-48e3-a7bd-d7e382a44aaa tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Created reservations ['69be5aac-c113-40e3-9f4d-f42aebdd7267', '7bac7190-f3af-4352-ac30-1b9bd12c61c8', '253ad958-d809-4ca4-9b40-e7e5172d116a', 'd5b196bd-4a59-4ecd-9a6d-35020e65ad48'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:08:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2c05119b-77a7-48e3-a7bd-d7e382a44aaa tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2c05119b-77a7-48e3-a7bd-d7e382a44aaa tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:41 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2c05119b-77a7-48e3-a7bd-d7e382a44aaa tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:41 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2c05119b-77a7-48e3-a7bd-d7e382a44aaa tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2c05119b-77a7-48e3-a7bd-d7e382a44aaa tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2c05119b-77a7-48e3-a7bd-d7e382a44aaa tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:41 devstack sudo[104518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:08:41 devstack sudo[104518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:41 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-880698fc-658f-4ed8-b0e6-1346a8ef0006 tempest-CreateVolumesFromImageTest-1417987421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:08:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-880698fc-658f-4ed8-b0e6-1346a8ef0006 tempest-CreateVolumesFromImageTest-1417987421 None] Flow 'volume_create_manager' (7d2e6f6d-4949-4082-8dfb-759e103e478f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-880698fc-658f-4ed8-b0e6-1346a8ef0006 tempest-CreateVolumesFromImageTest-1417987421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (739251fb-7b24-41e3-bf0a-798bdaa8da13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-880698fc-658f-4ed8-b0e6-1346a8ef0006 tempest-CreateVolumesFromImageTest-1417987421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (739251fb-7b24-41e3-bf0a-798bdaa8da13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1175127772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08a4c59c-1b00-4377-9ed8-e6e5dd322133,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7c700de903e48c3ad0332374d8bbc29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:42Z,use_quota=True,user_id='e48c335cfd9e482085a690a223f288da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-880698fc-658f-4ed8-b0e6-1346a8ef0006 tempest-CreateVolumesFromImageTest-1417987421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4b1e0ab-319f-4796-9c7a-7c45215fba74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-880698fc-658f-4ed8-b0e6-1346a8ef0006 tempest-CreateVolumesFromImageTest-1417987421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4b1e0ab-319f-4796-9c7a-7c45215fba74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-880698fc-658f-4ed8-b0e6-1346a8ef0006 tempest-CreateVolumesFromImageTest-1417987421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b073a33-d8a3-4148-8e79-9d9f648394b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-880698fc-658f-4ed8-b0e6-1346a8ef0006 tempest-CreateVolumesFromImageTest-1417987421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b073a33-d8a3-4148-8e79-9d9f648394b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08a4c59c-1b00-4377-9ed8-e6e5dd322133', 'volume_name': 'volume-08a4c59c-1b00-4377-9ed8-e6e5dd322133', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-880698fc-658f-4ed8-b0e6-1346a8ef0006 tempest-CreateVolumesFromImageTest-1417987421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39ae767c-7540-405b-aece-117c0c4e069d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-880698fc-658f-4ed8-b0e6-1346a8ef0006 tempest-CreateVolumesFromImageTest-1417987421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39ae767c-7540-405b-aece-117c0c4e069d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-880698fc-658f-4ed8-b0e6-1346a8ef0006 tempest-CreateVolumesFromImageTest-1417987421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (403bdaa8-32f9-4696-9d8c-d18753fef9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:42 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-880698fc-658f-4ed8-b0e6-1346a8ef0006 tempest-CreateVolumesFromImageTest-1417987421 None] Volume 08a4c59c-1b00-4377-9ed8-e6e5dd322133: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08a4c59c-1b00-4377-9ed8-e6e5dd322133', 'volume_size': 1} Sep 28 15:08:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-880698fc-658f-4ed8-b0e6-1346a8ef0006 tempest-CreateVolumesFromImageTest-1417987421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:42 devstack sudo[104512]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e955fbaf-af78-466b-a2c2-7bc59666048d tempest-CreateVolumesFromImageTest-1417987421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2fdae31d-29a5-4bb5-9cca-16c7c15c5466 1073741824" returned: 0 in 0.688s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:42 devstack sudo[104518]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2c05119b-77a7-48e3-a7bd-d7e382a44aaa tempest-CreateVolumesFromSourceVolumeTest-876782771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.361s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:42 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-2c05119b-77a7-48e3-a7bd-d7e382a44aaa tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:08:42 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-2c05119b-77a7-48e3-a7bd-d7e382a44aaa tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Deleted volume successfully. Sep 28 15:08:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e955fbaf-af78-466b-a2c2-7bc59666048d tempest-CreateVolumesFromImageTest-1417987421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2fdae31d-29a5-4bb5-9cca-16c7c15c5466 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:42 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2c05119b-77a7-48e3-a7bd-d7e382a44aaa tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Lock "cinder-ea6b6d38-5313-425b-b412-74028339ed87-delete_volume" released by "delete_volume" :: held 1.953s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:42 devstack sudo[104522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2fdae31d-29a5-4bb5-9cca-16c7c15c5466 Sep 28 15:08:42 devstack sudo[104522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:42 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e9c1f54-2c4a-40da-ad5e-df89ad01e4dc tempest-CreateVolumesFromImageTest-1417987421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:08:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3e9c1f54-2c4a-40da-ad5e-df89ad01e4dc tempest-CreateVolumesFromImageTest-1417987421 None] Flow 'volume_create_manager' (59a1e3ad-e9cb-45a7-8be4-33bed7efe90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3e9c1f54-2c4a-40da-ad5e-df89ad01e4dc tempest-CreateVolumesFromImageTest-1417987421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5228333a-7423-412f-ac72-2c56880ff3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3e9c1f54-2c4a-40da-ad5e-df89ad01e4dc tempest-CreateVolumesFromImageTest-1417987421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5228333a-7423-412f-ac72-2c56880ff3d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2048246090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dea5139-79f2-432d-a306-29cc28675e4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7c700de903e48c3ad0332374d8bbc29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:43Z,use_quota=True,user_id='e48c335cfd9e482085a690a223f288da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3e9c1f54-2c4a-40da-ad5e-df89ad01e4dc tempest-CreateVolumesFromImageTest-1417987421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d4b1215-751b-4be3-b01e-8ca39f1900c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3e9c1f54-2c4a-40da-ad5e-df89ad01e4dc tempest-CreateVolumesFromImageTest-1417987421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d4b1215-751b-4be3-b01e-8ca39f1900c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3e9c1f54-2c4a-40da-ad5e-df89ad01e4dc tempest-CreateVolumesFromImageTest-1417987421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7283c8c-5b34-4a62-b147-5aae5bda4791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3e9c1f54-2c4a-40da-ad5e-df89ad01e4dc tempest-CreateVolumesFromImageTest-1417987421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7283c8c-5b34-4a62-b147-5aae5bda4791) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dea5139-79f2-432d-a306-29cc28675e4d', 'volume_name': 'volume-8dea5139-79f2-432d-a306-29cc28675e4d', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3e9c1f54-2c4a-40da-ad5e-df89ad01e4dc tempest-CreateVolumesFromImageTest-1417987421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5c53768-4a38-4a55-a255-203a61a409f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3e9c1f54-2c4a-40da-ad5e-df89ad01e4dc tempest-CreateVolumesFromImageTest-1417987421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5c53768-4a38-4a55-a255-203a61a409f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3e9c1f54-2c4a-40da-ad5e-df89ad01e4dc tempest-CreateVolumesFromImageTest-1417987421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (020f0514-7e7a-48ac-80ea-560d18baaa58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:42 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-3e9c1f54-2c4a-40da-ad5e-df89ad01e4dc tempest-CreateVolumesFromImageTest-1417987421 None] Volume 8dea5139-79f2-432d-a306-29cc28675e4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dea5139-79f2-432d-a306-29cc28675e4d', 'volume_size': 1} Sep 28 15:08:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3e9c1f54-2c4a-40da-ad5e-df89ad01e4dc tempest-CreateVolumesFromImageTest-1417987421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:42 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-698e0fba-482f-4248-95f2-70131f883042 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Acquiring lock "cinder-a90a6f41-2bdc-48ec-95ed-187b1c37610a-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:42 devstack sudo[104522]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e955fbaf-af78-466b-a2c2-7bc59666048d tempest-CreateVolumesFromImageTest-1417987421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2fdae31d-29a5-4bb5-9cca-16c7c15c5466" returned: 0 in 0.407s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:42 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e955fbaf-af78-466b-a2c2-7bc59666048d tempest-CreateVolumesFromImageTest-1417987421 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:08:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e955fbaf-af78-466b-a2c2-7bc59666048d tempest-CreateVolumesFromImageTest-1417987421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.215s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b7038a81-cb83-426c-89e0-71fbb161bf80 tempest-CreateVolumesFromImageTest-1417987421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.108s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:42 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b7038a81-cb83-426c-89e0-71fbb161bf80 tempest-CreateVolumesFromImageTest-1417987421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1004526745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1ab656f-be28-4a56-b360-8297c21de2b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7c700de903e48c3ad0332374d8bbc29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:41Z,use_quota=True,user_id='e48c335cfd9e482085a690a223f288da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:08:42 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-b7038a81-cb83-426c-89e0-71fbb161bf80 tempest-CreateVolumesFromImageTest-1417987421 None] Creating volume d1ab656f-be28-4a56-b360-8297c21de2b3 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:08:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b7038a81-cb83-426c-89e0-71fbb161bf80 tempest-CreateVolumesFromImageTest-1417987421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b7038a81-cb83-426c-89e0-71fbb161bf80 tempest-CreateVolumesFromImageTest-1417987421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:42 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b7038a81-cb83-426c-89e0-71fbb161bf80 tempest-CreateVolumesFromImageTest-1417987421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:42 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b7038a81-cb83-426c-89e0-71fbb161bf80 tempest-CreateVolumesFromImageTest-1417987421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b7038a81-cb83-426c-89e0-71fbb161bf80 tempest-CreateVolumesFromImageTest-1417987421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:42 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b7038a81-cb83-426c-89e0-71fbb161bf80 tempest-CreateVolumesFromImageTest-1417987421 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:08:42 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-b7038a81-cb83-426c-89e0-71fbb161bf80 tempest-CreateVolumesFromImageTest-1417987421 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:08:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b7038a81-cb83-426c-89e0-71fbb161bf80 tempest-CreateVolumesFromImageTest-1417987421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-d1ab656f-be28-4a56-b360-8297c21de2b3 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:42 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-698e0fba-482f-4248-95f2-70131f883042 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Lock "cinder-a90a6f41-2bdc-48ec-95ed-187b1c37610a-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e955fbaf-af78-466b-a2c2-7bc59666048d tempest-CreateVolumesFromImageTest-1417987421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adfe1882-e143-4531-b542-a2946f9c45b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fdae31d-29a5-4bb5-9cca-16c7c15c5466', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:42 devstack sudo[104525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-d1ab656f-be28-4a56-b360-8297c21de2b3 1073741824 Sep 28 15:08:42 devstack sudo[104525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e955fbaf-af78-466b-a2c2-7bc59666048d tempest-CreateVolumesFromImageTest-1417987421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2ebefcd-68a6-42bd-9d42-3c185774e359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:42 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-e955fbaf-af78-466b-a2c2-7bc59666048d tempest-CreateVolumesFromImageTest-1417987421 None] Volume volume-2fdae31d-29a5-4bb5-9cca-16c7c15c5466 (2fdae31d-29a5-4bb5-9cca-16c7c15c5466): created successfully Sep 28 15:08:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e955fbaf-af78-466b-a2c2-7bc59666048d tempest-CreateVolumesFromImageTest-1417987421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2ebefcd-68a6-42bd-9d42-3c185774e359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e955fbaf-af78-466b-a2c2-7bc59666048d tempest-CreateVolumesFromImageTest-1417987421 None] Flow 'volume_create_manager' (f46506ce-59bd-4e0d-a195-4d294425bafa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:42 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-e955fbaf-af78-466b-a2c2-7bc59666048d tempest-CreateVolumesFromImageTest-1417987421 None] Created volume successfully. Sep 28 15:08:42 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-698e0fba-482f-4248-95f2-70131f883042 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Acquiring lock "cinder-quobyte-a90a6f41-2bdc-48ec-95ed-187b1c37610a" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:42 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-698e0fba-482f-4248-95f2-70131f883042 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Lock "cinder-quobyte-a90a6f41-2bdc-48ec-95ed-187b1c37610a" acquired by "delete_volume" :: waited 0.030s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:42 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25dbc74-d2f2-4848-b499-9fc6eade0015]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-698e0fba-482f-4248-95f2-70131f883042 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a90a6f41-2bdc-48ec-95ed-187b1c37610a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:43 devstack sudo[104527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a90a6f41-2bdc-48ec-95ed-187b1c37610a Sep 28 15:08:43 devstack sudo[104527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:43 devstack sudo[104525]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b7038a81-cb83-426c-89e0-71fbb161bf80 tempest-CreateVolumesFromImageTest-1417987421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-d1ab656f-be28-4a56-b360-8297c21de2b3 1073741824" returned: 0 in 0.605s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b7038a81-cb83-426c-89e0-71fbb161bf80 tempest-CreateVolumesFromImageTest-1417987421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-d1ab656f-be28-4a56-b360-8297c21de2b3 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:43 devstack sudo[104527]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-698e0fba-482f-4248-95f2-70131f883042 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a90a6f41-2bdc-48ec-95ed-187b1c37610a" returned: 0 in 0.513s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-698e0fba-482f-4248-95f2-70131f883042 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a90a6f41-2bdc-48ec-95ed-187b1c37610a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:43 devstack sudo[104537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-d1ab656f-be28-4a56-b360-8297c21de2b3 Sep 28 15:08:43 devstack sudo[104537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:43 devstack sudo[104539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a90a6f41-2bdc-48ec-95ed-187b1c37610a Sep 28 15:08:43 devstack sudo[104539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:43 devstack sudo[104537]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b7038a81-cb83-426c-89e0-71fbb161bf80 tempest-CreateVolumesFromImageTest-1417987421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-d1ab656f-be28-4a56-b360-8297c21de2b3" returned: 0 in 0.325s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:43 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b7038a81-cb83-426c-89e0-71fbb161bf80 tempest-CreateVolumesFromImageTest-1417987421 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:08:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b7038a81-cb83-426c-89e0-71fbb161bf80 tempest-CreateVolumesFromImageTest-1417987421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-880698fc-658f-4ed8-b0e6-1346a8ef0006 tempest-CreateVolumesFromImageTest-1417987421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.613s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:43 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-880698fc-658f-4ed8-b0e6-1346a8ef0006 tempest-CreateVolumesFromImageTest-1417987421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1175127772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08a4c59c-1b00-4377-9ed8-e6e5dd322133,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7c700de903e48c3ad0332374d8bbc29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:42Z,use_quota=True,user_id='e48c335cfd9e482085a690a223f288da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:08:43 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-880698fc-658f-4ed8-b0e6-1346a8ef0006 tempest-CreateVolumesFromImageTest-1417987421 None] Creating volume 08a4c59c-1b00-4377-9ed8-e6e5dd322133 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:08:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-880698fc-658f-4ed8-b0e6-1346a8ef0006 tempest-CreateVolumesFromImageTest-1417987421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-880698fc-658f-4ed8-b0e6-1346a8ef0006 tempest-CreateVolumesFromImageTest-1417987421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:43 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-880698fc-658f-4ed8-b0e6-1346a8ef0006 tempest-CreateVolumesFromImageTest-1417987421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:43 devstack sudo[104539]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:43 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-880698fc-658f-4ed8-b0e6-1346a8ef0006 tempest-CreateVolumesFromImageTest-1417987421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-880698fc-658f-4ed8-b0e6-1346a8ef0006 tempest-CreateVolumesFromImageTest-1417987421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:43 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-880698fc-658f-4ed8-b0e6-1346a8ef0006 tempest-CreateVolumesFromImageTest-1417987421 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:08:43 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-880698fc-658f-4ed8-b0e6-1346a8ef0006 tempest-CreateVolumesFromImageTest-1417987421 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:08:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-880698fc-658f-4ed8-b0e6-1346a8ef0006 tempest-CreateVolumesFromImageTest-1417987421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-08a4c59c-1b00-4377-9ed8-e6e5dd322133 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-698e0fba-482f-4248-95f2-70131f883042 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a90a6f41-2bdc-48ec-95ed-187b1c37610a" returned: 0 in 0.331s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:43 devstack sudo[104543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-08a4c59c-1b00-4377-9ed8-e6e5dd322133 1073741824 Sep 28 15:08:43 devstack sudo[104543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:43 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b7038a81-cb83-426c-89e0-71fbb161bf80 tempest-CreateVolumesFromImageTest-1417987421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49ae4399-3fa5-4cf1-85f2-617284dc6013) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1ab656f-be28-4a56-b360-8297c21de2b3', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:43 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b7038a81-cb83-426c-89e0-71fbb161bf80 tempest-CreateVolumesFromImageTest-1417987421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a18bd1fc-de55-4b4c-9cae-a19fb2ddca42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-698e0fba-482f-4248-95f2-70131f883042 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Lock "cinder-quobyte-a90a6f41-2bdc-48ec-95ed-187b1c37610a" released by "delete_volume" :: held 0.949s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:43 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-b7038a81-cb83-426c-89e0-71fbb161bf80 tempest-CreateVolumesFromImageTest-1417987421 None] Volume volume-d1ab656f-be28-4a56-b360-8297c21de2b3 (d1ab656f-be28-4a56-b360-8297c21de2b3): created successfully Sep 28 15:08:43 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b7038a81-cb83-426c-89e0-71fbb161bf80 tempest-CreateVolumesFromImageTest-1417987421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a18bd1fc-de55-4b4c-9cae-a19fb2ddca42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:43 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b7038a81-cb83-426c-89e0-71fbb161bf80 tempest-CreateVolumesFromImageTest-1417987421 None] Flow 'volume_create_manager' (ff871969-785e-4846-a40a-18e0131bb530) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:43 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-b7038a81-cb83-426c-89e0-71fbb161bf80 tempest-CreateVolumesFromImageTest-1417987421 None] Created volume successfully. Sep 28 15:08:43 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-698e0fba-482f-4248-95f2-70131f883042 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Created reservations ['b18a4850-c6e5-4cab-bd75-4e601759c8e2', 'f685a069-d41c-49a6-b222-8caf51461081', '2d5a412d-c943-4e57-9cba-3200c663e2e7', '2183bc37-b90d-4f17-9dce-8c6a12695bde'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:08:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-698e0fba-482f-4248-95f2-70131f883042 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-698e0fba-482f-4248-95f2-70131f883042 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:44 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-698e0fba-482f-4248-95f2-70131f883042 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:44 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-698e0fba-482f-4248-95f2-70131f883042 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-698e0fba-482f-4248-95f2-70131f883042 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-698e0fba-482f-4248-95f2-70131f883042 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:44 devstack sudo[104547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:08:44 devstack sudo[104547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:44 devstack sudo[104543]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-880698fc-658f-4ed8-b0e6-1346a8ef0006 tempest-CreateVolumesFromImageTest-1417987421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-08a4c59c-1b00-4377-9ed8-e6e5dd322133 1073741824" returned: 0 in 0.586s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:44 devstack sudo[104547]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-698e0fba-482f-4248-95f2-70131f883042 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.325s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:44 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-698e0fba-482f-4248-95f2-70131f883042 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:08:44 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-698e0fba-482f-4248-95f2-70131f883042 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Deleted volume successfully. Sep 28 15:08:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-880698fc-658f-4ed8-b0e6-1346a8ef0006 tempest-CreateVolumesFromImageTest-1417987421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-08a4c59c-1b00-4377-9ed8-e6e5dd322133 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:44 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-698e0fba-482f-4248-95f2-70131f883042 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Lock "cinder-a90a6f41-2bdc-48ec-95ed-187b1c37610a-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:44 devstack sudo[104558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-08a4c59c-1b00-4377-9ed8-e6e5dd322133 Sep 28 15:08:44 devstack sudo[104558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:44 devstack sudo[104558]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-880698fc-658f-4ed8-b0e6-1346a8ef0006 tempest-CreateVolumesFromImageTest-1417987421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-08a4c59c-1b00-4377-9ed8-e6e5dd322133" returned: 0 in 0.336s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:44 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-880698fc-658f-4ed8-b0e6-1346a8ef0006 tempest-CreateVolumesFromImageTest-1417987421 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:08:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-880698fc-658f-4ed8-b0e6-1346a8ef0006 tempest-CreateVolumesFromImageTest-1417987421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3e9c1f54-2c4a-40da-ad5e-df89ad01e4dc tempest-CreateVolumesFromImageTest-1417987421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.040s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:44 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3e9c1f54-2c4a-40da-ad5e-df89ad01e4dc tempest-CreateVolumesFromImageTest-1417987421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2048246090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dea5139-79f2-432d-a306-29cc28675e4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7c700de903e48c3ad0332374d8bbc29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:43Z,use_quota=True,user_id='e48c335cfd9e482085a690a223f288da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:08:44 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-3e9c1f54-2c4a-40da-ad5e-df89ad01e4dc tempest-CreateVolumesFromImageTest-1417987421 None] Creating volume 8dea5139-79f2-432d-a306-29cc28675e4d {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:08:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3e9c1f54-2c4a-40da-ad5e-df89ad01e4dc tempest-CreateVolumesFromImageTest-1417987421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3e9c1f54-2c4a-40da-ad5e-df89ad01e4dc tempest-CreateVolumesFromImageTest-1417987421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:44 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3e9c1f54-2c4a-40da-ad5e-df89ad01e4dc tempest-CreateVolumesFromImageTest-1417987421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:44 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3e9c1f54-2c4a-40da-ad5e-df89ad01e4dc tempest-CreateVolumesFromImageTest-1417987421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3e9c1f54-2c4a-40da-ad5e-df89ad01e4dc tempest-CreateVolumesFromImageTest-1417987421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:44 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3e9c1f54-2c4a-40da-ad5e-df89ad01e4dc tempest-CreateVolumesFromImageTest-1417987421 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:08:44 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-3e9c1f54-2c4a-40da-ad5e-df89ad01e4dc tempest-CreateVolumesFromImageTest-1417987421 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:08:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3e9c1f54-2c4a-40da-ad5e-df89ad01e4dc tempest-CreateVolumesFromImageTest-1417987421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8dea5139-79f2-432d-a306-29cc28675e4d 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:44 devstack sudo[104561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8dea5139-79f2-432d-a306-29cc28675e4d 1073741824 Sep 28 15:08:44 devstack sudo[104561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:44 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-880698fc-658f-4ed8-b0e6-1346a8ef0006 tempest-CreateVolumesFromImageTest-1417987421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (403bdaa8-32f9-4696-9d8c-d18753fef9b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08a4c59c-1b00-4377-9ed8-e6e5dd322133', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:44 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-880698fc-658f-4ed8-b0e6-1346a8ef0006 tempest-CreateVolumesFromImageTest-1417987421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (465c5393-2352-4345-bb23-7e16813738db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:44 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-880698fc-658f-4ed8-b0e6-1346a8ef0006 tempest-CreateVolumesFromImageTest-1417987421 None] Volume volume-08a4c59c-1b00-4377-9ed8-e6e5dd322133 (08a4c59c-1b00-4377-9ed8-e6e5dd322133): created successfully Sep 28 15:08:44 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-880698fc-658f-4ed8-b0e6-1346a8ef0006 tempest-CreateVolumesFromImageTest-1417987421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (465c5393-2352-4345-bb23-7e16813738db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:44 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-880698fc-658f-4ed8-b0e6-1346a8ef0006 tempest-CreateVolumesFromImageTest-1417987421 None] Flow 'volume_create_manager' (7d2e6f6d-4949-4082-8dfb-759e103e478f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:44 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-880698fc-658f-4ed8-b0e6-1346a8ef0006 tempest-CreateVolumesFromImageTest-1417987421 None] Created volume successfully. Sep 28 15:08:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5aba6438-498d-4221-8024-e43a286521a2 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Acquiring lock "cinder-cfef2722-763c-494d-acca-b9f3726a98fa-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5aba6438-498d-4221-8024-e43a286521a2 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Lock "cinder-cfef2722-763c-494d-acca-b9f3726a98fa-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5aba6438-498d-4221-8024-e43a286521a2 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Acquiring lock "cinder-quobyte-cfef2722-763c-494d-acca-b9f3726a98fa" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5aba6438-498d-4221-8024-e43a286521a2 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Lock "cinder-quobyte-cfef2722-763c-494d-acca-b9f3726a98fa" acquired by "delete_volume" :: waited 0.021s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:45 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c70f5d-7ff9-45da-a8d4-18eba303993b]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5aba6438-498d-4221-8024-e43a286521a2 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cfef2722-763c-494d-acca-b9f3726a98fa {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:45 devstack sudo[104566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cfef2722-763c-494d-acca-b9f3726a98fa Sep 28 15:08:45 devstack sudo[104566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:45 devstack sudo[104561]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3e9c1f54-2c4a-40da-ad5e-df89ad01e4dc tempest-CreateVolumesFromImageTest-1417987421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8dea5139-79f2-432d-a306-29cc28675e4d 1073741824" returned: 0 in 0.642s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3e9c1f54-2c4a-40da-ad5e-df89ad01e4dc tempest-CreateVolumesFromImageTest-1417987421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8dea5139-79f2-432d-a306-29cc28675e4d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:45 devstack sudo[104569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8dea5139-79f2-432d-a306-29cc28675e4d Sep 28 15:08:45 devstack sudo[104569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:45 devstack sudo[104566]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5aba6438-498d-4221-8024-e43a286521a2 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cfef2722-763c-494d-acca-b9f3726a98fa" returned: 0 in 0.532s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5aba6438-498d-4221-8024-e43a286521a2 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cfef2722-763c-494d-acca-b9f3726a98fa {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:45 devstack sudo[104574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cfef2722-763c-494d-acca-b9f3726a98fa Sep 28 15:08:45 devstack sudo[104574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:45 devstack sudo[104569]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3e9c1f54-2c4a-40da-ad5e-df89ad01e4dc tempest-CreateVolumesFromImageTest-1417987421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8dea5139-79f2-432d-a306-29cc28675e4d" returned: 0 in 0.369s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:45 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3e9c1f54-2c4a-40da-ad5e-df89ad01e4dc tempest-CreateVolumesFromImageTest-1417987421 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:08:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3e9c1f54-2c4a-40da-ad5e-df89ad01e4dc tempest-CreateVolumesFromImageTest-1417987421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3e9c1f54-2c4a-40da-ad5e-df89ad01e4dc tempest-CreateVolumesFromImageTest-1417987421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (020f0514-7e7a-48ac-80ea-560d18baaa58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dea5139-79f2-432d-a306-29cc28675e4d', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3e9c1f54-2c4a-40da-ad5e-df89ad01e4dc tempest-CreateVolumesFromImageTest-1417987421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1519cf20-5060-4242-ba6d-7d7e5cab84c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:45 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-3e9c1f54-2c4a-40da-ad5e-df89ad01e4dc tempest-CreateVolumesFromImageTest-1417987421 None] Volume volume-8dea5139-79f2-432d-a306-29cc28675e4d (8dea5139-79f2-432d-a306-29cc28675e4d): created successfully Sep 28 15:08:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3e9c1f54-2c4a-40da-ad5e-df89ad01e4dc tempest-CreateVolumesFromImageTest-1417987421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1519cf20-5060-4242-ba6d-7d7e5cab84c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3e9c1f54-2c4a-40da-ad5e-df89ad01e4dc tempest-CreateVolumesFromImageTest-1417987421 None] Flow 'volume_create_manager' (59a1e3ad-e9cb-45a7-8be4-33bed7efe90c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:45 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-3e9c1f54-2c4a-40da-ad5e-df89ad01e4dc tempest-CreateVolumesFromImageTest-1417987421 None] Created volume successfully. Sep 28 15:08:45 devstack sudo[104574]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5aba6438-498d-4221-8024-e43a286521a2 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cfef2722-763c-494d-acca-b9f3726a98fa" returned: 0 in 0.314s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5aba6438-498d-4221-8024-e43a286521a2 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Lock "cinder-quobyte-cfef2722-763c-494d-acca-b9f3726a98fa" released by "delete_volume" :: held 0.915s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:46 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-5aba6438-498d-4221-8024-e43a286521a2 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Created reservations ['fb56ebdc-c2de-4eee-a9fc-f774142e3dc7', '2c1c4bce-ea04-434d-9a72-c5d056cfcb2e', '8ac5b464-319f-4410-8d26-d429f21fe480', '135c3910-5049-4b09-86e6-502d96693067'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:08:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5aba6438-498d-4221-8024-e43a286521a2 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5aba6438-498d-4221-8024-e43a286521a2 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:46 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5aba6438-498d-4221-8024-e43a286521a2 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:46 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5aba6438-498d-4221-8024-e43a286521a2 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5aba6438-498d-4221-8024-e43a286521a2 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5aba6438-498d-4221-8024-e43a286521a2 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2d0455bf-e8d5-4f9f-acb4-f0022dd857b4 tempest-CreateVolumesFromImageTest-1417987421 None] Acquiring lock "cinder-8dea5139-79f2-432d-a306-29cc28675e4d-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:46 devstack sudo[104579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:08:46 devstack sudo[104579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2d0455bf-e8d5-4f9f-acb4-f0022dd857b4 tempest-CreateVolumesFromImageTest-1417987421 None] Lock "cinder-8dea5139-79f2-432d-a306-29cc28675e4d-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7b93774d-8901-4756-a21a-7b33482a27ac tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Acquiring lock "cinder-13e25b9a-c561-4335-909c-8cbea6403924-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7b93774d-8901-4756-a21a-7b33482a27ac tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Lock "cinder-13e25b9a-c561-4335-909c-8cbea6403924-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2d0455bf-e8d5-4f9f-acb4-f0022dd857b4 tempest-CreateVolumesFromImageTest-1417987421 None] Acquiring lock "cinder-quobyte-8dea5139-79f2-432d-a306-29cc28675e4d" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2d0455bf-e8d5-4f9f-acb4-f0022dd857b4 tempest-CreateVolumesFromImageTest-1417987421 None] Lock "cinder-quobyte-8dea5139-79f2-432d-a306-29cc28675e4d" acquired by "delete_volume" :: waited 0.044s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:46 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[85630d17-0574-4d34-a705-9caaa110b960]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2d0455bf-e8d5-4f9f-acb4-f0022dd857b4 tempest-CreateVolumesFromImageTest-1417987421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8dea5139-79f2-432d-a306-29cc28675e4d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7b93774d-8901-4756-a21a-7b33482a27ac tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Acquiring lock "cinder-quobyte-13e25b9a-c561-4335-909c-8cbea6403924" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7b93774d-8901-4756-a21a-7b33482a27ac tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Lock "cinder-quobyte-13e25b9a-c561-4335-909c-8cbea6403924" acquired by "delete_volume" :: waited 0.025s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:46 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[199421b1-9245-4231-93a7-b5a631036d58]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7b93774d-8901-4756-a21a-7b33482a27ac tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-13e25b9a-c561-4335-909c-8cbea6403924 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:46 devstack sudo[104581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8dea5139-79f2-432d-a306-29cc28675e4d Sep 28 15:08:46 devstack sudo[104581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:46 devstack sudo[104579]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5aba6438-498d-4221-8024-e43a286521a2 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.575s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:46 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-5aba6438-498d-4221-8024-e43a286521a2 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:08:46 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-5aba6438-498d-4221-8024-e43a286521a2 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Deleted volume successfully. Sep 28 15:08:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5aba6438-498d-4221-8024-e43a286521a2 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Lock "cinder-cfef2722-763c-494d-acca-b9f3726a98fa-delete_volume" released by "delete_volume" :: held 1.833s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:46 devstack sudo[104582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-13e25b9a-c561-4335-909c-8cbea6403924 Sep 28 15:08:46 devstack sudo[104582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:47 devstack sudo[104581]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2d0455bf-e8d5-4f9f-acb4-f0022dd857b4 tempest-CreateVolumesFromImageTest-1417987421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8dea5139-79f2-432d-a306-29cc28675e4d" returned: 0 in 0.547s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2d0455bf-e8d5-4f9f-acb4-f0022dd857b4 tempest-CreateVolumesFromImageTest-1417987421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8dea5139-79f2-432d-a306-29cc28675e4d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:47 devstack sudo[104589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8dea5139-79f2-432d-a306-29cc28675e4d Sep 28 15:08:47 devstack sudo[104589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:47 devstack sudo[104582]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7b93774d-8901-4756-a21a-7b33482a27ac tempest-CreateVolumesFromSourceVolumeTest-876782771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-13e25b9a-c561-4335-909c-8cbea6403924" returned: 0 in 0.569s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7b93774d-8901-4756-a21a-7b33482a27ac tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-13e25b9a-c561-4335-909c-8cbea6403924 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:47 devstack sudo[104595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-13e25b9a-c561-4335-909c-8cbea6403924 Sep 28 15:08:47 devstack sudo[104595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:47 devstack sudo[104589]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2d0455bf-e8d5-4f9f-acb4-f0022dd857b4 tempest-CreateVolumesFromImageTest-1417987421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8dea5139-79f2-432d-a306-29cc28675e4d" returned: 0 in 0.304s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:47 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2d0455bf-e8d5-4f9f-acb4-f0022dd857b4 tempest-CreateVolumesFromImageTest-1417987421 None] Lock "cinder-quobyte-8dea5139-79f2-432d-a306-29cc28675e4d" released by "delete_volume" :: held 0.960s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:47 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-2d0455bf-e8d5-4f9f-acb4-f0022dd857b4 tempest-CreateVolumesFromImageTest-1417987421 None] Created reservations ['5c3b5130-973f-47e8-89ee-b6409c42c152', 'bd264099-71ed-4da4-9d5b-a85e61adef76', '9e6c4044-45a1-43e0-9358-28a74e69e3aa', '4c6ee954-cad0-4fc8-b40b-54d92a99ad15'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:08:47 devstack sudo[104595]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7b93774d-8901-4756-a21a-7b33482a27ac tempest-CreateVolumesFromSourceVolumeTest-876782771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-13e25b9a-c561-4335-909c-8cbea6403924" returned: 0 in 0.453s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:47 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7b93774d-8901-4756-a21a-7b33482a27ac tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Lock "cinder-quobyte-13e25b9a-c561-4335-909c-8cbea6403924" released by "delete_volume" :: held 1.118s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2d0455bf-e8d5-4f9f-acb4-f0022dd857b4 tempest-CreateVolumesFromImageTest-1417987421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2d0455bf-e8d5-4f9f-acb4-f0022dd857b4 tempest-CreateVolumesFromImageTest-1417987421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:47 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2d0455bf-e8d5-4f9f-acb4-f0022dd857b4 tempest-CreateVolumesFromImageTest-1417987421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:47 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2d0455bf-e8d5-4f9f-acb4-f0022dd857b4 tempest-CreateVolumesFromImageTest-1417987421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2d0455bf-e8d5-4f9f-acb4-f0022dd857b4 tempest-CreateVolumesFromImageTest-1417987421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2d0455bf-e8d5-4f9f-acb4-f0022dd857b4 tempest-CreateVolumesFromImageTest-1417987421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:47 devstack sudo[104600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:08:47 devstack sudo[104600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:47 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-7b93774d-8901-4756-a21a-7b33482a27ac tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Created reservations ['439c97de-87fc-4ddc-8062-cc097a8936ea', '982c2449-c806-433f-bb37-9b4433b3e076', '52ee5615-bb10-4ae9-903c-bdb7ad7bfe1f', 'b606dd89-d10b-4a8c-ab4d-a097fa49713c'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:08:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7b93774d-8901-4756-a21a-7b33482a27ac tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7b93774d-8901-4756-a21a-7b33482a27ac tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:47 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7b93774d-8901-4756-a21a-7b33482a27ac tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:47 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7b93774d-8901-4756-a21a-7b33482a27ac tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7b93774d-8901-4756-a21a-7b33482a27ac tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7b93774d-8901-4756-a21a-7b33482a27ac tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:47 devstack sudo[104603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:08:47 devstack sudo[104603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:48 devstack sudo[104600]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2d0455bf-e8d5-4f9f-acb4-f0022dd857b4 tempest-CreateVolumesFromImageTest-1417987421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.502s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:48 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-2d0455bf-e8d5-4f9f-acb4-f0022dd857b4 tempest-CreateVolumesFromImageTest-1417987421 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:08:48 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-2d0455bf-e8d5-4f9f-acb4-f0022dd857b4 tempest-CreateVolumesFromImageTest-1417987421 None] Deleted volume successfully. Sep 28 15:08:48 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2d0455bf-e8d5-4f9f-acb4-f0022dd857b4 tempest-CreateVolumesFromImageTest-1417987421 None] Lock "cinder-8dea5139-79f2-432d-a306-29cc28675e4d-delete_volume" released by "delete_volume" :: held 1.985s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:48 devstack sudo[104603]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7b93774d-8901-4756-a21a-7b33482a27ac tempest-CreateVolumesFromSourceVolumeTest-876782771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.402s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:48 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-7b93774d-8901-4756-a21a-7b33482a27ac tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:08:48 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-7b93774d-8901-4756-a21a-7b33482a27ac tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Deleted volume successfully. Sep 28 15:08:48 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7b93774d-8901-4756-a21a-7b33482a27ac tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Lock "cinder-13e25b9a-c561-4335-909c-8cbea6403924-delete_volume" released by "delete_volume" :: held 2.036s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:48 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7583a5ce-5420-40ce-967a-c892097fa47a tempest-CreateVolumesFromImageTest-1417987421 None] Acquiring lock "cinder-08a4c59c-1b00-4377-9ed8-e6e5dd322133-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:48 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7583a5ce-5420-40ce-967a-c892097fa47a tempest-CreateVolumesFromImageTest-1417987421 None] Lock "cinder-08a4c59c-1b00-4377-9ed8-e6e5dd322133-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:48 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c5c23ffe-c1db-4956-b437-3919d9f91946 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Acquiring lock "cinder-8c6a82cf-7b38-45bf-a72d-a3e04dd9c7e4-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:48 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c5c23ffe-c1db-4956-b437-3919d9f91946 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Lock "cinder-8c6a82cf-7b38-45bf-a72d-a3e04dd9c7e4-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:48 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7583a5ce-5420-40ce-967a-c892097fa47a tempest-CreateVolumesFromImageTest-1417987421 None] Acquiring lock "cinder-quobyte-08a4c59c-1b00-4377-9ed8-e6e5dd322133" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:48 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7583a5ce-5420-40ce-967a-c892097fa47a tempest-CreateVolumesFromImageTest-1417987421 None] Lock "cinder-quobyte-08a4c59c-1b00-4377-9ed8-e6e5dd322133" acquired by "delete_volume" :: waited 0.028s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:48 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[189757c8-3acd-405f-93e7-652c675a133d]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7583a5ce-5420-40ce-967a-c892097fa47a tempest-CreateVolumesFromImageTest-1417987421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-08a4c59c-1b00-4377-9ed8-e6e5dd322133 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:48 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c5c23ffe-c1db-4956-b437-3919d9f91946 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Acquiring lock "cinder-quobyte-8c6a82cf-7b38-45bf-a72d-a3e04dd9c7e4" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:48 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c5c23ffe-c1db-4956-b437-3919d9f91946 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Lock "cinder-quobyte-8c6a82cf-7b38-45bf-a72d-a3e04dd9c7e4" acquired by "delete_volume" :: waited 0.022s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:48 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-dc56df83-0e49-4db2-b498-83359c5fa3bf req-0b923818-aed8-46b9-ab3a-a84590aba6e1 tempest-TestMinimumBasicScenario-1546684596 None] Terminate volume connection completed successfully. Sep 28 15:08:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-dc56df83-0e49-4db2-b498-83359c5fa3bf req-0b923818-aed8-46b9-ab3a-a84590aba6e1 tempest-TestMinimumBasicScenario-1546684596 None] Deleting attachment 9a7b5694-8f1f-4e96-acb0-65af99ed8731. {{(pid=87116) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:08:49 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b531a0-ed23-435c-b9a4-8b3be30cc4af]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c5c23ffe-c1db-4956-b437-3919d9f91946 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8c6a82cf-7b38-45bf-a72d-a3e04dd9c7e4 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:49 devstack sudo[104613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-08a4c59c-1b00-4377-9ed8-e6e5dd322133 Sep 28 15:08:49 devstack sudo[104613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:49 devstack sudo[104614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8c6a82cf-7b38-45bf-a72d-a3e04dd9c7e4 Sep 28 15:08:49 devstack sudo[104614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:49 devstack sudo[104613]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7583a5ce-5420-40ce-967a-c892097fa47a tempest-CreateVolumesFromImageTest-1417987421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-08a4c59c-1b00-4377-9ed8-e6e5dd322133" returned: 0 in 0.540s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7583a5ce-5420-40ce-967a-c892097fa47a tempest-CreateVolumesFromImageTest-1417987421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-08a4c59c-1b00-4377-9ed8-e6e5dd322133 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:49 devstack sudo[104623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-08a4c59c-1b00-4377-9ed8-e6e5dd322133 Sep 28 15:08:49 devstack sudo[104623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:49 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3cbe8bfb-d633-4a86-be17-13cac44b9639 tempest-TestMinimumBasicScenario-1546684596 None] Acquiring lock "cinder-84955917-c572-4297-98c7-e17bdafc941b-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:49 devstack sudo[104614]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c5c23ffe-c1db-4956-b437-3919d9f91946 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8c6a82cf-7b38-45bf-a72d-a3e04dd9c7e4" returned: 0 in 0.542s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c5c23ffe-c1db-4956-b437-3919d9f91946 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8c6a82cf-7b38-45bf-a72d-a3e04dd9c7e4 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:49 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3cbe8bfb-d633-4a86-be17-13cac44b9639 tempest-TestMinimumBasicScenario-1546684596 None] Lock "cinder-84955917-c572-4297-98c7-e17bdafc941b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:49 devstack sudo[104625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8c6a82cf-7b38-45bf-a72d-a3e04dd9c7e4 Sep 28 15:08:49 devstack sudo[104625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:49 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3cbe8bfb-d633-4a86-be17-13cac44b9639 tempest-TestMinimumBasicScenario-1546684596 None] Acquiring lock "cinder-quobyte-84955917-c572-4297-98c7-e17bdafc941b" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:49 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3cbe8bfb-d633-4a86-be17-13cac44b9639 tempest-TestMinimumBasicScenario-1546684596 None] Lock "cinder-quobyte-84955917-c572-4297-98c7-e17bdafc941b" acquired by "delete_volume" :: waited 0.020s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:49 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[06bb52a1-aa4b-4013-aeca-f2b4ec5aa721]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3cbe8bfb-d633-4a86-be17-13cac44b9639 tempest-TestMinimumBasicScenario-1546684596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-84955917-c572-4297-98c7-e17bdafc941b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:49 devstack sudo[104627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-84955917-c572-4297-98c7-e17bdafc941b Sep 28 15:08:49 devstack sudo[104627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:49 devstack sudo[104623]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7583a5ce-5420-40ce-967a-c892097fa47a tempest-CreateVolumesFromImageTest-1417987421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-08a4c59c-1b00-4377-9ed8-e6e5dd322133" returned: 0 in 0.349s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:49 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7583a5ce-5420-40ce-967a-c892097fa47a tempest-CreateVolumesFromImageTest-1417987421 None] Lock "cinder-quobyte-08a4c59c-1b00-4377-9ed8-e6e5dd322133" released by "delete_volume" :: held 0.995s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:49 devstack sudo[104625]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c5c23ffe-c1db-4956-b437-3919d9f91946 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-8c6a82cf-7b38-45bf-a72d-a3e04dd9c7e4" returned: 0 in 0.328s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:49 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c5c23ffe-c1db-4956-b437-3919d9f91946 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Lock "cinder-quobyte-8c6a82cf-7b38-45bf-a72d-a3e04dd9c7e4" released by "delete_volume" :: held 0.931s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:49 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-7583a5ce-5420-40ce-967a-c892097fa47a tempest-CreateVolumesFromImageTest-1417987421 None] Created reservations ['2b0400c5-a87a-4489-8070-8e1a635d207e', '329f0e03-8ac1-4fdb-8f91-902d13174474', 'f56643ea-b3a0-4de0-a690-617d1251463e', '33a17666-24d3-4b5a-8e9a-74362302806e'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:08:50 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-c5c23ffe-c1db-4956-b437-3919d9f91946 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Created reservations ['94df8fb0-699f-426a-9432-ea7cba918613', '631c1da3-ef1c-49bd-9497-73d4f38175ad', '61391fe5-7ac3-44b5-80ca-0ea0b009fbaf', '98ca1e27-efc5-4f69-a768-51556f621eb1'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:08:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7583a5ce-5420-40ce-967a-c892097fa47a tempest-CreateVolumesFromImageTest-1417987421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7583a5ce-5420-40ce-967a-c892097fa47a tempest-CreateVolumesFromImageTest-1417987421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:50 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7583a5ce-5420-40ce-967a-c892097fa47a tempest-CreateVolumesFromImageTest-1417987421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:50 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7583a5ce-5420-40ce-967a-c892097fa47a tempest-CreateVolumesFromImageTest-1417987421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7583a5ce-5420-40ce-967a-c892097fa47a tempest-CreateVolumesFromImageTest-1417987421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7583a5ce-5420-40ce-967a-c892097fa47a tempest-CreateVolumesFromImageTest-1417987421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:50 devstack sudo[104634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:08:50 devstack sudo[104634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c5c23ffe-c1db-4956-b437-3919d9f91946 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c5c23ffe-c1db-4956-b437-3919d9f91946 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:50 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c5c23ffe-c1db-4956-b437-3919d9f91946 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:50 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c5c23ffe-c1db-4956-b437-3919d9f91946 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c5c23ffe-c1db-4956-b437-3919d9f91946 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c5c23ffe-c1db-4956-b437-3919d9f91946 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:50 devstack sudo[104627]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3cbe8bfb-d633-4a86-be17-13cac44b9639 tempest-TestMinimumBasicScenario-1546684596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-84955917-c572-4297-98c7-e17bdafc941b" returned: 0 in 0.492s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3cbe8bfb-d633-4a86-be17-13cac44b9639 tempest-TestMinimumBasicScenario-1546684596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-84955917-c572-4297-98c7-e17bdafc941b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:50 devstack sudo[104636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:08:50 devstack sudo[104636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:50 devstack sudo[104637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-84955917-c572-4297-98c7-e17bdafc941b Sep 28 15:08:50 devstack sudo[104637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:50 devstack sudo[104634]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7583a5ce-5420-40ce-967a-c892097fa47a tempest-CreateVolumesFromImageTest-1417987421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.318s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:50 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-7583a5ce-5420-40ce-967a-c892097fa47a tempest-CreateVolumesFromImageTest-1417987421 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:08:50 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-7583a5ce-5420-40ce-967a-c892097fa47a tempest-CreateVolumesFromImageTest-1417987421 None] Deleted volume successfully. Sep 28 15:08:50 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7583a5ce-5420-40ce-967a-c892097fa47a tempest-CreateVolumesFromImageTest-1417987421 None] Lock "cinder-08a4c59c-1b00-4377-9ed8-e6e5dd322133-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:50 devstack sudo[104637]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3cbe8bfb-d633-4a86-be17-13cac44b9639 tempest-TestMinimumBasicScenario-1546684596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-84955917-c572-4297-98c7-e17bdafc941b" returned: 0 in 0.319s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:50 devstack sudo[104636]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c5c23ffe-c1db-4956-b437-3919d9f91946 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.355s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:50 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-c5c23ffe-c1db-4956-b437-3919d9f91946 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:08:50 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3cbe8bfb-d633-4a86-be17-13cac44b9639 tempest-TestMinimumBasicScenario-1546684596 None] Lock "cinder-quobyte-84955917-c572-4297-98c7-e17bdafc941b" released by "delete_volume" :: held 0.868s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:50 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-c5c23ffe-c1db-4956-b437-3919d9f91946 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Deleted volume successfully. Sep 28 15:08:50 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c5c23ffe-c1db-4956-b437-3919d9f91946 tempest-CreateVolumesFromSourceVolumeTest-876782771 None] Lock "cinder-8c6a82cf-7b38-45bf-a72d-a3e04dd9c7e4-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:50 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-3cbe8bfb-d633-4a86-be17-13cac44b9639 tempest-TestMinimumBasicScenario-1546684596 None] Created reservations ['2233a83e-fdea-4348-b72b-8723a3c1e014', '83a24b30-e6ed-43f0-bda3-9d4c3efd60e1', 'd194cb97-a74c-443e-9110-58e07c895b72', '9de063a0-7bcf-43c8-bbb3-570a0576aba7'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:08:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3cbe8bfb-d633-4a86-be17-13cac44b9639 tempest-TestMinimumBasicScenario-1546684596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3cbe8bfb-d633-4a86-be17-13cac44b9639 tempest-TestMinimumBasicScenario-1546684596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:50 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3cbe8bfb-d633-4a86-be17-13cac44b9639 tempest-TestMinimumBasicScenario-1546684596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:50 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3cbe8bfb-d633-4a86-be17-13cac44b9639 tempest-TestMinimumBasicScenario-1546684596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3cbe8bfb-d633-4a86-be17-13cac44b9639 tempest-TestMinimumBasicScenario-1546684596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3cbe8bfb-d633-4a86-be17-13cac44b9639 tempest-TestMinimumBasicScenario-1546684596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:50 devstack sudo[104643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:08:50 devstack sudo[104643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:51 devstack sudo[104643]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:51 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-da8218fc-b05c-481e-bf7b-df32f0f1f8fb tempest-CreateVolumesFromImageTest-1417987421 None] Acquiring lock "cinder-d1ab656f-be28-4a56-b360-8297c21de2b3-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3cbe8bfb-d633-4a86-be17-13cac44b9639 tempest-TestMinimumBasicScenario-1546684596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.459s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:51 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-3cbe8bfb-d633-4a86-be17-13cac44b9639 tempest-TestMinimumBasicScenario-1546684596 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:08:51 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-3cbe8bfb-d633-4a86-be17-13cac44b9639 tempest-TestMinimumBasicScenario-1546684596 None] Deleted volume successfully. Sep 28 15:08:51 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-da8218fc-b05c-481e-bf7b-df32f0f1f8fb tempest-CreateVolumesFromImageTest-1417987421 None] Lock "cinder-d1ab656f-be28-4a56-b360-8297c21de2b3-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:51 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3cbe8bfb-d633-4a86-be17-13cac44b9639 tempest-TestMinimumBasicScenario-1546684596 None] Lock "cinder-84955917-c572-4297-98c7-e17bdafc941b-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:51 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-da8218fc-b05c-481e-bf7b-df32f0f1f8fb tempest-CreateVolumesFromImageTest-1417987421 None] Acquiring lock "cinder-quobyte-d1ab656f-be28-4a56-b360-8297c21de2b3" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:51 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-da8218fc-b05c-481e-bf7b-df32f0f1f8fb tempest-CreateVolumesFromImageTest-1417987421 None] Lock "cinder-quobyte-d1ab656f-be28-4a56-b360-8297c21de2b3" acquired by "delete_volume" :: waited 0.018s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:51 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[5073c6c5-0f94-4258-888d-4d1fde732052]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-da8218fc-b05c-481e-bf7b-df32f0f1f8fb tempest-CreateVolumesFromImageTest-1417987421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-d1ab656f-be28-4a56-b360-8297c21de2b3 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:51 devstack sudo[104650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-d1ab656f-be28-4a56-b360-8297c21de2b3 Sep 28 15:08:51 devstack sudo[104650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:52 devstack sudo[104650]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-da8218fc-b05c-481e-bf7b-df32f0f1f8fb tempest-CreateVolumesFromImageTest-1417987421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-d1ab656f-be28-4a56-b360-8297c21de2b3" returned: 0 in 0.860s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-da8218fc-b05c-481e-bf7b-df32f0f1f8fb tempest-CreateVolumesFromImageTest-1417987421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-d1ab656f-be28-4a56-b360-8297c21de2b3 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:52 devstack sudo[104679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-d1ab656f-be28-4a56-b360-8297c21de2b3 Sep 28 15:08:52 devstack sudo[104679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:52 devstack sudo[104679]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-da8218fc-b05c-481e-bf7b-df32f0f1f8fb tempest-CreateVolumesFromImageTest-1417987421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-d1ab656f-be28-4a56-b360-8297c21de2b3" returned: 0 in 0.501s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:52 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-da8218fc-b05c-481e-bf7b-df32f0f1f8fb tempest-CreateVolumesFromImageTest-1417987421 None] Lock "cinder-quobyte-d1ab656f-be28-4a56-b360-8297c21de2b3" released by "delete_volume" :: held 1.453s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:52 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-da8218fc-b05c-481e-bf7b-df32f0f1f8fb tempest-CreateVolumesFromImageTest-1417987421 None] Created reservations ['e4be2bb0-bbc6-4e38-acee-594ca5c78bc3', '2e2f0def-f370-4c46-8585-932540dd6110', '6c6a5522-1562-45eb-bedd-cbd5c4ee7830', 'd0ab8a9b-acc3-4f36-9197-07a36b1570e0'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:08:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-da8218fc-b05c-481e-bf7b-df32f0f1f8fb tempest-CreateVolumesFromImageTest-1417987421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-da8218fc-b05c-481e-bf7b-df32f0f1f8fb tempest-CreateVolumesFromImageTest-1417987421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-da8218fc-b05c-481e-bf7b-df32f0f1f8fb tempest-CreateVolumesFromImageTest-1417987421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-da8218fc-b05c-481e-bf7b-df32f0f1f8fb tempest-CreateVolumesFromImageTest-1417987421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-da8218fc-b05c-481e-bf7b-df32f0f1f8fb tempest-CreateVolumesFromImageTest-1417987421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-da8218fc-b05c-481e-bf7b-df32f0f1f8fb tempest-CreateVolumesFromImageTest-1417987421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:53 devstack sudo[104684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:08:53 devstack sudo[104684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:53 devstack sudo[104684]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-da8218fc-b05c-481e-bf7b-df32f0f1f8fb tempest-CreateVolumesFromImageTest-1417987421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.395s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:53 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-da8218fc-b05c-481e-bf7b-df32f0f1f8fb tempest-CreateVolumesFromImageTest-1417987421 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:08:53 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-da8218fc-b05c-481e-bf7b-df32f0f1f8fb tempest-CreateVolumesFromImageTest-1417987421 None] Deleted volume successfully. Sep 28 15:08:53 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-da8218fc-b05c-481e-bf7b-df32f0f1f8fb tempest-CreateVolumesFromImageTest-1417987421 None] Lock "cinder-d1ab656f-be28-4a56-b360-8297c21de2b3-delete_volume" released by "delete_volume" :: held 2.247s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:53 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ad55b171-236f-4a3e-b4e7-4b6f2641fd18 tempest-CreateVolumesFromImageTest-1417987421 None] Acquiring lock "cinder-2fdae31d-29a5-4bb5-9cca-16c7c15c5466-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:53 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ad55b171-236f-4a3e-b4e7-4b6f2641fd18 tempest-CreateVolumesFromImageTest-1417987421 None] Lock "cinder-2fdae31d-29a5-4bb5-9cca-16c7c15c5466-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:53 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ad55b171-236f-4a3e-b4e7-4b6f2641fd18 tempest-CreateVolumesFromImageTest-1417987421 None] Acquiring lock "cinder-quobyte-2fdae31d-29a5-4bb5-9cca-16c7c15c5466" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:53 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ad55b171-236f-4a3e-b4e7-4b6f2641fd18 tempest-CreateVolumesFromImageTest-1417987421 None] Lock "cinder-quobyte-2fdae31d-29a5-4bb5-9cca-16c7c15c5466" acquired by "delete_volume" :: waited 0.016s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:53 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[368385f6-1292-4598-a54c-a576fb8c8b61]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ad55b171-236f-4a3e-b4e7-4b6f2641fd18 tempest-CreateVolumesFromImageTest-1417987421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2fdae31d-29a5-4bb5-9cca-16c7c15c5466 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:53 devstack sudo[104687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2fdae31d-29a5-4bb5-9cca-16c7c15c5466 Sep 28 15:08:53 devstack sudo[104687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:54 devstack sudo[104687]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ad55b171-236f-4a3e-b4e7-4b6f2641fd18 tempest-CreateVolumesFromImageTest-1417987421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2fdae31d-29a5-4bb5-9cca-16c7c15c5466" returned: 0 in 0.596s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ad55b171-236f-4a3e-b4e7-4b6f2641fd18 tempest-CreateVolumesFromImageTest-1417987421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2fdae31d-29a5-4bb5-9cca-16c7c15c5466 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:54 devstack sudo[104692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2fdae31d-29a5-4bb5-9cca-16c7c15c5466 Sep 28 15:08:54 devstack sudo[104692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:54 devstack sudo[104692]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ad55b171-236f-4a3e-b4e7-4b6f2641fd18 tempest-CreateVolumesFromImageTest-1417987421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2fdae31d-29a5-4bb5-9cca-16c7c15c5466" returned: 0 in 0.431s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:54 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ad55b171-236f-4a3e-b4e7-4b6f2641fd18 tempest-CreateVolumesFromImageTest-1417987421 None] Lock "cinder-quobyte-2fdae31d-29a5-4bb5-9cca-16c7c15c5466" released by "delete_volume" :: held 1.093s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:54 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-ad55b171-236f-4a3e-b4e7-4b6f2641fd18 tempest-CreateVolumesFromImageTest-1417987421 None] Created reservations ['74f6316d-2491-4f3e-83c4-a191192d96d3', 'e559bb84-2041-4995-a09b-4fa669945572', '90cdb491-173a-45f2-bbe0-1513326a02b3', '300dad6b-cd4c-49d9-b7b9-61d124990e9b'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:08:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ad55b171-236f-4a3e-b4e7-4b6f2641fd18 tempest-CreateVolumesFromImageTest-1417987421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ad55b171-236f-4a3e-b4e7-4b6f2641fd18 tempest-CreateVolumesFromImageTest-1417987421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:54 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ad55b171-236f-4a3e-b4e7-4b6f2641fd18 tempest-CreateVolumesFromImageTest-1417987421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:54 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ad55b171-236f-4a3e-b4e7-4b6f2641fd18 tempest-CreateVolumesFromImageTest-1417987421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ad55b171-236f-4a3e-b4e7-4b6f2641fd18 tempest-CreateVolumesFromImageTest-1417987421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ad55b171-236f-4a3e-b4e7-4b6f2641fd18 tempest-CreateVolumesFromImageTest-1417987421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:54 devstack sudo[104695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:08:54 devstack sudo[104695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:55 devstack sudo[104695]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ad55b171-236f-4a3e-b4e7-4b6f2641fd18 tempest-CreateVolumesFromImageTest-1417987421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.309s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:55 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-ad55b171-236f-4a3e-b4e7-4b6f2641fd18 tempest-CreateVolumesFromImageTest-1417987421 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:08:55 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-ad55b171-236f-4a3e-b4e7-4b6f2641fd18 tempest-CreateVolumesFromImageTest-1417987421 None] Deleted volume successfully. Sep 28 15:08:55 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ad55b171-236f-4a3e-b4e7-4b6f2641fd18 tempest-CreateVolumesFromImageTest-1417987421 None] Lock "cinder-2fdae31d-29a5-4bb5-9cca-16c7c15c5466-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:55 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-422ea61f-0420-422f-b3ee-b4eedd8eb470 tempest-CreateVolumesFromImageTest-1417987421 None] Acquiring lock "cinder-f5b2919f-d1e6-426a-b0d2-671aded91a31-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:55 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-422ea61f-0420-422f-b3ee-b4eedd8eb470 tempest-CreateVolumesFromImageTest-1417987421 None] Lock "cinder-f5b2919f-d1e6-426a-b0d2-671aded91a31-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:55 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-422ea61f-0420-422f-b3ee-b4eedd8eb470 tempest-CreateVolumesFromImageTest-1417987421 None] Acquiring lock "cinder-quobyte-f5b2919f-d1e6-426a-b0d2-671aded91a31" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:55 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-422ea61f-0420-422f-b3ee-b4eedd8eb470 tempest-CreateVolumesFromImageTest-1417987421 None] Lock "cinder-quobyte-f5b2919f-d1e6-426a-b0d2-671aded91a31" acquired by "delete_volume" :: waited 0.022s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:56 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5dbe86-ede6-43ba-8069-f2b250941480]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-422ea61f-0420-422f-b3ee-b4eedd8eb470 tempest-CreateVolumesFromImageTest-1417987421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f5b2919f-d1e6-426a-b0d2-671aded91a31 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:56 devstack sudo[104698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f5b2919f-d1e6-426a-b0d2-671aded91a31 Sep 28 15:08:56 devstack sudo[104698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:56 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-0be87e3e-cf2a-416e-a47e-839de5c031a6 tempest-VolumeDependencyTests-313388064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:08:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0be87e3e-cf2a-416e-a47e-839de5c031a6 tempest-VolumeDependencyTests-313388064 None] Flow 'volume_create_manager' (e6b75d00-5929-42c0-a756-e9400b47382f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0be87e3e-cf2a-416e-a47e-839de5c031a6 tempest-VolumeDependencyTests-313388064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45995f6b-78d8-4097-af58-6d8d8e4f691f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:56 devstack sudo[104698]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0be87e3e-cf2a-416e-a47e-839de5c031a6 tempest-VolumeDependencyTests-313388064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45995f6b-78d8-4097-af58-6d8d8e4f691f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1506079786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b2ca02a-ddde-447c-a4c4-80a50ea8b382,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a07c72808ff4cfd81d511b17876940f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:57Z,use_quota=True,user_id='d956f6d88f3e4998a30a99694dde885d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0be87e3e-cf2a-416e-a47e-839de5c031a6 tempest-VolumeDependencyTests-313388064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9772506-5d1b-40ce-98af-d2417c3517df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0be87e3e-cf2a-416e-a47e-839de5c031a6 tempest-VolumeDependencyTests-313388064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9772506-5d1b-40ce-98af-d2417c3517df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0be87e3e-cf2a-416e-a47e-839de5c031a6 tempest-VolumeDependencyTests-313388064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51b5fd1d-8f86-4aa6-af15-648f192ad1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0be87e3e-cf2a-416e-a47e-839de5c031a6 tempest-VolumeDependencyTests-313388064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51b5fd1d-8f86-4aa6-af15-648f192ad1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b2ca02a-ddde-447c-a4c4-80a50ea8b382', 'volume_name': 'volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0be87e3e-cf2a-416e-a47e-839de5c031a6 tempest-VolumeDependencyTests-313388064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f18146c1-6aa0-4d95-b93b-6ae50df9debc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0be87e3e-cf2a-416e-a47e-839de5c031a6 tempest-VolumeDependencyTests-313388064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f18146c1-6aa0-4d95-b93b-6ae50df9debc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0be87e3e-cf2a-416e-a47e-839de5c031a6 tempest-VolumeDependencyTests-313388064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8cab013-232f-4bd3-9efd-bc14036b07e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:56 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-0be87e3e-cf2a-416e-a47e-839de5c031a6 tempest-VolumeDependencyTests-313388064 None] Volume 6b2ca02a-ddde-447c-a4c4-80a50ea8b382: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382', 'volume_size': 1} Sep 28 15:08:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0be87e3e-cf2a-416e-a47e-839de5c031a6 tempest-VolumeDependencyTests-313388064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0be87e3e-cf2a-416e-a47e-839de5c031a6 tempest-VolumeDependencyTests-313388064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:56 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0be87e3e-cf2a-416e-a47e-839de5c031a6 tempest-VolumeDependencyTests-313388064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1506079786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b2ca02a-ddde-447c-a4c4-80a50ea8b382,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a07c72808ff4cfd81d511b17876940f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:57Z,use_quota=True,user_id='d956f6d88f3e4998a30a99694dde885d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:08:56 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-0be87e3e-cf2a-416e-a47e-839de5c031a6 tempest-VolumeDependencyTests-313388064 None] Creating volume 6b2ca02a-ddde-447c-a4c4-80a50ea8b382 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:08:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0be87e3e-cf2a-416e-a47e-839de5c031a6 tempest-VolumeDependencyTests-313388064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0be87e3e-cf2a-416e-a47e-839de5c031a6 tempest-VolumeDependencyTests-313388064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:56 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0be87e3e-cf2a-416e-a47e-839de5c031a6 tempest-VolumeDependencyTests-313388064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:56 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0be87e3e-cf2a-416e-a47e-839de5c031a6 tempest-VolumeDependencyTests-313388064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0be87e3e-cf2a-416e-a47e-839de5c031a6 tempest-VolumeDependencyTests-313388064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:56 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0be87e3e-cf2a-416e-a47e-839de5c031a6 tempest-VolumeDependencyTests-313388064 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:08:56 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-0be87e3e-cf2a-416e-a47e-839de5c031a6 tempest-VolumeDependencyTests-313388064 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:08:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0be87e3e-cf2a-416e-a47e-839de5c031a6 tempest-VolumeDependencyTests-313388064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-422ea61f-0420-422f-b3ee-b4eedd8eb470 tempest-CreateVolumesFromImageTest-1417987421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f5b2919f-d1e6-426a-b0d2-671aded91a31" returned: 0 in 0.728s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-422ea61f-0420-422f-b3ee-b4eedd8eb470 tempest-CreateVolumesFromImageTest-1417987421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f5b2919f-d1e6-426a-b0d2-671aded91a31 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:56 devstack sudo[104705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382 1073741824 Sep 28 15:08:56 devstack sudo[104705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:56 devstack sudo[104706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f5b2919f-d1e6-426a-b0d2-671aded91a31 Sep 28 15:08:56 devstack sudo[104706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:57 devstack sudo[104706]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-422ea61f-0420-422f-b3ee-b4eedd8eb470 tempest-CreateVolumesFromImageTest-1417987421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f5b2919f-d1e6-426a-b0d2-671aded91a31" returned: 0 in 0.359s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:57 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-422ea61f-0420-422f-b3ee-b4eedd8eb470 tempest-CreateVolumesFromImageTest-1417987421 None] Lock "cinder-quobyte-f5b2919f-d1e6-426a-b0d2-671aded91a31" released by "delete_volume" :: held 1.165s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:57 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-422ea61f-0420-422f-b3ee-b4eedd8eb470 tempest-CreateVolumesFromImageTest-1417987421 None] Created reservations ['f4a6f30f-b1ab-4a0b-9eb6-7098f8a4df1c', '76859f2b-7de3-49ca-8365-39cb3489c8e7', '9d85e726-d88c-48c6-b794-860ebb1ee2de', 'f4c34da3-e6f9-4810-a64f-ff5360dcf29c'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:08:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-422ea61f-0420-422f-b3ee-b4eedd8eb470 tempest-CreateVolumesFromImageTest-1417987421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-422ea61f-0420-422f-b3ee-b4eedd8eb470 tempest-CreateVolumesFromImageTest-1417987421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-422ea61f-0420-422f-b3ee-b4eedd8eb470 tempest-CreateVolumesFromImageTest-1417987421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-422ea61f-0420-422f-b3ee-b4eedd8eb470 tempest-CreateVolumesFromImageTest-1417987421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-422ea61f-0420-422f-b3ee-b4eedd8eb470 tempest-CreateVolumesFromImageTest-1417987421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-422ea61f-0420-422f-b3ee-b4eedd8eb470 tempest-CreateVolumesFromImageTest-1417987421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:57 devstack sudo[104714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:08:57 devstack sudo[104714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:57 devstack sudo[104705]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0be87e3e-cf2a-416e-a47e-839de5c031a6 tempest-VolumeDependencyTests-313388064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382 1073741824" returned: 0 in 0.655s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0be87e3e-cf2a-416e-a47e-839de5c031a6 tempest-VolumeDependencyTests-313388064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:57 devstack sudo[104716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382 Sep 28 15:08:57 devstack sudo[104716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:57 devstack sudo[104714]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-422ea61f-0420-422f-b3ee-b4eedd8eb470 tempest-CreateVolumesFromImageTest-1417987421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.355s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:57 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-422ea61f-0420-422f-b3ee-b4eedd8eb470 tempest-CreateVolumesFromImageTest-1417987421 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:08:57 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-422ea61f-0420-422f-b3ee-b4eedd8eb470 tempest-CreateVolumesFromImageTest-1417987421 None] Deleted volume successfully. Sep 28 15:08:57 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-422ea61f-0420-422f-b3ee-b4eedd8eb470 tempest-CreateVolumesFromImageTest-1417987421 None] Lock "cinder-f5b2919f-d1e6-426a-b0d2-671aded91a31-delete_volume" released by "delete_volume" :: held 1.820s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:57 devstack sudo[104716]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0be87e3e-cf2a-416e-a47e-839de5c031a6 tempest-VolumeDependencyTests-313388064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382" returned: 0 in 0.328s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0be87e3e-cf2a-416e-a47e-839de5c031a6 tempest-VolumeDependencyTests-313388064 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:08:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0be87e3e-cf2a-416e-a47e-839de5c031a6 tempest-VolumeDependencyTests-313388064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0be87e3e-cf2a-416e-a47e-839de5c031a6 tempest-VolumeDependencyTests-313388064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8cab013-232f-4bd3-9efd-bc14036b07e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0be87e3e-cf2a-416e-a47e-839de5c031a6 tempest-VolumeDependencyTests-313388064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a378b70-b67d-4676-adf3-1fe559e0b7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:57 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-0be87e3e-cf2a-416e-a47e-839de5c031a6 tempest-VolumeDependencyTests-313388064 None] Volume volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382 (6b2ca02a-ddde-447c-a4c4-80a50ea8b382): created successfully Sep 28 15:08:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0be87e3e-cf2a-416e-a47e-839de5c031a6 tempest-VolumeDependencyTests-313388064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a378b70-b67d-4676-adf3-1fe559e0b7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0be87e3e-cf2a-416e-a47e-839de5c031a6 tempest-VolumeDependencyTests-313388064 None] Flow 'volume_create_manager' (e6b75d00-5929-42c0-a756-e9400b47382f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:57 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-0be87e3e-cf2a-416e-a47e-839de5c031a6 tempest-VolumeDependencyTests-313388064 None] Created volume successfully. Sep 28 15:08:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5ad97470-8f04-4106-a015-e167e23dc5dc tempest-VolumeDependencyTests-313388064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5ad97470-8f04-4106-a015-e167e23dc5dc tempest-VolumeDependencyTests-313388064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-5ad97470-8f04-4106-a015-e167e23dc5dc tempest-VolumeDependencyTests-313388064 None] Creating offline snapshot d80eddfa-487b-47ae-aa20-295e8b64ed3e of volume 6b2ca02a-ddde-447c-a4c4-80a50ea8b382 {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:08:59 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7d3299-fae7-4279-ab3a-50acec922318]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5ad97470-8f04-4106-a015-e167e23dc5dc tempest-VolumeDependencyTests-313388064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:59 devstack sudo[104720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382 Sep 28 15:08:59 devstack sudo[104720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:59 devstack sudo[104720]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5ad97470-8f04-4106-a015-e167e23dc5dc tempest-VolumeDependencyTests-313388064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382" returned: 0 in 0.575s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5ad97470-8f04-4106-a015-e167e23dc5dc tempest-VolumeDependencyTests-313388064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382.d80eddfa-487b-47ae-aa20-295e8b64ed3e 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:59 devstack sudo[104725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382.d80eddfa-487b-47ae-aa20-295e8b64ed3e 1G Sep 28 15:08:59 devstack sudo[104725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:00 devstack sudo[104725]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5ad97470-8f04-4106-a015-e167e23dc5dc tempest-VolumeDependencyTests-313388064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382.d80eddfa-487b-47ae-aa20-295e8b64ed3e 1G" returned: 0 in 0.656s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5ad97470-8f04-4106-a015-e167e23dc5dc tempest-VolumeDependencyTests-313388064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382.d80eddfa-487b-47ae-aa20-295e8b64ed3e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:00 devstack sudo[104731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382.d80eddfa-487b-47ae-aa20-295e8b64ed3e Sep 28 15:09:00 devstack sudo[104731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:00 devstack sudo[104731]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5ad97470-8f04-4106-a015-e167e23dc5dc tempest-VolumeDependencyTests-313388064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382.d80eddfa-487b-47ae-aa20-295e8b64ed3e" returned: 0 in 0.470s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:00 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-5ad97470-8f04-4106-a015-e167e23dc5dc tempest-VolumeDependencyTests-313388064 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382.d80eddfa-487b-47ae-aa20-295e8b64ed3e is being set with open permissions: ugo+rw Sep 28 15:09:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5ad97470-8f04-4106-a015-e167e23dc5dc tempest-VolumeDependencyTests-313388064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382.d80eddfa-487b-47ae-aa20-295e8b64ed3e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:00 devstack sudo[104737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382.d80eddfa-487b-47ae-aa20-295e8b64ed3e Sep 28 15:09:00 devstack sudo[104737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:01 devstack sudo[104737]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5ad97470-8f04-4106-a015-e167e23dc5dc tempest-VolumeDependencyTests-313388064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382.d80eddfa-487b-47ae-aa20-295e8b64ed3e" returned: 0 in 0.363s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5ad97470-8f04-4106-a015-e167e23dc5dc tempest-VolumeDependencyTests-313388064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:01 devstack sudo[104742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382.info Sep 28 15:09:01 devstack sudo[104742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:01 devstack sudo[104742]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5ad97470-8f04-4106-a015-e167e23dc5dc tempest-VolumeDependencyTests-313388064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382.info" returned: 0 in 0.321s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:01 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-5ad97470-8f04-4106-a015-e167e23dc5dc tempest-VolumeDependencyTests-313388064 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382.info is being set with open permissions: ugo+rw Sep 28 15:09:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5ad97470-8f04-4106-a015-e167e23dc5dc tempest-VolumeDependencyTests-313388064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:01 devstack sudo[104745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382.info Sep 28 15:09:01 devstack sudo[104745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:01 devstack sudo[104745]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5ad97470-8f04-4106-a015-e167e23dc5dc tempest-VolumeDependencyTests-313388064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382.info" returned: 0 in 0.294s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5ad97470-8f04-4106-a015-e167e23dc5dc tempest-VolumeDependencyTests-313388064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.822s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:01 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-5ad97470-8f04-4106-a015-e167e23dc5dc tempest-VolumeDependencyTests-313388064 None] Create snapshot completed successfully Sep 28 15:09:02 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d543f26-c2cd-4917-be43-1e89227c6cbe tempest-VolumeDependencyTests-313388064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:09:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3d543f26-c2cd-4917-be43-1e89227c6cbe tempest-VolumeDependencyTests-313388064 None] Flow 'volume_create_manager' (a91c7a1e-8068-407c-812b-1a6a4688bee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3d543f26-c2cd-4917-be43-1e89227c6cbe tempest-VolumeDependencyTests-313388064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98658488-7e7d-45f0-bb06-a301f51ea34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3d543f26-c2cd-4917-be43-1e89227c6cbe tempest-VolumeDependencyTests-313388064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98658488-7e7d-45f0-bb06-a301f51ea34e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1256054297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a941ffe5-68dd-4237-acf0-a585782d07a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a07c72808ff4cfd81d511b17876940f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d80eddfa-487b-47ae-aa20-295e8b64ed3e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:09:03Z,use_quota=True,user_id='d956f6d88f3e4998a30a99694dde885d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3d543f26-c2cd-4917-be43-1e89227c6cbe tempest-VolumeDependencyTests-313388064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4705c6e7-aa20-467f-a963-019aaf0a9ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3d543f26-c2cd-4917-be43-1e89227c6cbe tempest-VolumeDependencyTests-313388064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4705c6e7-aa20-467f-a963-019aaf0a9ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3d543f26-c2cd-4917-be43-1e89227c6cbe tempest-VolumeDependencyTests-313388064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61a1a245-5ed2-42a6-af38-1698b576f222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3d543f26-c2cd-4917-be43-1e89227c6cbe tempest-VolumeDependencyTests-313388064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61a1a245-5ed2-42a6-af38-1698b576f222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a941ffe5-68dd-4237-acf0-a585782d07a6', 'volume_name': 'volume-a941ffe5-68dd-4237-acf0-a585782d07a6', 'volume_size': 1, 'snapshot_id': 'd80eddfa-487b-47ae-aa20-295e8b64ed3e'}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3d543f26-c2cd-4917-be43-1e89227c6cbe tempest-VolumeDependencyTests-313388064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0446b12-8e63-4d3d-aabd-c9012bbd1f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3d543f26-c2cd-4917-be43-1e89227c6cbe tempest-VolumeDependencyTests-313388064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0446b12-8e63-4d3d-aabd-c9012bbd1f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3d543f26-c2cd-4917-be43-1e89227c6cbe tempest-VolumeDependencyTests-313388064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (166e2e48-45a0-4430-9891-a6af1bb8be03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:03 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-3d543f26-c2cd-4917-be43-1e89227c6cbe tempest-VolumeDependencyTests-313388064 None] Volume a941ffe5-68dd-4237-acf0-a585782d07a6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a941ffe5-68dd-4237-acf0-a585782d07a6', 'volume_size': 1, 'snapshot_id': 'd80eddfa-487b-47ae-aa20-295e8b64ed3e'} Sep 28 15:09:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3d543f26-c2cd-4917-be43-1e89227c6cbe tempest-VolumeDependencyTests-313388064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3d543f26-c2cd-4917-be43-1e89227c6cbe tempest-VolumeDependencyTests-313388064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:03 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3d543f26-c2cd-4917-be43-1e89227c6cbe tempest-VolumeDependencyTests-313388064 None] Acquiring lock "cinder-quobyte-d80eddfa-487b-47ae-aa20-295e8b64ed3e-a941ffe5-68dd-4237-acf0-a585782d07a6" by "_create_volume_from_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:03 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3d543f26-c2cd-4917-be43-1e89227c6cbe tempest-VolumeDependencyTests-313388064 None] Lock "cinder-quobyte-d80eddfa-487b-47ae-aa20-295e8b64ed3e-a941ffe5-68dd-4237-acf0-a585782d07a6" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3d543f26-c2cd-4917-be43-1e89227c6cbe tempest-VolumeDependencyTests-313388064 None] Creating volume a941ffe5-68dd-4237-acf0-a585782d07a6 from snapshot d80eddfa-487b-47ae-aa20-295e8b64ed3e {{(pid=87116) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 15:09:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3d543f26-c2cd-4917-be43-1e89227c6cbe tempest-VolumeDependencyTests-313388064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3d543f26-c2cd-4917-be43-1e89227c6cbe tempest-VolumeDependencyTests-313388064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3d543f26-c2cd-4917-be43-1e89227c6cbe tempest-VolumeDependencyTests-313388064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3d543f26-c2cd-4917-be43-1e89227c6cbe tempest-VolumeDependencyTests-313388064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3d543f26-c2cd-4917-be43-1e89227c6cbe tempest-VolumeDependencyTests-313388064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3d543f26-c2cd-4917-be43-1e89227c6cbe tempest-VolumeDependencyTests-313388064 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:09:03 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3d543f26-c2cd-4917-be43-1e89227c6cbe tempest-VolumeDependencyTests-313388064 None] Acquiring lock "cinder-quobyte-a941ffe5-68dd-4237-acf0-a585782d07a6" by "_copy_volume_from_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:03 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3d543f26-c2cd-4917-be43-1e89227c6cbe tempest-VolumeDependencyTests-313388064 None] Lock "cinder-quobyte-a941ffe5-68dd-4237-acf0-a585782d07a6" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3d543f26-c2cd-4917-be43-1e89227c6cbe tempest-VolumeDependencyTests-313388064 None] snapshot: d80eddfa-487b-47ae-aa20-295e8b64ed3e, volume: a941ffe5-68dd-4237-acf0-a585782d07a6, {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 15:09:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3d543f26-c2cd-4917-be43-1e89227c6cbe tempest-VolumeDependencyTests-313388064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3d543f26-c2cd-4917-be43-1e89227c6cbe tempest-VolumeDependencyTests-313388064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3d543f26-c2cd-4917-be43-1e89227c6cbe tempest-VolumeDependencyTests-313388064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3d543f26-c2cd-4917-be43-1e89227c6cbe tempest-VolumeDependencyTests-313388064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3d543f26-c2cd-4917-be43-1e89227c6cbe tempest-VolumeDependencyTests-313388064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:03 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef2aaf7-7278-4b0a-b4f8-141de8e1d2d0]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3d543f26-c2cd-4917-be43-1e89227c6cbe tempest-VolumeDependencyTests-313388064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382.d80eddfa-487b-47ae-aa20-295e8b64ed3e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:03 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebee0daa-1b7c-4445-9c84-8f0a3dce5f71 tempest-ProjectReaderTests-822848790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:09:03 devstack sudo[104749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382.d80eddfa-487b-47ae-aa20-295e8b64ed3e Sep 28 15:09:03 devstack sudo[104749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ebee0daa-1b7c-4445-9c84-8f0a3dce5f71 tempest-ProjectReaderTests-822848790 None] Flow 'volume_create_manager' (ba56cb7d-644c-4a74-93e1-3925bc950361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ebee0daa-1b7c-4445-9c84-8f0a3dce5f71 tempest-ProjectReaderTests-822848790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0116403c-f190-483a-bd27-f4822c198e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ebee0daa-1b7c-4445-9c84-8f0a3dce5f71 tempest-ProjectReaderTests-822848790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0116403c-f190-483a-bd27-f4822c198e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-773712929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79473f60-23f6-449c-a049-6a60ecca346f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32b6575407be4ed29ae977568829f2b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:09:03Z,use_quota=True,user_id='2b6162b48e76476bb0bcb2c07f1e1ba0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ebee0daa-1b7c-4445-9c84-8f0a3dce5f71 tempest-ProjectReaderTests-822848790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40600284-26ca-450a-83d5-b1f0556f3373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ebee0daa-1b7c-4445-9c84-8f0a3dce5f71 tempest-ProjectReaderTests-822848790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40600284-26ca-450a-83d5-b1f0556f3373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ebee0daa-1b7c-4445-9c84-8f0a3dce5f71 tempest-ProjectReaderTests-822848790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (447b8e4e-194c-4b58-b945-f14ee7c21741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ebee0daa-1b7c-4445-9c84-8f0a3dce5f71 tempest-ProjectReaderTests-822848790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (447b8e4e-194c-4b58-b945-f14ee7c21741) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79473f60-23f6-449c-a049-6a60ecca346f', 'volume_name': 'volume-79473f60-23f6-449c-a049-6a60ecca346f', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ebee0daa-1b7c-4445-9c84-8f0a3dce5f71 tempest-ProjectReaderTests-822848790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ed546b8-6598-4abb-9ae8-91232e39153d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ebee0daa-1b7c-4445-9c84-8f0a3dce5f71 tempest-ProjectReaderTests-822848790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ed546b8-6598-4abb-9ae8-91232e39153d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ebee0daa-1b7c-4445-9c84-8f0a3dce5f71 tempest-ProjectReaderTests-822848790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7de9193-ff97-483a-bcd8-b2ded24f0091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:03 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-ebee0daa-1b7c-4445-9c84-8f0a3dce5f71 tempest-ProjectReaderTests-822848790 None] Volume 79473f60-23f6-449c-a049-6a60ecca346f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79473f60-23f6-449c-a049-6a60ecca346f', 'volume_size': 1} Sep 28 15:09:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ebee0daa-1b7c-4445-9c84-8f0a3dce5f71 tempest-ProjectReaderTests-822848790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:03 devstack sudo[104749]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3d543f26-c2cd-4917-be43-1e89227c6cbe tempest-VolumeDependencyTests-313388064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382.d80eddfa-487b-47ae-aa20-295e8b64ed3e" returned: 0 in 0.447s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-3d543f26-c2cd-4917-be43-1e89227c6cbe tempest-VolumeDependencyTests-313388064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:09:03 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[86730ba3-9e74-4f53-a6f7-f6ad0dffa673]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3d543f26-c2cd-4917-be43-1e89227c6cbe tempest-VolumeDependencyTests-313388064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:03 devstack sudo[104755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382 Sep 28 15:09:03 devstack sudo[104755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:04 devstack sudo[104755]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3d543f26-c2cd-4917-be43-1e89227c6cbe tempest-VolumeDependencyTests-313388064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382" returned: 0 in 0.614s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:04 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3d543f26-c2cd-4917-be43-1e89227c6cbe tempest-VolumeDependencyTests-313388064 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382 {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 15:09:04 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3d543f26-c2cd-4917-be43-1e89227c6cbe tempest-VolumeDependencyTests-313388064 None] Creating direct copy from snapshot {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 15:09:04 devstack cinder-volume[87116]: DEBUG cinder.utils [None req-3d543f26-c2cd-4917-be43-1e89227c6cbe tempest-VolumeDependencyTests-313388064 None] Path /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a941ffe5-68dd-4237-acf0-a585782d07a6 not found in is_blk_device check {{(pid=87116) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 15:09:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3d543f26-c2cd-4917-be43-1e89227c6cbe tempest-VolumeDependencyTests-313388064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a941ffe5-68dd-4237-acf0-a585782d07a6 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:04 devstack sudo[104760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a941ffe5-68dd-4237-acf0-a585782d07a6 Sep 28 15:09:04 devstack sudo[104760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:12 devstack sudo[104760]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3d543f26-c2cd-4917-be43-1e89227c6cbe tempest-VolumeDependencyTests-313388064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a941ffe5-68dd-4237-acf0-a585782d07a6" returned: 0 in 8.102s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:12 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-3d543f26-c2cd-4917-be43-1e89227c6cbe tempest-VolumeDependencyTests-313388064 None] Image conversion details: src /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382, size 1024.00 MB, duration 8.10 sec, destination /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a941ffe5-68dd-4237-acf0-a585782d07a6 {{(pid=87116) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:09:12 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-3d543f26-c2cd-4917-be43-1e89227c6cbe tempest-VolumeDependencyTests-313388064 None] Converted 1024.00 MB image at 126.36 MB/s Sep 28 15:09:12 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-3d543f26-c2cd-4917-be43-1e89227c6cbe tempest-VolumeDependencyTests-313388064 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a941ffe5-68dd-4237-acf0-a585782d07a6 is being set with open permissions: ugo+rw Sep 28 15:09:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3d543f26-c2cd-4917-be43-1e89227c6cbe tempest-VolumeDependencyTests-313388064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a941ffe5-68dd-4237-acf0-a585782d07a6 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:12 devstack sudo[104775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a941ffe5-68dd-4237-acf0-a585782d07a6 Sep 28 15:09:12 devstack sudo[104775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:12 devstack sudo[104775]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3d543f26-c2cd-4917-be43-1e89227c6cbe tempest-VolumeDependencyTests-313388064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a941ffe5-68dd-4237-acf0-a585782d07a6" returned: 0 in 0.315s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:12 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3d543f26-c2cd-4917-be43-1e89227c6cbe tempest-VolumeDependencyTests-313388064 None] Lock "cinder-quobyte-a941ffe5-68dd-4237-acf0-a585782d07a6" released by "_copy_volume_from_snapshot" :: held 9.617s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:12 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3d543f26-c2cd-4917-be43-1e89227c6cbe tempest-VolumeDependencyTests-313388064 None] Lock "cinder-quobyte-d80eddfa-487b-47ae-aa20-295e8b64ed3e-a941ffe5-68dd-4237-acf0-a585782d07a6" released by "_create_volume_from_snapshot" :: held 9.716s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3d543f26-c2cd-4917-be43-1e89227c6cbe tempest-VolumeDependencyTests-313388064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.737s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ebee0daa-1b7c-4445-9c84-8f0a3dce5f71 tempest-ProjectReaderTests-822848790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.360s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:12 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ebee0daa-1b7c-4445-9c84-8f0a3dce5f71 tempest-ProjectReaderTests-822848790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-773712929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79473f60-23f6-449c-a049-6a60ecca346f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32b6575407be4ed29ae977568829f2b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:09:03Z,use_quota=True,user_id='2b6162b48e76476bb0bcb2c07f1e1ba0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:09:12 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-ebee0daa-1b7c-4445-9c84-8f0a3dce5f71 tempest-ProjectReaderTests-822848790 None] Creating volume 79473f60-23f6-449c-a049-6a60ecca346f {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:09:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ebee0daa-1b7c-4445-9c84-8f0a3dce5f71 tempest-ProjectReaderTests-822848790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ebee0daa-1b7c-4445-9c84-8f0a3dce5f71 tempest-ProjectReaderTests-822848790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:12 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ebee0daa-1b7c-4445-9c84-8f0a3dce5f71 tempest-ProjectReaderTests-822848790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:12 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ebee0daa-1b7c-4445-9c84-8f0a3dce5f71 tempest-ProjectReaderTests-822848790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ebee0daa-1b7c-4445-9c84-8f0a3dce5f71 tempest-ProjectReaderTests-822848790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:12 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ebee0daa-1b7c-4445-9c84-8f0a3dce5f71 tempest-ProjectReaderTests-822848790 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:09:12 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-ebee0daa-1b7c-4445-9c84-8f0a3dce5f71 tempest-ProjectReaderTests-822848790 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:09:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ebee0daa-1b7c-4445-9c84-8f0a3dce5f71 tempest-ProjectReaderTests-822848790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-79473f60-23f6-449c-a049-6a60ecca346f 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:12 devstack sudo[104778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-79473f60-23f6-449c-a049-6a60ecca346f 1073741824 Sep 28 15:09:12 devstack sudo[104778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3d543f26-c2cd-4917-be43-1e89227c6cbe tempest-VolumeDependencyTests-313388064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (166e2e48-45a0-4430-9891-a6af1bb8be03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a941ffe5-68dd-4237-acf0-a585782d07a6', 'volume_size': 1, 'snapshot_id': 'd80eddfa-487b-47ae-aa20-295e8b64ed3e'}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3d543f26-c2cd-4917-be43-1e89227c6cbe tempest-VolumeDependencyTests-313388064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b48d2c8d-c85a-432e-911f-dfd324d5ca71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:12 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-3d543f26-c2cd-4917-be43-1e89227c6cbe tempest-VolumeDependencyTests-313388064 None] Volume volume-a941ffe5-68dd-4237-acf0-a585782d07a6 (a941ffe5-68dd-4237-acf0-a585782d07a6): created successfully Sep 28 15:09:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3d543f26-c2cd-4917-be43-1e89227c6cbe tempest-VolumeDependencyTests-313388064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b48d2c8d-c85a-432e-911f-dfd324d5ca71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3d543f26-c2cd-4917-be43-1e89227c6cbe tempest-VolumeDependencyTests-313388064 None] Flow 'volume_create_manager' (a91c7a1e-8068-407c-812b-1a6a4688bee1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:13 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-3d543f26-c2cd-4917-be43-1e89227c6cbe tempest-VolumeDependencyTests-313388064 None] Created volume successfully. Sep 28 15:09:13 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-262eeb52-11a0-497a-b379-ce1a4b797044 tempest-VolumeDependencyTests-313388064 None] Acquiring lock "cinder-d80eddfa-487b-47ae-aa20-295e8b64ed3e-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:13 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-262eeb52-11a0-497a-b379-ce1a4b797044 tempest-VolumeDependencyTests-313388064 None] Lock "cinder-d80eddfa-487b-47ae-aa20-295e8b64ed3e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:13 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-262eeb52-11a0-497a-b379-ce1a4b797044 tempest-VolumeDependencyTests-313388064 None] Acquiring lock "cinder-quobyte-6b2ca02a-ddde-447c-a4c4-80a50ea8b382" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:13 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-262eeb52-11a0-497a-b379-ce1a4b797044 tempest-VolumeDependencyTests-313388064 None] Lock "cinder-quobyte-6b2ca02a-ddde-447c-a4c4-80a50ea8b382" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:13 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-262eeb52-11a0-497a-b379-ce1a4b797044 tempest-VolumeDependencyTests-313388064 None] Acquiring lock "cinder-quobyte-d80eddfa-487b-47ae-aa20-295e8b64ed3e" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:13 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-262eeb52-11a0-497a-b379-ce1a4b797044 tempest-VolumeDependencyTests-313388064 None] Lock "cinder-quobyte-d80eddfa-487b-47ae-aa20-295e8b64ed3e" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:13 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-262eeb52-11a0-497a-b379-ce1a4b797044 tempest-VolumeDependencyTests-313388064 None] Deleting offline snapshot d80eddfa-487b-47ae-aa20-295e8b64ed3e of volume 6b2ca02a-ddde-447c-a4c4-80a50ea8b382 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:09:13 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-262eeb52-11a0-497a-b379-ce1a4b797044 tempest-VolumeDependencyTests-313388064 None] snapshot_file for this snap is: volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382.d80eddfa-487b-47ae-aa20-295e8b64ed3e {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:09:13 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[729c5997-9823-4ac8-a4f1-ba42f4cb15f0]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-262eeb52-11a0-497a-b379-ce1a4b797044 tempest-VolumeDependencyTests-313388064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382.d80eddfa-487b-47ae-aa20-295e8b64ed3e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:13 devstack sudo[104783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382.d80eddfa-487b-47ae-aa20-295e8b64ed3e Sep 28 15:09:13 devstack sudo[104783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:13 devstack sudo[104778]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ebee0daa-1b7c-4445-9c84-8f0a3dce5f71 tempest-ProjectReaderTests-822848790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-79473f60-23f6-449c-a049-6a60ecca346f 1073741824" returned: 0 in 0.630s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ebee0daa-1b7c-4445-9c84-8f0a3dce5f71 tempest-ProjectReaderTests-822848790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-79473f60-23f6-449c-a049-6a60ecca346f {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:13 devstack sudo[104786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-79473f60-23f6-449c-a049-6a60ecca346f Sep 28 15:09:13 devstack sudo[104786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:13 devstack sudo[104783]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-262eeb52-11a0-497a-b379-ce1a4b797044 tempest-VolumeDependencyTests-313388064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382.d80eddfa-487b-47ae-aa20-295e8b64ed3e" returned: 0 in 0.492s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:13 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-262eeb52-11a0-497a-b379-ce1a4b797044 tempest-VolumeDependencyTests-313388064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:09:13 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e0d76b-95e0-45a7-b24b-185082c9428c]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-262eeb52-11a0-497a-b379-ce1a4b797044 tempest-VolumeDependencyTests-313388064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:13 devstack sudo[104786]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ebee0daa-1b7c-4445-9c84-8f0a3dce5f71 tempest-ProjectReaderTests-822848790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-79473f60-23f6-449c-a049-6a60ecca346f" returned: 0 in 0.351s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:13 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ebee0daa-1b7c-4445-9c84-8f0a3dce5f71 tempest-ProjectReaderTests-822848790 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:09:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ebee0daa-1b7c-4445-9c84-8f0a3dce5f71 tempest-ProjectReaderTests-822848790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:13 devstack sudo[104791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382 Sep 28 15:09:13 devstack sudo[104791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:13 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ebee0daa-1b7c-4445-9c84-8f0a3dce5f71 tempest-ProjectReaderTests-822848790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7de9193-ff97-483a-bcd8-b2ded24f0091) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79473f60-23f6-449c-a049-6a60ecca346f', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:13 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ebee0daa-1b7c-4445-9c84-8f0a3dce5f71 tempest-ProjectReaderTests-822848790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73e7bef8-fd86-438d-aef3-f46d304665ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:13 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-ebee0daa-1b7c-4445-9c84-8f0a3dce5f71 tempest-ProjectReaderTests-822848790 None] Volume volume-79473f60-23f6-449c-a049-6a60ecca346f (79473f60-23f6-449c-a049-6a60ecca346f): created successfully Sep 28 15:09:13 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ebee0daa-1b7c-4445-9c84-8f0a3dce5f71 tempest-ProjectReaderTests-822848790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73e7bef8-fd86-438d-aef3-f46d304665ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:13 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ebee0daa-1b7c-4445-9c84-8f0a3dce5f71 tempest-ProjectReaderTests-822848790 None] Flow 'volume_create_manager' (ba56cb7d-644c-4a74-93e1-3925bc950361) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:13 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-ebee0daa-1b7c-4445-9c84-8f0a3dce5f71 tempest-ProjectReaderTests-822848790 None] Created volume successfully. Sep 28 15:09:14 devstack sudo[104791]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-262eeb52-11a0-497a-b379-ce1a4b797044 tempest-VolumeDependencyTests-313388064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382" returned: 0 in 0.674s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-262eeb52-11a0-497a-b379-ce1a4b797044 tempest-VolumeDependencyTests-313388064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382.d80eddfa-487b-47ae-aa20-295e8b64ed3e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:14 devstack sudo[104797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382.d80eddfa-487b-47ae-aa20-295e8b64ed3e Sep 28 15:09:14 devstack sudo[104797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:14 devstack sudo[104797]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-262eeb52-11a0-497a-b379-ce1a4b797044 tempest-VolumeDependencyTests-313388064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382.d80eddfa-487b-47ae-aa20-295e8b64ed3e" returned: 0 in 0.508s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-262eeb52-11a0-497a-b379-ce1a4b797044 tempest-VolumeDependencyTests-313388064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382.d80eddfa-487b-47ae-aa20-295e8b64ed3e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:14 devstack sudo[104803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382.d80eddfa-487b-47ae-aa20-295e8b64ed3e Sep 28 15:09:14 devstack sudo[104803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-bb0f26cf-57db-4988-84a7-921f23a3aac6 tempest-ProjectReaderTests-822848790 None] Acquiring lock "cinder-79473f60-23f6-449c-a049-6a60ecca346f-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-bb0f26cf-57db-4988-84a7-921f23a3aac6 tempest-ProjectReaderTests-822848790 None] Lock "cinder-79473f60-23f6-449c-a049-6a60ecca346f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-bb0f26cf-57db-4988-84a7-921f23a3aac6 tempest-ProjectReaderTests-822848790 None] Acquiring lock "cinder-quobyte-79473f60-23f6-449c-a049-6a60ecca346f" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-bb0f26cf-57db-4988-84a7-921f23a3aac6 tempest-ProjectReaderTests-822848790 None] Lock "cinder-quobyte-79473f60-23f6-449c-a049-6a60ecca346f" acquired by "delete_volume" :: waited 0.016s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:15 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03ef053-2b81-49b0-94d5-81caaa3ff63f]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bb0f26cf-57db-4988-84a7-921f23a3aac6 tempest-ProjectReaderTests-822848790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-79473f60-23f6-449c-a049-6a60ecca346f {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:15 devstack sudo[104803]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-262eeb52-11a0-497a-b379-ce1a4b797044 tempest-VolumeDependencyTests-313388064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382.d80eddfa-487b-47ae-aa20-295e8b64ed3e" returned: 0 in 0.468s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:15 devstack sudo[104805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-79473f60-23f6-449c-a049-6a60ecca346f Sep 28 15:09:15 devstack sudo[104805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-262eeb52-11a0-497a-b379-ce1a4b797044 tempest-VolumeDependencyTests-313388064 None] Lock "cinder-quobyte-d80eddfa-487b-47ae-aa20-295e8b64ed3e" released by "_delete_snapshot" :: held 2.306s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-262eeb52-11a0-497a-b379-ce1a4b797044 tempest-VolumeDependencyTests-313388064 None] Lock "cinder-quobyte-6b2ca02a-ddde-447c-a4c4-80a50ea8b382" released by "delete_snapshot" :: held 2.340s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:15 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-262eeb52-11a0-497a-b379-ce1a4b797044 tempest-VolumeDependencyTests-313388064 None] Created reservations ['3fc6abe4-2f5c-4db1-823b-77530fa55a71', 'f3491098-1593-47ca-9ef0-14da103c9a8f', 'a9634ca7-0490-4a61-8eb4-8d24c49ce157', '8a9ebd1b-0194-4c38-b392-413208c1a32c'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:09:15 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-262eeb52-11a0-497a-b379-ce1a4b797044 tempest-VolumeDependencyTests-313388064 None] Delete snapshot completed successfully. Sep 28 15:09:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-262eeb52-11a0-497a-b379-ce1a4b797044 tempest-VolumeDependencyTests-313388064 None] Lock "cinder-d80eddfa-487b-47ae-aa20-295e8b64ed3e-delete_snapshot" released by "delete_snapshot" :: held 2.562s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:15 devstack sudo[104805]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bb0f26cf-57db-4988-84a7-921f23a3aac6 tempest-ProjectReaderTests-822848790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-79473f60-23f6-449c-a049-6a60ecca346f" returned: 0 in 0.500s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bb0f26cf-57db-4988-84a7-921f23a3aac6 tempest-ProjectReaderTests-822848790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-79473f60-23f6-449c-a049-6a60ecca346f {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:15 devstack sudo[104811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-79473f60-23f6-449c-a049-6a60ecca346f Sep 28 15:09:15 devstack sudo[104811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:16 devstack sudo[104811]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bb0f26cf-57db-4988-84a7-921f23a3aac6 tempest-ProjectReaderTests-822848790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-79473f60-23f6-449c-a049-6a60ecca346f" returned: 0 in 0.320s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:16 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-bb0f26cf-57db-4988-84a7-921f23a3aac6 tempest-ProjectReaderTests-822848790 None] Lock "cinder-quobyte-79473f60-23f6-449c-a049-6a60ecca346f" released by "delete_volume" :: held 0.903s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:16 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-bb0f26cf-57db-4988-84a7-921f23a3aac6 tempest-ProjectReaderTests-822848790 None] Created reservations ['5501bc13-a560-4696-b59c-1a15060c1416', 'c8448cfd-13a9-41c3-bd96-a424e0520dc3', '8b312d0e-f952-4082-89ef-32d43939ee3d', '413113fe-31f8-41da-8b16-0736076071e9'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:09:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bb0f26cf-57db-4988-84a7-921f23a3aac6 tempest-ProjectReaderTests-822848790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bb0f26cf-57db-4988-84a7-921f23a3aac6 tempest-ProjectReaderTests-822848790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:16 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-bb0f26cf-57db-4988-84a7-921f23a3aac6 tempest-ProjectReaderTests-822848790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:16 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-bb0f26cf-57db-4988-84a7-921f23a3aac6 tempest-ProjectReaderTests-822848790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bb0f26cf-57db-4988-84a7-921f23a3aac6 tempest-ProjectReaderTests-822848790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bb0f26cf-57db-4988-84a7-921f23a3aac6 tempest-ProjectReaderTests-822848790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:16 devstack sudo[104814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:09:16 devstack sudo[104814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:16 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-33326e02-9420-46b9-9459-1b344c453d52 tempest-VolumeDependencyTests-313388064 None] Acquiring lock "cinder-6b2ca02a-ddde-447c-a4c4-80a50ea8b382-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:16 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-33326e02-9420-46b9-9459-1b344c453d52 tempest-VolumeDependencyTests-313388064 None] Lock "cinder-6b2ca02a-ddde-447c-a4c4-80a50ea8b382-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:16 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-33326e02-9420-46b9-9459-1b344c453d52 tempest-VolumeDependencyTests-313388064 None] Acquiring lock "cinder-quobyte-6b2ca02a-ddde-447c-a4c4-80a50ea8b382" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:16 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-33326e02-9420-46b9-9459-1b344c453d52 tempest-VolumeDependencyTests-313388064 None] Lock "cinder-quobyte-6b2ca02a-ddde-447c-a4c4-80a50ea8b382" acquired by "delete_volume" :: waited 0.017s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:16 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0a0384-02fa-4df1-9c8f-06f73d6bcd1a]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-33326e02-9420-46b9-9459-1b344c453d52 tempest-VolumeDependencyTests-313388064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:16 devstack sudo[104816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382 Sep 28 15:09:16 devstack sudo[104816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:16 devstack sudo[104814]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bb0f26cf-57db-4988-84a7-921f23a3aac6 tempest-ProjectReaderTests-822848790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.488s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:16 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-bb0f26cf-57db-4988-84a7-921f23a3aac6 tempest-ProjectReaderTests-822848790 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:09:16 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-bb0f26cf-57db-4988-84a7-921f23a3aac6 tempest-ProjectReaderTests-822848790 None] Deleted volume successfully. Sep 28 15:09:16 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-bb0f26cf-57db-4988-84a7-921f23a3aac6 tempest-ProjectReaderTests-822848790 None] Lock "cinder-79473f60-23f6-449c-a049-6a60ecca346f-delete_volume" released by "delete_volume" :: held 1.772s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:17 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:09:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:17 devstack sudo[104819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:09:17 devstack sudo[104819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:17 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-b24b9ac3-25c6-4214-b101-fb507d3a4193 tempest-ProjectReaderTests-822848790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:09:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b24b9ac3-25c6-4214-b101-fb507d3a4193 tempest-ProjectReaderTests-822848790 None] Flow 'volume_create_manager' (3e2cd0e7-b712-4d5d-8c76-204f8bfc40e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b24b9ac3-25c6-4214-b101-fb507d3a4193 tempest-ProjectReaderTests-822848790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d1af911-5487-4634-87ed-c177a42457f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:17 devstack sudo[104816]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b24b9ac3-25c6-4214-b101-fb507d3a4193 tempest-ProjectReaderTests-822848790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d1af911-5487-4634-87ed-c177a42457f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:09:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1260655348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d6de3b5-a01b-47cb-b0be-a46594c9ff26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32b6575407be4ed29ae977568829f2b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:09:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:09:17Z,use_quota=True,user_id='2b6162b48e76476bb0bcb2c07f1e1ba0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b24b9ac3-25c6-4214-b101-fb507d3a4193 tempest-ProjectReaderTests-822848790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a97482f-0a84-48a0-ac4f-3ec7e4c53eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b24b9ac3-25c6-4214-b101-fb507d3a4193 tempest-ProjectReaderTests-822848790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a97482f-0a84-48a0-ac4f-3ec7e4c53eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b24b9ac3-25c6-4214-b101-fb507d3a4193 tempest-ProjectReaderTests-822848790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7306ffd5-2654-4bae-9f3a-92ab9a397f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b24b9ac3-25c6-4214-b101-fb507d3a4193 tempest-ProjectReaderTests-822848790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7306ffd5-2654-4bae-9f3a-92ab9a397f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d6de3b5-a01b-47cb-b0be-a46594c9ff26', 'volume_name': 'volume-0d6de3b5-a01b-47cb-b0be-a46594c9ff26', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b24b9ac3-25c6-4214-b101-fb507d3a4193 tempest-ProjectReaderTests-822848790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9892b934-e961-46cc-9232-b3ae894aa7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b24b9ac3-25c6-4214-b101-fb507d3a4193 tempest-ProjectReaderTests-822848790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9892b934-e961-46cc-9232-b3ae894aa7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b24b9ac3-25c6-4214-b101-fb507d3a4193 tempest-ProjectReaderTests-822848790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (521040e2-6ce4-46d2-8a1e-67643d0b7bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:17 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-b24b9ac3-25c6-4214-b101-fb507d3a4193 tempest-ProjectReaderTests-822848790 None] Volume 0d6de3b5-a01b-47cb-b0be-a46594c9ff26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d6de3b5-a01b-47cb-b0be-a46594c9ff26', 'volume_size': 1} Sep 28 15:09:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b24b9ac3-25c6-4214-b101-fb507d3a4193 tempest-ProjectReaderTests-822848790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b24b9ac3-25c6-4214-b101-fb507d3a4193 tempest-ProjectReaderTests-822848790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b24b9ac3-25c6-4214-b101-fb507d3a4193 tempest-ProjectReaderTests-822848790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:09:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1260655348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d6de3b5-a01b-47cb-b0be-a46594c9ff26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32b6575407be4ed29ae977568829f2b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:09:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:09:17Z,use_quota=True,user_id='2b6162b48e76476bb0bcb2c07f1e1ba0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:09:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-b24b9ac3-25c6-4214-b101-fb507d3a4193 tempest-ProjectReaderTests-822848790 None] Creating volume 0d6de3b5-a01b-47cb-b0be-a46594c9ff26 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:09:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b24b9ac3-25c6-4214-b101-fb507d3a4193 tempest-ProjectReaderTests-822848790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b24b9ac3-25c6-4214-b101-fb507d3a4193 tempest-ProjectReaderTests-822848790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b24b9ac3-25c6-4214-b101-fb507d3a4193 tempest-ProjectReaderTests-822848790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b24b9ac3-25c6-4214-b101-fb507d3a4193 tempest-ProjectReaderTests-822848790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b24b9ac3-25c6-4214-b101-fb507d3a4193 tempest-ProjectReaderTests-822848790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b24b9ac3-25c6-4214-b101-fb507d3a4193 tempest-ProjectReaderTests-822848790 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:09:17 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-b24b9ac3-25c6-4214-b101-fb507d3a4193 tempest-ProjectReaderTests-822848790 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:09:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b24b9ac3-25c6-4214-b101-fb507d3a4193 tempest-ProjectReaderTests-822848790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0d6de3b5-a01b-47cb-b0be-a46594c9ff26 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-33326e02-9420-46b9-9459-1b344c453d52 tempest-VolumeDependencyTests-313388064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382" returned: 0 in 0.739s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-33326e02-9420-46b9-9459-1b344c453d52 tempest-VolumeDependencyTests-313388064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:17 devstack sudo[104819]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.382s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:17 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:09:17 devstack sudo[104826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382 Sep 28 15:09:17 devstack sudo[104826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:17 devstack sudo[104825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0d6de3b5-a01b-47cb-b0be-a46594c9ff26 1073741824 Sep 28 15:09:17 devstack sudo[104825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:17 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running periodic task VolumeManager._thread_info {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:09:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] thread count: 28 {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:09:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] thread info: [<_MainThread(MainThread, started 135146735652992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:09:17 devstack sudo[104826]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-33326e02-9420-46b9-9459-1b344c453d52 tempest-VolumeDependencyTests-313388064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6b2ca02a-ddde-447c-a4c4-80a50ea8b382" returned: 0 in 0.409s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:17 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-33326e02-9420-46b9-9459-1b344c453d52 tempest-VolumeDependencyTests-313388064 None] Lock "cinder-quobyte-6b2ca02a-ddde-447c-a4c4-80a50ea8b382" released by "delete_volume" :: held 1.261s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:17 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-33326e02-9420-46b9-9459-1b344c453d52 tempest-VolumeDependencyTests-313388064 None] Created reservations ['c7d59768-35e6-42b2-b052-964024b669a7', '997b67de-997f-4b50-b30e-d44d19f31ce0', 'e3b0649c-c171-40f7-976b-c57acc33a3e0', 'ada8c349-9666-4839-aca0-ebafdbf45dff'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:09:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-33326e02-9420-46b9-9459-1b344c453d52 tempest-VolumeDependencyTests-313388064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-33326e02-9420-46b9-9459-1b344c453d52 tempest-VolumeDependencyTests-313388064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-33326e02-9420-46b9-9459-1b344c453d52 tempest-VolumeDependencyTests-313388064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-33326e02-9420-46b9-9459-1b344c453d52 tempest-VolumeDependencyTests-313388064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-33326e02-9420-46b9-9459-1b344c453d52 tempest-VolumeDependencyTests-313388064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-33326e02-9420-46b9-9459-1b344c453d52 tempest-VolumeDependencyTests-313388064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:18 devstack sudo[104825]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b24b9ac3-25c6-4214-b101-fb507d3a4193 tempest-ProjectReaderTests-822848790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0d6de3b5-a01b-47cb-b0be-a46594c9ff26 1073741824" returned: 0 in 0.680s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:18 devstack sudo[104834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:09:18 devstack sudo[104834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b24b9ac3-25c6-4214-b101-fb507d3a4193 tempest-ProjectReaderTests-822848790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0d6de3b5-a01b-47cb-b0be-a46594c9ff26 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:18 devstack sudo[104836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0d6de3b5-a01b-47cb-b0be-a46594c9ff26 Sep 28 15:09:18 devstack sudo[104836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:18 devstack sudo[104834]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-33326e02-9420-46b9-9459-1b344c453d52 tempest-VolumeDependencyTests-313388064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.347s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:18 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-33326e02-9420-46b9-9459-1b344c453d52 tempest-VolumeDependencyTests-313388064 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:09:18 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-33326e02-9420-46b9-9459-1b344c453d52 tempest-VolumeDependencyTests-313388064 None] Deleted volume successfully. Sep 28 15:09:18 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-33326e02-9420-46b9-9459-1b344c453d52 tempest-VolumeDependencyTests-313388064 None] Lock "cinder-6b2ca02a-ddde-447c-a4c4-80a50ea8b382-delete_volume" released by "delete_volume" :: held 1.938s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:18 devstack sudo[104836]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b24b9ac3-25c6-4214-b101-fb507d3a4193 tempest-ProjectReaderTests-822848790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0d6de3b5-a01b-47cb-b0be-a46594c9ff26" returned: 0 in 0.454s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b24b9ac3-25c6-4214-b101-fb507d3a4193 tempest-ProjectReaderTests-822848790 None] <== create_volume: return (1219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:09:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b24b9ac3-25c6-4214-b101-fb507d3a4193 tempest-ProjectReaderTests-822848790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b24b9ac3-25c6-4214-b101-fb507d3a4193 tempest-ProjectReaderTests-822848790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (521040e2-6ce4-46d2-8a1e-67643d0b7bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d6de3b5-a01b-47cb-b0be-a46594c9ff26', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b24b9ac3-25c6-4214-b101-fb507d3a4193 tempest-ProjectReaderTests-822848790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9994760e-85f7-4f76-8487-c1af3d302086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:18 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-b24b9ac3-25c6-4214-b101-fb507d3a4193 tempest-ProjectReaderTests-822848790 None] Volume volume-0d6de3b5-a01b-47cb-b0be-a46594c9ff26 (0d6de3b5-a01b-47cb-b0be-a46594c9ff26): created successfully Sep 28 15:09:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b24b9ac3-25c6-4214-b101-fb507d3a4193 tempest-ProjectReaderTests-822848790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9994760e-85f7-4f76-8487-c1af3d302086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b24b9ac3-25c6-4214-b101-fb507d3a4193 tempest-ProjectReaderTests-822848790 None] Flow 'volume_create_manager' (3e2cd0e7-b712-4d5d-8c76-204f8bfc40e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:18 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-b24b9ac3-25c6-4214-b101-fb507d3a4193 tempest-ProjectReaderTests-822848790 None] Created volume successfully. Sep 28 15:09:18 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c90714d4-7fae-482c-bb28-468de603847b tempest-VolumeDependencyTests-313388064 None] Acquiring lock "cinder-a941ffe5-68dd-4237-acf0-a585782d07a6-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:18 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c90714d4-7fae-482c-bb28-468de603847b tempest-VolumeDependencyTests-313388064 None] Lock "cinder-a941ffe5-68dd-4237-acf0-a585782d07a6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:18 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c90714d4-7fae-482c-bb28-468de603847b tempest-VolumeDependencyTests-313388064 None] Acquiring lock "cinder-quobyte-a941ffe5-68dd-4237-acf0-a585782d07a6" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:18 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c90714d4-7fae-482c-bb28-468de603847b tempest-VolumeDependencyTests-313388064 None] Lock "cinder-quobyte-a941ffe5-68dd-4237-acf0-a585782d07a6" acquired by "delete_volume" :: waited 0.043s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:18 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16bce63-b14c-4cb1-805a-8b6269ad6da1]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c90714d4-7fae-482c-bb28-468de603847b tempest-VolumeDependencyTests-313388064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a941ffe5-68dd-4237-acf0-a585782d07a6 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:19 devstack sudo[104840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a941ffe5-68dd-4237-acf0-a585782d07a6 Sep 28 15:09:19 devstack sudo[104840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:19 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d94b4e48-1cdb-4501-8956-88ad2da2c845 tempest-ProjectReaderTests-822848790 None] Acquiring lock "cinder-0d6de3b5-a01b-47cb-b0be-a46594c9ff26-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:19 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d94b4e48-1cdb-4501-8956-88ad2da2c845 tempest-ProjectReaderTests-822848790 None] Lock "cinder-0d6de3b5-a01b-47cb-b0be-a46594c9ff26-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:19 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d94b4e48-1cdb-4501-8956-88ad2da2c845 tempest-ProjectReaderTests-822848790 None] Acquiring lock "cinder-quobyte-0d6de3b5-a01b-47cb-b0be-a46594c9ff26" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:19 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d94b4e48-1cdb-4501-8956-88ad2da2c845 tempest-ProjectReaderTests-822848790 None] Lock "cinder-quobyte-0d6de3b5-a01b-47cb-b0be-a46594c9ff26" acquired by "delete_volume" :: waited 0.024s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:19 devstack sudo[104840]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c90714d4-7fae-482c-bb28-468de603847b tempest-VolumeDependencyTests-313388064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a941ffe5-68dd-4237-acf0-a585782d07a6" returned: 0 in 0.564s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c90714d4-7fae-482c-bb28-468de603847b tempest-VolumeDependencyTests-313388064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a941ffe5-68dd-4237-acf0-a585782d07a6 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:19 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[81dbab28-05d6-4f03-ac79-c6ca567d1c9b]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d94b4e48-1cdb-4501-8956-88ad2da2c845 tempest-ProjectReaderTests-822848790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0d6de3b5-a01b-47cb-b0be-a46594c9ff26 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:19 devstack sudo[104846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a941ffe5-68dd-4237-acf0-a585782d07a6 Sep 28 15:09:19 devstack sudo[104846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:19 devstack sudo[104847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0d6de3b5-a01b-47cb-b0be-a46594c9ff26 Sep 28 15:09:19 devstack sudo[104847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:19 devstack sudo[104846]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c90714d4-7fae-482c-bb28-468de603847b tempest-VolumeDependencyTests-313388064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a941ffe5-68dd-4237-acf0-a585782d07a6" returned: 0 in 0.354s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:19 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c90714d4-7fae-482c-bb28-468de603847b tempest-VolumeDependencyTests-313388064 None] Lock "cinder-quobyte-a941ffe5-68dd-4237-acf0-a585782d07a6" released by "delete_volume" :: held 0.978s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:20 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-c90714d4-7fae-482c-bb28-468de603847b tempest-VolumeDependencyTests-313388064 None] Created reservations ['cb03d523-45c2-4cd1-b270-1ff625a68060', 'd77fe285-bec4-4813-93e6-818b09cc6155', 'e32fb3cd-f080-4e32-8d2b-58b944cd70bc', '02cd3156-50c0-46ff-9439-f816fc83e9f1'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:09:20 devstack sudo[104847]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d94b4e48-1cdb-4501-8956-88ad2da2c845 tempest-ProjectReaderTests-822848790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0d6de3b5-a01b-47cb-b0be-a46594c9ff26" returned: 0 in 0.535s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d94b4e48-1cdb-4501-8956-88ad2da2c845 tempest-ProjectReaderTests-822848790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0d6de3b5-a01b-47cb-b0be-a46594c9ff26 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c90714d4-7fae-482c-bb28-468de603847b tempest-VolumeDependencyTests-313388064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c90714d4-7fae-482c-bb28-468de603847b tempest-VolumeDependencyTests-313388064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:20 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c90714d4-7fae-482c-bb28-468de603847b tempest-VolumeDependencyTests-313388064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:20 devstack sudo[104855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0d6de3b5-a01b-47cb-b0be-a46594c9ff26 Sep 28 15:09:20 devstack sudo[104855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:20 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c90714d4-7fae-482c-bb28-468de603847b tempest-VolumeDependencyTests-313388064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c90714d4-7fae-482c-bb28-468de603847b tempest-VolumeDependencyTests-313388064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c90714d4-7fae-482c-bb28-468de603847b tempest-VolumeDependencyTests-313388064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:20 devstack sudo[104857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:09:20 devstack sudo[104857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:20 devstack sudo[104855]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d94b4e48-1cdb-4501-8956-88ad2da2c845 tempest-ProjectReaderTests-822848790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0d6de3b5-a01b-47cb-b0be-a46594c9ff26" returned: 0 in 0.355s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:20 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d94b4e48-1cdb-4501-8956-88ad2da2c845 tempest-ProjectReaderTests-822848790 None] Lock "cinder-quobyte-0d6de3b5-a01b-47cb-b0be-a46594c9ff26" released by "delete_volume" :: held 0.972s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:20 devstack sudo[104857]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c90714d4-7fae-482c-bb28-468de603847b tempest-VolumeDependencyTests-313388064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.379s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:20 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-c90714d4-7fae-482c-bb28-468de603847b tempest-VolumeDependencyTests-313388064 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:09:20 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-c90714d4-7fae-482c-bb28-468de603847b tempest-VolumeDependencyTests-313388064 None] Deleted volume successfully. Sep 28 15:09:20 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c90714d4-7fae-482c-bb28-468de603847b tempest-VolumeDependencyTests-313388064 None] Lock "cinder-a941ffe5-68dd-4237-acf0-a585782d07a6-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:20 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-d94b4e48-1cdb-4501-8956-88ad2da2c845 tempest-ProjectReaderTests-822848790 None] Created reservations ['6ebe355d-4341-4603-9e78-d646c6afe593', '87a55dda-9bc9-4ea6-9d4b-3d3d71b7a0f4', 'd30ca758-26fa-4b94-80bc-354cf52f9fa3', 'c2ea82c6-02d2-445f-9ff4-63fec621e277'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:09:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d94b4e48-1cdb-4501-8956-88ad2da2c845 tempest-ProjectReaderTests-822848790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d94b4e48-1cdb-4501-8956-88ad2da2c845 tempest-ProjectReaderTests-822848790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:20 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d94b4e48-1cdb-4501-8956-88ad2da2c845 tempest-ProjectReaderTests-822848790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:20 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d94b4e48-1cdb-4501-8956-88ad2da2c845 tempest-ProjectReaderTests-822848790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d94b4e48-1cdb-4501-8956-88ad2da2c845 tempest-ProjectReaderTests-822848790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d94b4e48-1cdb-4501-8956-88ad2da2c845 tempest-ProjectReaderTests-822848790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:20 devstack sudo[104861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:09:20 devstack sudo[104861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:21 devstack sudo[104861]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d94b4e48-1cdb-4501-8956-88ad2da2c845 tempest-ProjectReaderTests-822848790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.305s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:21 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-d94b4e48-1cdb-4501-8956-88ad2da2c845 tempest-ProjectReaderTests-822848790 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:09:21 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-d94b4e48-1cdb-4501-8956-88ad2da2c845 tempest-ProjectReaderTests-822848790 None] Deleted volume successfully. Sep 28 15:09:21 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d94b4e48-1cdb-4501-8956-88ad2da2c845 tempest-ProjectReaderTests-822848790 None] Lock "cinder-0d6de3b5-a01b-47cb-b0be-a46594c9ff26-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:30 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=133,cinder:INSERT=44,cinder:UPDATE=171,cinder:DELETE=17 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:09:31 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=109,cinder:UPDATE=188,cinder:DELETE=15,cinder:INSERT=40 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:09:31 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:09:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] Flow 'volume_create_manager' (1ab90180-5f7f-4fbc-8d1a-d267baaedbcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (104e3ca8-64fd-47c7-aedc-5a98172ad1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (104e3ca8-64fd-47c7-aedc-5a98172ad1a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beb4a7a6-b584-44a8-b98b-d854a3c9ebca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dc9bdf9f44a480e9ef98868417ca068',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:09:31Z,use_quota=True,user_id='10de9b639f3b4a9db9c173a269690f14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a1852ad-9f8f-464a-be85-5c599a75b2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a1852ad-9f8f-464a-be85-5c599a75b2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8937ecae-5c15-4307-979f-23114278fd0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:31 devstack cinder-volume[87116]: DEBUG cinder.image.glance [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] Creating Keystone auth plugin from conf {{(pid=87116) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 15:09:32 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8937ecae-5c15-4307-979f-23114278fd0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'beb4a7a6-b584-44a8-b98b-d854a3c9ebca', 'volume_name': 'volume-beb4a7a6-b584-44a8-b98b-d854a3c9ebca', 'volume_size': 1, 'image_id': '5a839072-fccf-4773-9854-4d5214a1e021', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5a839072-fccf-4773-9854-4d5214a1e021', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a06398fc9c9a518885927ee2294212c7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7dc9bdf9f44a480e9ef98868417ca068', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '170faa099b546fcd83f67576b863291aa73c381b7d7f369e9391947af400243bc09372cb31ad9e14567d25c37028c5396c464a2439b4548253e3fd5757a2b775', 'id': '5a839072-fccf-4773-9854-4d5214a1e021', 'created_at': datetime.datetime(2026, 9, 28, 13, 9, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 9, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a839072-fccf-4773-9854-4d5214a1e021/file', 'properties': {}}, 'image_service': }' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:32 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bd7df71-dcb2-43aa-b223-ba7d105352e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:32 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bd7df71-dcb2-43aa-b223-ba7d105352e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:32 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbba3207-689a-4549-9a05-a46f0b92d30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:32 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] Volume beb4a7a6-b584-44a8-b98b-d854a3c9ebca: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-beb4a7a6-b584-44a8-b98b-d854a3c9ebca', 'volume_size': 1, 'image_id': '5a839072-fccf-4773-9854-4d5214a1e021', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5a839072-fccf-4773-9854-4d5214a1e021', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a06398fc9c9a518885927ee2294212c7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7dc9bdf9f44a480e9ef98868417ca068', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '170faa099b546fcd83f67576b863291aa73c381b7d7f369e9391947af400243bc09372cb31ad9e14567d25c37028c5396c464a2439b4548253e3fd5757a2b775', 'id': '5a839072-fccf-4773-9854-4d5214a1e021', 'created_at': datetime.datetime(2026, 9, 28, 13, 9, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 9, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a839072-fccf-4773-9854-4d5214a1e021/file', 'properties': {}}, 'image_service': } Sep 28 15:09:32 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] Trying to clone beb4a7a6-b584-44a8-b98b-d854a3c9ebca from image 5a839072-fccf-4773-9854-4d5214a1e021 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5a839072-fccf-4773-9854-4d5214a1e021', 'metadata': {}}]). {{(pid=87116) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 15:09:32 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5a839072-fccf-4773-9854-4d5214a1e021_ecywy66adevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87116) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 15:09:32 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] Image download 0.00 MB at 0.00 MB/s Sep 28 15:09:32 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e581df8-252e-44c0-b911-7c18ec5cfbe7]: (4, 'raw') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a839072-fccf-4773-9854-4d5214a1e021_ecywy66adevstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:32 devstack sudo[104870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a839072-fccf-4773-9854-4d5214a1e021_ecywy66adevstack@QuobyteHD Sep 28 15:09:32 devstack sudo[104870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:32 devstack sudo[104870]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a839072-fccf-4773-9854-4d5214a1e021_ecywy66adevstack@QuobyteHD" returned: 0 in 0.592s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a839072-fccf-4773-9854-4d5214a1e021_ecywy66adevstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:33 devstack sudo[104880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a839072-fccf-4773-9854-4d5214a1e021_ecywy66adevstack@QuobyteHD Sep 28 15:09:33 devstack sudo[104880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:33 devstack sudo[104880]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a839072-fccf-4773-9854-4d5214a1e021_ecywy66adevstack@QuobyteHD" returned: 1 in 0.503s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a839072-fccf-4773-9854-4d5214a1e021_ecywy66adevstack@QuobyteHD' failed. Not Retrying. {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:09:33 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] Temporary image 5a839072-fccf-4773-9854-4d5214a1e021 is fetched for user 10de9b639f3b4a9db9c173a269690f14. {{(pid=87116) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 15:09:33 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb2f518d-d885-4eda-8dca-bb1cca1efcc6]: (4, 'raw') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a839072-fccf-4773-9854-4d5214a1e021_ecywy66adevstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:33 devstack sudo[104885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a839072-fccf-4773-9854-4d5214a1e021_ecywy66adevstack@QuobyteHD Sep 28 15:09:33 devstack sudo[104885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:34 devstack sudo[104885]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a839072-fccf-4773-9854-4d5214a1e021_ecywy66adevstack@QuobyteHD" returned: 0 in 0.514s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a839072-fccf-4773-9854-4d5214a1e021_ecywy66adevstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:34 devstack sudo[104889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a839072-fccf-4773-9854-4d5214a1e021_ecywy66adevstack@QuobyteHD Sep 28 15:09:34 devstack sudo[104889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:34 devstack sudo[104889]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a839072-fccf-4773-9854-4d5214a1e021_ecywy66adevstack@QuobyteHD" returned: 1 in 0.492s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a839072-fccf-4773-9854-4d5214a1e021_ecywy66adevstack@QuobyteHD' failed. Not Retrying. {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:09:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:34 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beb4a7a6-b584-44a8-b98b-d854a3c9ebca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dc9bdf9f44a480e9ef98868417ca068',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:09:31Z,use_quota=True,user_id='10de9b639f3b4a9db9c173a269690f14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:09:34 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] Creating volume beb4a7a6-b584-44a8-b98b-d854a3c9ebca {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:09:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:34 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:34 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:34 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:09:34 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:09:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-beb4a7a6-b584-44a8-b98b-d854a3c9ebca 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:34 devstack sudo[104894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-beb4a7a6-b584-44a8-b98b-d854a3c9ebca 1073741824 Sep 28 15:09:34 devstack sudo[104894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:35 devstack sudo[104894]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-beb4a7a6-b584-44a8-b98b-d854a3c9ebca 1073741824" returned: 0 in 0.741s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-beb4a7a6-b584-44a8-b98b-d854a3c9ebca {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:35 devstack sudo[104900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-beb4a7a6-b584-44a8-b98b-d854a3c9ebca Sep 28 15:09:35 devstack sudo[104900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:35 devstack sudo[104900]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-beb4a7a6-b584-44a8-b98b-d854a3c9ebca" returned: 0 in 0.354s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:09:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:35 devstack cinder-volume[87116]: DEBUG cinder.volume.volume_utils [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] Attempting download of 5a839072-fccf-4773-9854-4d5214a1e021 ((None, [{'url': 'file:///opt/stack/data/glance/images/5a839072-fccf-4773-9854-4d5214a1e021', 'metadata': {}}])) to volume beb4a7a6-b584-44a8-b98b-d854a3c9ebca. {{(pid=87116) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1208}} Sep 28 15:09:35 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[eedd06e5-c369-44f0-8e49-84eb5f699b4e]: (4, 'raw') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5a839072-fccf-4773-9854-4d5214a1e021_lz6jodcz {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:36 devstack sudo[104903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5a839072-fccf-4773-9854-4d5214a1e021_lz6jodcz Sep 28 15:09:36 devstack sudo[104903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:36 devstack sudo[104903]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5a839072-fccf-4773-9854-4d5214a1e021_lz6jodcz" returned: 0 in 0.498s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5a839072-fccf-4773-9854-4d5214a1e021_lz6jodcz {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:36 devstack sudo[104907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5a839072-fccf-4773-9854-4d5214a1e021_lz6jodcz Sep 28 15:09:36 devstack sudo[104907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:36 devstack sudo[104907]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5a839072-fccf-4773-9854-4d5214a1e021_lz6jodcz" returned: 1 in 0.433s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5a839072-fccf-4773-9854-4d5214a1e021_lz6jodcz' failed. Not Retrying. {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:09:36 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[924db900-4159-48be-bd5b-6b10b8d93e64]: (4, 'raw') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a839072-fccf-4773-9854-4d5214a1e021_ecywy66adevstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:36 devstack sudo[104911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a839072-fccf-4773-9854-4d5214a1e021_ecywy66adevstack@QuobyteHD Sep 28 15:09:36 devstack sudo[104911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:37 devstack sudo[104911]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a839072-fccf-4773-9854-4d5214a1e021_ecywy66adevstack@QuobyteHD" returned: 0 in 0.474s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a839072-fccf-4773-9854-4d5214a1e021_ecywy66adevstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:37 devstack sudo[104949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a839072-fccf-4773-9854-4d5214a1e021_ecywy66adevstack@QuobyteHD Sep 28 15:09:37 devstack sudo[104949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:37 devstack sudo[104949]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a839072-fccf-4773-9854-4d5214a1e021_ecywy66adevstack@QuobyteHD" returned: 1 in 0.552s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a839072-fccf-4773-9854-4d5214a1e021_ecywy66adevstack@QuobyteHD' failed. Not Retrying. {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:09:37 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] 5a839072-fccf-4773-9854-4d5214a1e021 was raw, converting to qcow2 {{(pid=87116) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 15:09:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5a839072-fccf-4773-9854-4d5214a1e021_ecywy66adevstack@QuobyteHD /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-beb4a7a6-b584-44a8-b98b-d854a3c9ebca {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:37 devstack sudo[104956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5a839072-fccf-4773-9854-4d5214a1e021_ecywy66adevstack@QuobyteHD /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-beb4a7a6-b584-44a8-b98b-d854a3c9ebca Sep 28 15:09:37 devstack sudo[104956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:38 devstack sudo[104956]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5a839072-fccf-4773-9854-4d5214a1e021_ecywy66adevstack@QuobyteHD /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-beb4a7a6-b584-44a8-b98b-d854a3c9ebca" returned: 0 in 0.700s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:38 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5a839072-fccf-4773-9854-4d5214a1e021_ecywy66adevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-beb4a7a6-b584-44a8-b98b-d854a3c9ebca {{(pid=87116) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:09:38 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 15:09:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-beb4a7a6-b584-44a8-b98b-d854a3c9ebca 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:38 devstack sudo[104962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-beb4a7a6-b584-44a8-b98b-d854a3c9ebca 1G Sep 28 15:09:38 devstack sudo[104962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:39 devstack sudo[104962]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-beb4a7a6-b584-44a8-b98b-d854a3c9ebca 1G" returned: 0 in 0.613s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:39 devstack cinder-volume[87116]: DEBUG cinder.volume.volume_utils [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] Downloaded image 5a839072-fccf-4773-9854-4d5214a1e021 ((None, [{'url': 'file:///opt/stack/data/glance/images/5a839072-fccf-4773-9854-4d5214a1e021', 'metadata': {}}])) to volume beb4a7a6-b584-44a8-b98b-d854a3c9ebca successfully. {{(pid=87116) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1253}} Sep 28 15:09:39 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] Temporary image 5a839072-fccf-4773-9854-4d5214a1e021 for user 10de9b639f3b4a9db9c173a269690f14 is deleted. {{(pid=87116) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 15:09:39 devstack cinder-volume[87116]: DEBUG cinder.volume.volume_utils [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] Marking volume beb4a7a6-b584-44a8-b98b-d854a3c9ebca as bootable. {{(pid=87116) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1157}} Sep 28 15:09:39 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] Copying metadata from image 5a839072-fccf-4773-9854-4d5214a1e021 to beb4a7a6-b584-44a8-b98b-d854a3c9ebca. {{(pid=87116) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 15:09:39 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] Creating volume glance metadata for volume beb4a7a6-b584-44a8-b98b-d854a3c9ebca backed by image 5a839072-fccf-4773-9854-4d5214a1e021 with: {'image_id': '5a839072-fccf-4773-9854-4d5214a1e021', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'a06398fc9c9a518885927ee2294212c7', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87116) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 15:09:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbba3207-689a-4549-9a05-a46f0b92d30a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-beb4a7a6-b584-44a8-b98b-d854a3c9ebca', 'volume_size': 1, 'image_id': '5a839072-fccf-4773-9854-4d5214a1e021', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5a839072-fccf-4773-9854-4d5214a1e021', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a06398fc9c9a518885927ee2294212c7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7dc9bdf9f44a480e9ef98868417ca068', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '170faa099b546fcd83f67576b863291aa73c381b7d7f369e9391947af400243bc09372cb31ad9e14567d25c37028c5396c464a2439b4548253e3fd5757a2b775', 'id': '5a839072-fccf-4773-9854-4d5214a1e021', 'created_at': datetime.datetime(2026, 9, 28, 13, 9, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 9, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a839072-fccf-4773-9854-4d5214a1e021/file', 'properties': {}}, 'image_service': }' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4650bd3-b568-4026-962b-767d44107b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:39 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] Volume volume-beb4a7a6-b584-44a8-b98b-d854a3c9ebca (beb4a7a6-b584-44a8-b98b-d854a3c9ebca): created successfully Sep 28 15:09:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4650bd3-b568-4026-962b-767d44107b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] Flow 'volume_create_manager' (1ab90180-5f7f-4fbc-8d1a-d267baaedbcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:39 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-f6913ba3-b335-4835-bab4-ae963c5ff67a tempest-VolumeImageDependencyTests-1120009331 None] Created volume successfully. Sep 28 15:09:40 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-63e85e34-25fe-48f2-ab3e-0f0b65de5ee9 tempest-VolumeImageDependencyTests-1120009331 None] Acquiring lock "cinder-beb4a7a6-b584-44a8-b98b-d854a3c9ebca-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:40 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-63e85e34-25fe-48f2-ab3e-0f0b65de5ee9 tempest-VolumeImageDependencyTests-1120009331 None] Lock "cinder-beb4a7a6-b584-44a8-b98b-d854a3c9ebca-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:40 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-63e85e34-25fe-48f2-ab3e-0f0b65de5ee9 tempest-VolumeImageDependencyTests-1120009331 None] Acquiring lock "cinder-quobyte-beb4a7a6-b584-44a8-b98b-d854a3c9ebca" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:40 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-63e85e34-25fe-48f2-ab3e-0f0b65de5ee9 tempest-VolumeImageDependencyTests-1120009331 None] Lock "cinder-quobyte-beb4a7a6-b584-44a8-b98b-d854a3c9ebca" acquired by "delete_volume" :: waited 0.018s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:40 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50e8333-3299-4cbe-a019-b8f34f1d2c4e]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-63e85e34-25fe-48f2-ab3e-0f0b65de5ee9 tempest-VolumeImageDependencyTests-1120009331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-beb4a7a6-b584-44a8-b98b-d854a3c9ebca {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:40 devstack sudo[104968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-beb4a7a6-b584-44a8-b98b-d854a3c9ebca Sep 28 15:09:40 devstack sudo[104968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:41 devstack sudo[104968]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-63e85e34-25fe-48f2-ab3e-0f0b65de5ee9 tempest-VolumeImageDependencyTests-1120009331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-beb4a7a6-b584-44a8-b98b-d854a3c9ebca" returned: 0 in 0.455s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-63e85e34-25fe-48f2-ab3e-0f0b65de5ee9 tempest-VolumeImageDependencyTests-1120009331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-beb4a7a6-b584-44a8-b98b-d854a3c9ebca {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:41 devstack sudo[104975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-beb4a7a6-b584-44a8-b98b-d854a3c9ebca Sep 28 15:09:41 devstack sudo[104975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:41 devstack sudo[104975]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-63e85e34-25fe-48f2-ab3e-0f0b65de5ee9 tempest-VolumeImageDependencyTests-1120009331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-beb4a7a6-b584-44a8-b98b-d854a3c9ebca" returned: 0 in 0.321s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-63e85e34-25fe-48f2-ab3e-0f0b65de5ee9 tempest-VolumeImageDependencyTests-1120009331 None] Lock "cinder-quobyte-beb4a7a6-b584-44a8-b98b-d854a3c9ebca" released by "delete_volume" :: held 0.844s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:41 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-63e85e34-25fe-48f2-ab3e-0f0b65de5ee9 tempest-VolumeImageDependencyTests-1120009331 None] Created reservations ['789dff75-608d-47fd-9693-3ae53de9a488', '826a1599-7d90-439e-90dc-f1c0489d6098', '324bdfbf-64fb-4316-bea7-7acff8755b4b', 'c84b7903-a1fb-4c56-aad0-102a31c92302'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:09:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-63e85e34-25fe-48f2-ab3e-0f0b65de5ee9 tempest-VolumeImageDependencyTests-1120009331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-63e85e34-25fe-48f2-ab3e-0f0b65de5ee9 tempest-VolumeImageDependencyTests-1120009331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:41 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-63e85e34-25fe-48f2-ab3e-0f0b65de5ee9 tempest-VolumeImageDependencyTests-1120009331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:41 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-63e85e34-25fe-48f2-ab3e-0f0b65de5ee9 tempest-VolumeImageDependencyTests-1120009331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-63e85e34-25fe-48f2-ab3e-0f0b65de5ee9 tempest-VolumeImageDependencyTests-1120009331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-63e85e34-25fe-48f2-ab3e-0f0b65de5ee9 tempest-VolumeImageDependencyTests-1120009331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:41 devstack sudo[104978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:09:41 devstack sudo[104978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:42 devstack sudo[104978]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-63e85e34-25fe-48f2-ab3e-0f0b65de5ee9 tempest-VolumeImageDependencyTests-1120009331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.422s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:42 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-63e85e34-25fe-48f2-ab3e-0f0b65de5ee9 tempest-VolumeImageDependencyTests-1120009331 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:09:42 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-63e85e34-25fe-48f2-ab3e-0f0b65de5ee9 tempest-VolumeImageDependencyTests-1120009331 None] Deleted volume successfully. Sep 28 15:09:42 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-63e85e34-25fe-48f2-ab3e-0f0b65de5ee9 tempest-VolumeImageDependencyTests-1120009331 None] Lock "cinder-beb4a7a6-b584-44a8-b98b-d854a3c9ebca-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:44 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7749e67-0192-45e1-a247-de2ff99f2433 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:09:44 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f7749e67-0192-45e1-a247-de2ff99f2433 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Flow 'volume_create_manager' (1a4b3895-bfa4-4e17-acc8-15e5b637c3f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:44 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f7749e67-0192-45e1-a247-de2ff99f2433 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (519536ee-7bab-4ab4-8bd7-889586d7d844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:44 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f7749e67-0192-45e1-a247-de2ff99f2433 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (519536ee-7bab-4ab4-8bd7-889586d7d844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-137659192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49516da9-31e9-4f1b-8f2c-85e807c806f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='000e6e5341dd4e799e9029eeedb8373a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:09:44Z,use_quota=True,user_id='3bb75a96514e4c9090793e6ea11705e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:44 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f7749e67-0192-45e1-a247-de2ff99f2433 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2db96d56-3f1a-46f3-8245-a23024ebceb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:44 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f7749e67-0192-45e1-a247-de2ff99f2433 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2db96d56-3f1a-46f3-8245-a23024ebceb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:44 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f7749e67-0192-45e1-a247-de2ff99f2433 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94f23972-df5c-4fa3-8eec-ba686dad0a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:44 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f7749e67-0192-45e1-a247-de2ff99f2433 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94f23972-df5c-4fa3-8eec-ba686dad0a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49516da9-31e9-4f1b-8f2c-85e807c806f7', 'volume_name': 'volume-49516da9-31e9-4f1b-8f2c-85e807c806f7', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:44 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f7749e67-0192-45e1-a247-de2ff99f2433 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bddbaaa4-08ca-476f-9b20-04f7881875fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:44 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f7749e67-0192-45e1-a247-de2ff99f2433 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bddbaaa4-08ca-476f-9b20-04f7881875fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:44 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f7749e67-0192-45e1-a247-de2ff99f2433 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d71cb52c-145f-4d5f-a5fc-453bba342b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:44 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-f7749e67-0192-45e1-a247-de2ff99f2433 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Volume 49516da9-31e9-4f1b-8f2c-85e807c806f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49516da9-31e9-4f1b-8f2c-85e807c806f7', 'volume_size': 1} Sep 28 15:09:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f7749e67-0192-45e1-a247-de2ff99f2433 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f7749e67-0192-45e1-a247-de2ff99f2433 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:44 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f7749e67-0192-45e1-a247-de2ff99f2433 tempest-TestServerVolumeAttachmentScenario-1741783026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-137659192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49516da9-31e9-4f1b-8f2c-85e807c806f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='000e6e5341dd4e799e9029eeedb8373a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:09:44Z,use_quota=True,user_id='3bb75a96514e4c9090793e6ea11705e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:09:44 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-f7749e67-0192-45e1-a247-de2ff99f2433 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Creating volume 49516da9-31e9-4f1b-8f2c-85e807c806f7 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:09:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f7749e67-0192-45e1-a247-de2ff99f2433 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f7749e67-0192-45e1-a247-de2ff99f2433 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:44 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f7749e67-0192-45e1-a247-de2ff99f2433 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:44 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f7749e67-0192-45e1-a247-de2ff99f2433 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f7749e67-0192-45e1-a247-de2ff99f2433 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:44 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f7749e67-0192-45e1-a247-de2ff99f2433 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:09:44 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-f7749e67-0192-45e1-a247-de2ff99f2433 tempest-TestServerVolumeAttachmentScenario-1741783026 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:09:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f7749e67-0192-45e1-a247-de2ff99f2433 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-49516da9-31e9-4f1b-8f2c-85e807c806f7 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:44 devstack sudo[104981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-49516da9-31e9-4f1b-8f2c-85e807c806f7 1073741824 Sep 28 15:09:44 devstack sudo[104981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:45 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-f54ed700-af56-4aa9-8b66-bca1223f4d94 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:09:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f54ed700-af56-4aa9-8b66-bca1223f4d94 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Flow 'volume_create_manager' (317b4994-a634-4588-b16f-17aea949e00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f54ed700-af56-4aa9-8b66-bca1223f4d94 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (777c2c57-6999-499a-9998-252c77168401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f54ed700-af56-4aa9-8b66-bca1223f4d94 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (777c2c57-6999-499a-9998-252c77168401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-986816252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8ed775a-f25e-49e9-811a-7936b3fa2e49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='000e6e5341dd4e799e9029eeedb8373a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:09:45Z,use_quota=True,user_id='3bb75a96514e4c9090793e6ea11705e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f54ed700-af56-4aa9-8b66-bca1223f4d94 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98088609-0214-4e57-977f-78bc8b4bbd9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f54ed700-af56-4aa9-8b66-bca1223f4d94 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98088609-0214-4e57-977f-78bc8b4bbd9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f54ed700-af56-4aa9-8b66-bca1223f4d94 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdff4cee-4a25-4bc5-9397-a7789bc306ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f54ed700-af56-4aa9-8b66-bca1223f4d94 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdff4cee-4a25-4bc5-9397-a7789bc306ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8ed775a-f25e-49e9-811a-7936b3fa2e49', 'volume_name': 'volume-c8ed775a-f25e-49e9-811a-7936b3fa2e49', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f54ed700-af56-4aa9-8b66-bca1223f4d94 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2557b7bf-a9aa-4114-99f7-1427c42b05aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f54ed700-af56-4aa9-8b66-bca1223f4d94 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2557b7bf-a9aa-4114-99f7-1427c42b05aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f54ed700-af56-4aa9-8b66-bca1223f4d94 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8900905d-8152-43c0-96ae-4635e58e8fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:45 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-f54ed700-af56-4aa9-8b66-bca1223f4d94 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Volume c8ed775a-f25e-49e9-811a-7936b3fa2e49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8ed775a-f25e-49e9-811a-7936b3fa2e49', 'volume_size': 1} Sep 28 15:09:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f54ed700-af56-4aa9-8b66-bca1223f4d94 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:45 devstack sudo[104981]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f7749e67-0192-45e1-a247-de2ff99f2433 tempest-TestServerVolumeAttachmentScenario-1741783026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-49516da9-31e9-4f1b-8f2c-85e807c806f7 1073741824" returned: 0 in 0.647s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f7749e67-0192-45e1-a247-de2ff99f2433 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-49516da9-31e9-4f1b-8f2c-85e807c806f7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:45 devstack sudo[104987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-49516da9-31e9-4f1b-8f2c-85e807c806f7 Sep 28 15:09:45 devstack sudo[104987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:45 devstack sudo[104987]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f7749e67-0192-45e1-a247-de2ff99f2433 tempest-TestServerVolumeAttachmentScenario-1741783026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-49516da9-31e9-4f1b-8f2c-85e807c806f7" returned: 0 in 0.351s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:45 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f7749e67-0192-45e1-a247-de2ff99f2433 tempest-TestServerVolumeAttachmentScenario-1741783026 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:09:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f7749e67-0192-45e1-a247-de2ff99f2433 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f54ed700-af56-4aa9-8b66-bca1223f4d94 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.502s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:45 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f54ed700-af56-4aa9-8b66-bca1223f4d94 tempest-TestServerVolumeAttachmentScenario-1741783026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-986816252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8ed775a-f25e-49e9-811a-7936b3fa2e49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='000e6e5341dd4e799e9029eeedb8373a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:09:45Z,use_quota=True,user_id='3bb75a96514e4c9090793e6ea11705e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:09:45 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-f54ed700-af56-4aa9-8b66-bca1223f4d94 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Creating volume c8ed775a-f25e-49e9-811a-7936b3fa2e49 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:09:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f54ed700-af56-4aa9-8b66-bca1223f4d94 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f54ed700-af56-4aa9-8b66-bca1223f4d94 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:45 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f54ed700-af56-4aa9-8b66-bca1223f4d94 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:45 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f54ed700-af56-4aa9-8b66-bca1223f4d94 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f54ed700-af56-4aa9-8b66-bca1223f4d94 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:45 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f54ed700-af56-4aa9-8b66-bca1223f4d94 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:09:45 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-f54ed700-af56-4aa9-8b66-bca1223f4d94 tempest-TestServerVolumeAttachmentScenario-1741783026 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:09:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f54ed700-af56-4aa9-8b66-bca1223f4d94 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c8ed775a-f25e-49e9-811a-7936b3fa2e49 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f7749e67-0192-45e1-a247-de2ff99f2433 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d71cb52c-145f-4d5f-a5fc-453bba342b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49516da9-31e9-4f1b-8f2c-85e807c806f7', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:45 devstack sudo[104990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c8ed775a-f25e-49e9-811a-7936b3fa2e49 1073741824 Sep 28 15:09:45 devstack sudo[104990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f7749e67-0192-45e1-a247-de2ff99f2433 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65a4b9b9-30bf-4228-97d3-adf871880895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:45 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-f7749e67-0192-45e1-a247-de2ff99f2433 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Volume volume-49516da9-31e9-4f1b-8f2c-85e807c806f7 (49516da9-31e9-4f1b-8f2c-85e807c806f7): created successfully Sep 28 15:09:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f7749e67-0192-45e1-a247-de2ff99f2433 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65a4b9b9-30bf-4228-97d3-adf871880895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f7749e67-0192-45e1-a247-de2ff99f2433 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Flow 'volume_create_manager' (1a4b3895-bfa4-4e17-acc8-15e5b637c3f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:45 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-f7749e67-0192-45e1-a247-de2ff99f2433 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Created volume successfully. Sep 28 15:09:46 devstack sudo[104990]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f54ed700-af56-4aa9-8b66-bca1223f4d94 tempest-TestServerVolumeAttachmentScenario-1741783026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c8ed775a-f25e-49e9-811a-7936b3fa2e49 1073741824" returned: 0 in 0.668s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f54ed700-af56-4aa9-8b66-bca1223f4d94 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c8ed775a-f25e-49e9-811a-7936b3fa2e49 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:46 devstack sudo[104996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c8ed775a-f25e-49e9-811a-7936b3fa2e49 Sep 28 15:09:46 devstack sudo[104996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:46 devstack sudo[104996]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f54ed700-af56-4aa9-8b66-bca1223f4d94 tempest-TestServerVolumeAttachmentScenario-1741783026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c8ed775a-f25e-49e9-811a-7936b3fa2e49" returned: 0 in 0.299s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:46 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f54ed700-af56-4aa9-8b66-bca1223f4d94 tempest-TestServerVolumeAttachmentScenario-1741783026 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:09:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f54ed700-af56-4aa9-8b66-bca1223f4d94 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f54ed700-af56-4aa9-8b66-bca1223f4d94 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8900905d-8152-43c0-96ae-4635e58e8fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8ed775a-f25e-49e9-811a-7936b3fa2e49', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f54ed700-af56-4aa9-8b66-bca1223f4d94 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65c4c5e8-05e4-4faf-9618-1e7628a11f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:46 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-f54ed700-af56-4aa9-8b66-bca1223f4d94 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Volume volume-c8ed775a-f25e-49e9-811a-7936b3fa2e49 (c8ed775a-f25e-49e9-811a-7936b3fa2e49): created successfully Sep 28 15:09:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f54ed700-af56-4aa9-8b66-bca1223f4d94 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65c4c5e8-05e4-4faf-9618-1e7628a11f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f54ed700-af56-4aa9-8b66-bca1223f4d94 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Flow 'volume_create_manager' (317b4994-a634-4588-b16f-17aea949e00d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:46 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-f54ed700-af56-4aa9-8b66-bca1223f4d94 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Created volume successfully. Sep 28 15:09:56 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:UPDATE=20,cinder:SELECT=19,cinder:INSERT=8,cinder:DELETE=3 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:09:56 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=15,cinder:UPDATE=18,cinder:INSERT=8,cinder:DELETE=1 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:10:17 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:10:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:10:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:10:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:17 devstack sudo[105127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:10:17 devstack sudo[105127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:17 devstack sudo[105127]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.278s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:17 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:10:17 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-d57fdc85-ee4f-4213-8975-13bd2c12d204 tempest-SnapshotDependencyTests-954985534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:10:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d57fdc85-ee4f-4213-8975-13bd2c12d204 tempest-SnapshotDependencyTests-954985534 None] Flow 'volume_create_manager' (4ceeb2ce-3ea8-4f70-b590-341b86019492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:10:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d57fdc85-ee4f-4213-8975-13bd2c12d204 tempest-SnapshotDependencyTests-954985534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85a92c9b-3f7f-4878-adfa-255ce1f3a076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:17 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running periodic task VolumeManager._thread_info {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:10:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] thread count: 28 {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:10:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] thread info: [<_MainThread(MainThread, started 135146735652992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:10:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d57fdc85-ee4f-4213-8975-13bd2c12d204 tempest-SnapshotDependencyTests-954985534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85a92c9b-3f7f-4878-adfa-255ce1f3a076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-907549497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32823f82-2ecb-42e5-af31-07d48efa10cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c646cab87a6f46b997c0d37df93db3be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:10:17Z,use_quota=True,user_id='9ada9afb088d42f384eee49bc54dc1a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d57fdc85-ee4f-4213-8975-13bd2c12d204 tempest-SnapshotDependencyTests-954985534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (033d6286-d1d0-4e23-aa41-dabdfa85e237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d57fdc85-ee4f-4213-8975-13bd2c12d204 tempest-SnapshotDependencyTests-954985534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (033d6286-d1d0-4e23-aa41-dabdfa85e237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d57fdc85-ee4f-4213-8975-13bd2c12d204 tempest-SnapshotDependencyTests-954985534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faacbd47-2833-4b53-86ea-6ee2ab67050d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d57fdc85-ee4f-4213-8975-13bd2c12d204 tempest-SnapshotDependencyTests-954985534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faacbd47-2833-4b53-86ea-6ee2ab67050d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32823f82-2ecb-42e5-af31-07d48efa10cb', 'volume_name': 'volume-32823f82-2ecb-42e5-af31-07d48efa10cb', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d57fdc85-ee4f-4213-8975-13bd2c12d204 tempest-SnapshotDependencyTests-954985534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cee2f6da-9c3d-42a4-9a94-56c2623e7be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d57fdc85-ee4f-4213-8975-13bd2c12d204 tempest-SnapshotDependencyTests-954985534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cee2f6da-9c3d-42a4-9a94-56c2623e7be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d57fdc85-ee4f-4213-8975-13bd2c12d204 tempest-SnapshotDependencyTests-954985534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac6ae5fd-1e30-455c-86a9-d0c6b6d42d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:17 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-d57fdc85-ee4f-4213-8975-13bd2c12d204 tempest-SnapshotDependencyTests-954985534 None] Volume 32823f82-2ecb-42e5-af31-07d48efa10cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32823f82-2ecb-42e5-af31-07d48efa10cb', 'volume_size': 1} Sep 28 15:10:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d57fdc85-ee4f-4213-8975-13bd2c12d204 tempest-SnapshotDependencyTests-954985534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d57fdc85-ee4f-4213-8975-13bd2c12d204 tempest-SnapshotDependencyTests-954985534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d57fdc85-ee4f-4213-8975-13bd2c12d204 tempest-SnapshotDependencyTests-954985534 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-907549497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32823f82-2ecb-42e5-af31-07d48efa10cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c646cab87a6f46b997c0d37df93db3be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:10:17Z,use_quota=True,user_id='9ada9afb088d42f384eee49bc54dc1a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:10:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-d57fdc85-ee4f-4213-8975-13bd2c12d204 tempest-SnapshotDependencyTests-954985534 None] Creating volume 32823f82-2ecb-42e5-af31-07d48efa10cb {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:10:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d57fdc85-ee4f-4213-8975-13bd2c12d204 tempest-SnapshotDependencyTests-954985534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d57fdc85-ee4f-4213-8975-13bd2c12d204 tempest-SnapshotDependencyTests-954985534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d57fdc85-ee4f-4213-8975-13bd2c12d204 tempest-SnapshotDependencyTests-954985534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:10:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d57fdc85-ee4f-4213-8975-13bd2c12d204 tempest-SnapshotDependencyTests-954985534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:10:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d57fdc85-ee4f-4213-8975-13bd2c12d204 tempest-SnapshotDependencyTests-954985534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d57fdc85-ee4f-4213-8975-13bd2c12d204 tempest-SnapshotDependencyTests-954985534 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:10:17 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-d57fdc85-ee4f-4213-8975-13bd2c12d204 tempest-SnapshotDependencyTests-954985534 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:10:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d57fdc85-ee4f-4213-8975-13bd2c12d204 tempest-SnapshotDependencyTests-954985534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-32823f82-2ecb-42e5-af31-07d48efa10cb 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:17 devstack sudo[105130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-32823f82-2ecb-42e5-af31-07d48efa10cb 1073741824 Sep 28 15:10:17 devstack sudo[105130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:17 devstack sudo[105130]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d57fdc85-ee4f-4213-8975-13bd2c12d204 tempest-SnapshotDependencyTests-954985534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-32823f82-2ecb-42e5-af31-07d48efa10cb 1073741824" returned: 0 in 0.442s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d57fdc85-ee4f-4213-8975-13bd2c12d204 tempest-SnapshotDependencyTests-954985534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-32823f82-2ecb-42e5-af31-07d48efa10cb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:17 devstack sudo[105136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-32823f82-2ecb-42e5-af31-07d48efa10cb Sep 28 15:10:17 devstack sudo[105136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:18 devstack sudo[105136]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d57fdc85-ee4f-4213-8975-13bd2c12d204 tempest-SnapshotDependencyTests-954985534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-32823f82-2ecb-42e5-af31-07d48efa10cb" returned: 0 in 0.258s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d57fdc85-ee4f-4213-8975-13bd2c12d204 tempest-SnapshotDependencyTests-954985534 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:10:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d57fdc85-ee4f-4213-8975-13bd2c12d204 tempest-SnapshotDependencyTests-954985534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d57fdc85-ee4f-4213-8975-13bd2c12d204 tempest-SnapshotDependencyTests-954985534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac6ae5fd-1e30-455c-86a9-d0c6b6d42d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32823f82-2ecb-42e5-af31-07d48efa10cb', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d57fdc85-ee4f-4213-8975-13bd2c12d204 tempest-SnapshotDependencyTests-954985534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa7a6532-b5a0-46c7-a116-8fdc16eaa795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:18 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-d57fdc85-ee4f-4213-8975-13bd2c12d204 tempest-SnapshotDependencyTests-954985534 None] Volume volume-32823f82-2ecb-42e5-af31-07d48efa10cb (32823f82-2ecb-42e5-af31-07d48efa10cb): created successfully Sep 28 15:10:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d57fdc85-ee4f-4213-8975-13bd2c12d204 tempest-SnapshotDependencyTests-954985534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa7a6532-b5a0-46c7-a116-8fdc16eaa795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d57fdc85-ee4f-4213-8975-13bd2c12d204 tempest-SnapshotDependencyTests-954985534 None] Flow 'volume_create_manager' (4ceeb2ce-3ea8-4f70-b590-341b86019492) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:10:18 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-d57fdc85-ee4f-4213-8975-13bd2c12d204 tempest-SnapshotDependencyTests-954985534 None] Created volume successfully. Sep 28 15:10:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bdb768ac-4e8d-4c8c-9628-0d987013f1df tempest-SnapshotDependencyTests-954985534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bdb768ac-4e8d-4c8c-9628-0d987013f1df tempest-SnapshotDependencyTests-954985534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-bdb768ac-4e8d-4c8c-9628-0d987013f1df tempest-SnapshotDependencyTests-954985534 None] Creating offline snapshot 17898773-b511-4852-a079-f2c55335d185 of volume 32823f82-2ecb-42e5-af31-07d48efa10cb {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:10:19 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[844635ab-588a-4243-b63d-3436fd4b5210]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bdb768ac-4e8d-4c8c-9628-0d987013f1df tempest-SnapshotDependencyTests-954985534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-32823f82-2ecb-42e5-af31-07d48efa10cb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:19 devstack sudo[105139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-32823f82-2ecb-42e5-af31-07d48efa10cb Sep 28 15:10:19 devstack sudo[105139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:20 devstack sudo[105139]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bdb768ac-4e8d-4c8c-9628-0d987013f1df tempest-SnapshotDependencyTests-954985534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-32823f82-2ecb-42e5-af31-07d48efa10cb" returned: 0 in 0.429s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bdb768ac-4e8d-4c8c-9628-0d987013f1df tempest-SnapshotDependencyTests-954985534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-32823f82-2ecb-42e5-af31-07d48efa10cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-32823f82-2ecb-42e5-af31-07d48efa10cb.17898773-b511-4852-a079-f2c55335d185 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:20 devstack sudo[105144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-32823f82-2ecb-42e5-af31-07d48efa10cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-32823f82-2ecb-42e5-af31-07d48efa10cb.17898773-b511-4852-a079-f2c55335d185 1G Sep 28 15:10:20 devstack sudo[105144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:20 devstack sudo[105144]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bdb768ac-4e8d-4c8c-9628-0d987013f1df tempest-SnapshotDependencyTests-954985534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-32823f82-2ecb-42e5-af31-07d48efa10cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-32823f82-2ecb-42e5-af31-07d48efa10cb.17898773-b511-4852-a079-f2c55335d185 1G" returned: 0 in 0.501s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bdb768ac-4e8d-4c8c-9628-0d987013f1df tempest-SnapshotDependencyTests-954985534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32823f82-2ecb-42e5-af31-07d48efa10cb -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-32823f82-2ecb-42e5-af31-07d48efa10cb.17898773-b511-4852-a079-f2c55335d185 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:20 devstack sudo[105151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32823f82-2ecb-42e5-af31-07d48efa10cb -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-32823f82-2ecb-42e5-af31-07d48efa10cb.17898773-b511-4852-a079-f2c55335d185 Sep 28 15:10:20 devstack sudo[105151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:21 devstack sudo[105151]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bdb768ac-4e8d-4c8c-9628-0d987013f1df tempest-SnapshotDependencyTests-954985534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32823f82-2ecb-42e5-af31-07d48efa10cb -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-32823f82-2ecb-42e5-af31-07d48efa10cb.17898773-b511-4852-a079-f2c55335d185" returned: 0 in 0.332s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:21 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-bdb768ac-4e8d-4c8c-9628-0d987013f1df tempest-SnapshotDependencyTests-954985534 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-32823f82-2ecb-42e5-af31-07d48efa10cb.17898773-b511-4852-a079-f2c55335d185 is being set with open permissions: ugo+rw Sep 28 15:10:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bdb768ac-4e8d-4c8c-9628-0d987013f1df tempest-SnapshotDependencyTests-954985534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-32823f82-2ecb-42e5-af31-07d48efa10cb.17898773-b511-4852-a079-f2c55335d185 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:21 devstack sudo[105156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-32823f82-2ecb-42e5-af31-07d48efa10cb.17898773-b511-4852-a079-f2c55335d185 Sep 28 15:10:21 devstack sudo[105156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:21 devstack sudo[105156]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bdb768ac-4e8d-4c8c-9628-0d987013f1df tempest-SnapshotDependencyTests-954985534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-32823f82-2ecb-42e5-af31-07d48efa10cb.17898773-b511-4852-a079-f2c55335d185" returned: 0 in 0.290s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bdb768ac-4e8d-4c8c-9628-0d987013f1df tempest-SnapshotDependencyTests-954985534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-32823f82-2ecb-42e5-af31-07d48efa10cb.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:21 devstack sudo[105160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-32823f82-2ecb-42e5-af31-07d48efa10cb.info Sep 28 15:10:21 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:21 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bdb768ac-4e8d-4c8c-9628-0d987013f1df tempest-SnapshotDependencyTests-954985534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-32823f82-2ecb-42e5-af31-07d48efa10cb.info" returned: 0 in 0.325s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:21 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-bdb768ac-4e8d-4c8c-9628-0d987013f1df tempest-SnapshotDependencyTests-954985534 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-32823f82-2ecb-42e5-af31-07d48efa10cb.info is being set with open permissions: ugo+rw Sep 28 15:10:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bdb768ac-4e8d-4c8c-9628-0d987013f1df tempest-SnapshotDependencyTests-954985534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-32823f82-2ecb-42e5-af31-07d48efa10cb.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:21 devstack sudo[105165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-32823f82-2ecb-42e5-af31-07d48efa10cb.info Sep 28 15:10:21 devstack sudo[105165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:22 devstack sudo[105165]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bdb768ac-4e8d-4c8c-9628-0d987013f1df tempest-SnapshotDependencyTests-954985534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-32823f82-2ecb-42e5-af31-07d48efa10cb.info" returned: 0 in 0.307s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bdb768ac-4e8d-4c8c-9628-0d987013f1df tempest-SnapshotDependencyTests-954985534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.297s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:22 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-bdb768ac-4e8d-4c8c-9628-0d987013f1df tempest-SnapshotDependencyTests-954985534 None] Create snapshot completed successfully Sep 28 15:10:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-31687dba-e458-453f-b4e4-f50de9fbd753 req-30a2a47c-d7a7-4f12-ad5c-76fd2d7fd2e9 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-31687dba-e458-453f-b4e4-f50de9fbd753 req-30a2a47c-d7a7-4f12-ad5c-76fd2d7fd2e9 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-31687dba-e458-453f-b4e4-f50de9fbd753 req-30a2a47c-d7a7-4f12-ad5c-76fd2d7fd2e9 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-31687dba-e458-453f-b4e4-f50de9fbd753 req-30a2a47c-d7a7-4f12-ad5c-76fd2d7fd2e9 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1', 'name': 'volume-49516da9-31e9-4f1b-8f2c-85e807c806f7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4993847f-3fbf-4dbd-af45-53de082327c1', 'enforce_multipath': True} {{(pid=87116) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:10:23 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-31687dba-e458-453f-b4e4-f50de9fbd753 req-30a2a47c-d7a7-4f12-ad5c-76fd2d7fd2e9 tempest-TestServerVolumeAttachmentScenario-1741783026 None] attachment_update completed successfully. Sep 28 15:10:23 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d98b37c-8d4c-4119-a8f7-fe2be357eec4 tempest-SnapshotDependencyTests-954985534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:10:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1d98b37c-8d4c-4119-a8f7-fe2be357eec4 tempest-SnapshotDependencyTests-954985534 None] Flow 'volume_create_manager' (df30c821-a021-47da-b043-bdbd29e543de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:10:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1d98b37c-8d4c-4119-a8f7-fe2be357eec4 tempest-SnapshotDependencyTests-954985534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c814981-216a-4be1-9a3a-a282803eb56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1d98b37c-8d4c-4119-a8f7-fe2be357eec4 tempest-SnapshotDependencyTests-954985534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c814981-216a-4be1-9a3a-a282803eb56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a40cf92a-7f8b-4adf-83d2-e95a212e566f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c646cab87a6f46b997c0d37df93db3be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=17898773-b511-4852-a079-f2c55335d185,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:10:24Z,use_quota=True,user_id='9ada9afb088d42f384eee49bc54dc1a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1d98b37c-8d4c-4119-a8f7-fe2be357eec4 tempest-SnapshotDependencyTests-954985534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e7f371e-8bf7-4613-b0bc-df3c423a5f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1d98b37c-8d4c-4119-a8f7-fe2be357eec4 tempest-SnapshotDependencyTests-954985534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e7f371e-8bf7-4613-b0bc-df3c423a5f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1d98b37c-8d4c-4119-a8f7-fe2be357eec4 tempest-SnapshotDependencyTests-954985534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (431e4ea9-26c3-47fb-89a5-2a058f843d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1d98b37c-8d4c-4119-a8f7-fe2be357eec4 tempest-SnapshotDependencyTests-954985534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (431e4ea9-26c3-47fb-89a5-2a058f843d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a40cf92a-7f8b-4adf-83d2-e95a212e566f', 'volume_name': 'volume-a40cf92a-7f8b-4adf-83d2-e95a212e566f', 'volume_size': 1, 'snapshot_id': '17898773-b511-4852-a079-f2c55335d185'}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1d98b37c-8d4c-4119-a8f7-fe2be357eec4 tempest-SnapshotDependencyTests-954985534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8660a72a-86fa-492d-b693-8c18b59ac998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1d98b37c-8d4c-4119-a8f7-fe2be357eec4 tempest-SnapshotDependencyTests-954985534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8660a72a-86fa-492d-b693-8c18b59ac998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1d98b37c-8d4c-4119-a8f7-fe2be357eec4 tempest-SnapshotDependencyTests-954985534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8452edb5-7df9-4b1b-9ee0-6fd9f97fa90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:23 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-1d98b37c-8d4c-4119-a8f7-fe2be357eec4 tempest-SnapshotDependencyTests-954985534 None] Volume a40cf92a-7f8b-4adf-83d2-e95a212e566f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a40cf92a-7f8b-4adf-83d2-e95a212e566f', 'volume_size': 1, 'snapshot_id': '17898773-b511-4852-a079-f2c55335d185'} Sep 28 15:10:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1d98b37c-8d4c-4119-a8f7-fe2be357eec4 tempest-SnapshotDependencyTests-954985534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1d98b37c-8d4c-4119-a8f7-fe2be357eec4 tempest-SnapshotDependencyTests-954985534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:23 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1d98b37c-8d4c-4119-a8f7-fe2be357eec4 tempest-SnapshotDependencyTests-954985534 None] Acquiring lock "cinder-quobyte-17898773-b511-4852-a079-f2c55335d185-a40cf92a-7f8b-4adf-83d2-e95a212e566f" by "_create_volume_from_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:23 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1d98b37c-8d4c-4119-a8f7-fe2be357eec4 tempest-SnapshotDependencyTests-954985534 None] Lock "cinder-quobyte-17898773-b511-4852-a079-f2c55335d185-a40cf92a-7f8b-4adf-83d2-e95a212e566f" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:23 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1d98b37c-8d4c-4119-a8f7-fe2be357eec4 tempest-SnapshotDependencyTests-954985534 None] Creating volume a40cf92a-7f8b-4adf-83d2-e95a212e566f from snapshot 17898773-b511-4852-a079-f2c55335d185 {{(pid=87116) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 15:10:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1d98b37c-8d4c-4119-a8f7-fe2be357eec4 tempest-SnapshotDependencyTests-954985534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1d98b37c-8d4c-4119-a8f7-fe2be357eec4 tempest-SnapshotDependencyTests-954985534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:23 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1d98b37c-8d4c-4119-a8f7-fe2be357eec4 tempest-SnapshotDependencyTests-954985534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:10:23 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1d98b37c-8d4c-4119-a8f7-fe2be357eec4 tempest-SnapshotDependencyTests-954985534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:10:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1d98b37c-8d4c-4119-a8f7-fe2be357eec4 tempest-SnapshotDependencyTests-954985534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:23 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1d98b37c-8d4c-4119-a8f7-fe2be357eec4 tempest-SnapshotDependencyTests-954985534 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:10:23 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1d98b37c-8d4c-4119-a8f7-fe2be357eec4 tempest-SnapshotDependencyTests-954985534 None] Acquiring lock "cinder-quobyte-a40cf92a-7f8b-4adf-83d2-e95a212e566f" by "_copy_volume_from_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:23 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1d98b37c-8d4c-4119-a8f7-fe2be357eec4 tempest-SnapshotDependencyTests-954985534 None] Lock "cinder-quobyte-a40cf92a-7f8b-4adf-83d2-e95a212e566f" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:23 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1d98b37c-8d4c-4119-a8f7-fe2be357eec4 tempest-SnapshotDependencyTests-954985534 None] snapshot: 17898773-b511-4852-a079-f2c55335d185, volume: a40cf92a-7f8b-4adf-83d2-e95a212e566f, {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 15:10:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1d98b37c-8d4c-4119-a8f7-fe2be357eec4 tempest-SnapshotDependencyTests-954985534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1d98b37c-8d4c-4119-a8f7-fe2be357eec4 tempest-SnapshotDependencyTests-954985534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:23 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1d98b37c-8d4c-4119-a8f7-fe2be357eec4 tempest-SnapshotDependencyTests-954985534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:10:23 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1d98b37c-8d4c-4119-a8f7-fe2be357eec4 tempest-SnapshotDependencyTests-954985534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:10:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1d98b37c-8d4c-4119-a8f7-fe2be357eec4 tempest-SnapshotDependencyTests-954985534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:23 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1bbe01-2257-4b23-b6bd-e61fe8ac5039]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1d98b37c-8d4c-4119-a8f7-fe2be357eec4 tempest-SnapshotDependencyTests-954985534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-32823f82-2ecb-42e5-af31-07d48efa10cb.17898773-b511-4852-a079-f2c55335d185 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:24 devstack sudo[105594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-32823f82-2ecb-42e5-af31-07d48efa10cb.17898773-b511-4852-a079-f2c55335d185 Sep 28 15:10:24 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:24 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1d98b37c-8d4c-4119-a8f7-fe2be357eec4 tempest-SnapshotDependencyTests-954985534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-32823f82-2ecb-42e5-af31-07d48efa10cb.17898773-b511-4852-a079-f2c55335d185" returned: 0 in 0.495s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:24 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-1d98b37c-8d4c-4119-a8f7-fe2be357eec4 tempest-SnapshotDependencyTests-954985534 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32823f82-2ecb-42e5-af31-07d48efa10cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:10:24 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7149a8-deac-4234-ad11-ed18c60d08bc]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1d98b37c-8d4c-4119-a8f7-fe2be357eec4 tempest-SnapshotDependencyTests-954985534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-32823f82-2ecb-42e5-af31-07d48efa10cb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:24 devstack sudo[105599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-32823f82-2ecb-42e5-af31-07d48efa10cb Sep 28 15:10:24 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:24 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1d98b37c-8d4c-4119-a8f7-fe2be357eec4 tempest-SnapshotDependencyTests-954985534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-32823f82-2ecb-42e5-af31-07d48efa10cb" returned: 0 in 0.463s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:24 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1d98b37c-8d4c-4119-a8f7-fe2be357eec4 tempest-SnapshotDependencyTests-954985534 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-32823f82-2ecb-42e5-af31-07d48efa10cb {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 15:10:24 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1d98b37c-8d4c-4119-a8f7-fe2be357eec4 tempest-SnapshotDependencyTests-954985534 None] Creating direct copy from snapshot {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 15:10:24 devstack cinder-volume[87116]: DEBUG cinder.utils [None req-1d98b37c-8d4c-4119-a8f7-fe2be357eec4 tempest-SnapshotDependencyTests-954985534 None] Path /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a40cf92a-7f8b-4adf-83d2-e95a212e566f not found in is_blk_device check {{(pid=87116) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 15:10:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1d98b37c-8d4c-4119-a8f7-fe2be357eec4 tempest-SnapshotDependencyTests-954985534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-32823f82-2ecb-42e5-af31-07d48efa10cb /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a40cf92a-7f8b-4adf-83d2-e95a212e566f {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:24 devstack sudo[105604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-32823f82-2ecb-42e5-af31-07d48efa10cb /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a40cf92a-7f8b-4adf-83d2-e95a212e566f Sep 28 15:10:24 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-813b05ed-81ca-40a9-8b57-edd9ce277f6f req-5b16b540-9c31-4cdb-a44b-3e82bc18f171 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:31 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1d98b37c-8d4c-4119-a8f7-fe2be357eec4 tempest-SnapshotDependencyTests-954985534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-32823f82-2ecb-42e5-af31-07d48efa10cb /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a40cf92a-7f8b-4adf-83d2-e95a212e566f" returned: 0 in 7.106s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:31 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-1d98b37c-8d4c-4119-a8f7-fe2be357eec4 tempest-SnapshotDependencyTests-954985534 None] Image conversion details: src /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-32823f82-2ecb-42e5-af31-07d48efa10cb, size 1024.00 MB, duration 7.11 sec, destination /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a40cf92a-7f8b-4adf-83d2-e95a212e566f {{(pid=87116) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:10:31 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-1d98b37c-8d4c-4119-a8f7-fe2be357eec4 tempest-SnapshotDependencyTests-954985534 None] Converted 1024.00 MB image at 144.08 MB/s Sep 28 15:10:31 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-1d98b37c-8d4c-4119-a8f7-fe2be357eec4 tempest-SnapshotDependencyTests-954985534 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a40cf92a-7f8b-4adf-83d2-e95a212e566f is being set with open permissions: ugo+rw Sep 28 15:10:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1d98b37c-8d4c-4119-a8f7-fe2be357eec4 tempest-SnapshotDependencyTests-954985534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a40cf92a-7f8b-4adf-83d2-e95a212e566f {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:32 devstack sudo[105632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a40cf92a-7f8b-4adf-83d2-e95a212e566f Sep 28 15:10:32 devstack sudo[105632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:32 devstack sudo[105632]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1d98b37c-8d4c-4119-a8f7-fe2be357eec4 tempest-SnapshotDependencyTests-954985534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a40cf92a-7f8b-4adf-83d2-e95a212e566f" returned: 0 in 0.257s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:32 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1d98b37c-8d4c-4119-a8f7-fe2be357eec4 tempest-SnapshotDependencyTests-954985534 None] Lock "cinder-quobyte-a40cf92a-7f8b-4adf-83d2-e95a212e566f" released by "_copy_volume_from_snapshot" :: held 8.432s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:32 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1d98b37c-8d4c-4119-a8f7-fe2be357eec4 tempest-SnapshotDependencyTests-954985534 None] Lock "cinder-quobyte-17898773-b511-4852-a079-f2c55335d185-a40cf92a-7f8b-4adf-83d2-e95a212e566f" released by "_create_volume_from_snapshot" :: held 8.500s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1d98b37c-8d4c-4119-a8f7-fe2be357eec4 tempest-SnapshotDependencyTests-954985534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.522s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-813b05ed-81ca-40a9-8b57-edd9ce277f6f req-5b16b540-9c31-4cdb-a44b-3e82bc18f171 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.805s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-813b05ed-81ca-40a9-8b57-edd9ce277f6f req-5b16b540-9c31-4cdb-a44b-3e82bc18f171 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:32 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1d98b37c-8d4c-4119-a8f7-fe2be357eec4 tempest-SnapshotDependencyTests-954985534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8452edb5-7df9-4b1b-9ee0-6fd9f97fa90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a40cf92a-7f8b-4adf-83d2-e95a212e566f', 'volume_size': 1, 'snapshot_id': '17898773-b511-4852-a079-f2c55335d185'}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:32 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1d98b37c-8d4c-4119-a8f7-fe2be357eec4 tempest-SnapshotDependencyTests-954985534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd6e8777-1651-4336-96a8-363e7170d23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:32 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-1d98b37c-8d4c-4119-a8f7-fe2be357eec4 tempest-SnapshotDependencyTests-954985534 None] Volume volume-a40cf92a-7f8b-4adf-83d2-e95a212e566f (a40cf92a-7f8b-4adf-83d2-e95a212e566f): created successfully Sep 28 15:10:32 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1d98b37c-8d4c-4119-a8f7-fe2be357eec4 tempest-SnapshotDependencyTests-954985534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd6e8777-1651-4336-96a8-363e7170d23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:32 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1d98b37c-8d4c-4119-a8f7-fe2be357eec4 tempest-SnapshotDependencyTests-954985534 None] Flow 'volume_create_manager' (df30c821-a021-47da-b043-bdbd29e543de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:10:32 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-813b05ed-81ca-40a9-8b57-edd9ce277f6f req-5b16b540-9c31-4cdb-a44b-3e82bc18f171 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1', 'name': 'volume-c8ed775a-f25e-49e9-811a-7936b3fa2e49', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a5a44583-b2bd-425e-b320-819ff360805e', 'enforce_multipath': True} {{(pid=87116) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:10:32 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-1d98b37c-8d4c-4119-a8f7-fe2be357eec4 tempest-SnapshotDependencyTests-954985534 None] Created volume successfully. Sep 28 15:10:32 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-813b05ed-81ca-40a9-8b57-edd9ce277f6f req-5b16b540-9c31-4cdb-a44b-3e82bc18f171 tempest-TestServerVolumeAttachmentScenario-1741783026 None] attachment_update completed successfully. Sep 28 15:10:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9acd47d1-f9a2-42ee-8628-50e73f7e84ad tempest-SnapshotDependencyTests-954985534 None] Acquiring lock "cinder-17898773-b511-4852-a079-f2c55335d185-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9acd47d1-f9a2-42ee-8628-50e73f7e84ad tempest-SnapshotDependencyTests-954985534 None] Lock "cinder-17898773-b511-4852-a079-f2c55335d185-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9acd47d1-f9a2-42ee-8628-50e73f7e84ad tempest-SnapshotDependencyTests-954985534 None] Acquiring lock "cinder-quobyte-32823f82-2ecb-42e5-af31-07d48efa10cb" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9acd47d1-f9a2-42ee-8628-50e73f7e84ad tempest-SnapshotDependencyTests-954985534 None] Lock "cinder-quobyte-32823f82-2ecb-42e5-af31-07d48efa10cb" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9acd47d1-f9a2-42ee-8628-50e73f7e84ad tempest-SnapshotDependencyTests-954985534 None] Acquiring lock "cinder-quobyte-17898773-b511-4852-a079-f2c55335d185" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9acd47d1-f9a2-42ee-8628-50e73f7e84ad tempest-SnapshotDependencyTests-954985534 None] Lock "cinder-quobyte-17898773-b511-4852-a079-f2c55335d185" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:33 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-9acd47d1-f9a2-42ee-8628-50e73f7e84ad tempest-SnapshotDependencyTests-954985534 None] Deleting offline snapshot 17898773-b511-4852-a079-f2c55335d185 of volume 32823f82-2ecb-42e5-af31-07d48efa10cb {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:10:33 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-9acd47d1-f9a2-42ee-8628-50e73f7e84ad tempest-SnapshotDependencyTests-954985534 None] snapshot_file for this snap is: volume-32823f82-2ecb-42e5-af31-07d48efa10cb.17898773-b511-4852-a079-f2c55335d185 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:10:33 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[410765c8-5133-4acd-8897-c98b53d966b8]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9acd47d1-f9a2-42ee-8628-50e73f7e84ad tempest-SnapshotDependencyTests-954985534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-32823f82-2ecb-42e5-af31-07d48efa10cb.17898773-b511-4852-a079-f2c55335d185 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:33 devstack sudo[105646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-32823f82-2ecb-42e5-af31-07d48efa10cb.17898773-b511-4852-a079-f2c55335d185 Sep 28 15:10:33 devstack sudo[105646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:33 devstack sudo[105646]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9acd47d1-f9a2-42ee-8628-50e73f7e84ad tempest-SnapshotDependencyTests-954985534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-32823f82-2ecb-42e5-af31-07d48efa10cb.17898773-b511-4852-a079-f2c55335d185" returned: 0 in 0.424s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:33 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-9acd47d1-f9a2-42ee-8628-50e73f7e84ad tempest-SnapshotDependencyTests-954985534 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32823f82-2ecb-42e5-af31-07d48efa10cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:10:33 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[080c0395-d09e-47f8-990b-df8eedf54e47]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9acd47d1-f9a2-42ee-8628-50e73f7e84ad tempest-SnapshotDependencyTests-954985534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-32823f82-2ecb-42e5-af31-07d48efa10cb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:33 devstack sudo[105651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-32823f82-2ecb-42e5-af31-07d48efa10cb Sep 28 15:10:33 devstack sudo[105651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:34 devstack sudo[105651]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9acd47d1-f9a2-42ee-8628-50e73f7e84ad tempest-SnapshotDependencyTests-954985534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-32823f82-2ecb-42e5-af31-07d48efa10cb" returned: 0 in 0.650s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9acd47d1-f9a2-42ee-8628-50e73f7e84ad tempest-SnapshotDependencyTests-954985534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-32823f82-2ecb-42e5-af31-07d48efa10cb.17898773-b511-4852-a079-f2c55335d185 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:34 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-8c7233d7-3c1c-4926-81ae-5802007914f3 req-9f438c86-6ebf-4a9f-8ceb-5899099eea4b tempest-TestServerVolumeAttachmentScenario-1741783026 None] Terminate volume connection completed successfully. Sep 28 15:10:34 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-8c7233d7-3c1c-4926-81ae-5802007914f3 req-9f438c86-6ebf-4a9f-8ceb-5899099eea4b tempest-TestServerVolumeAttachmentScenario-1741783026 None] Deleting attachment a5a44583-b2bd-425e-b320-819ff360805e. {{(pid=87116) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:10:34 devstack sudo[105661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-32823f82-2ecb-42e5-af31-07d48efa10cb.17898773-b511-4852-a079-f2c55335d185 Sep 28 15:10:34 devstack sudo[105661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:34 devstack sudo[105661]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9acd47d1-f9a2-42ee-8628-50e73f7e84ad tempest-SnapshotDependencyTests-954985534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-32823f82-2ecb-42e5-af31-07d48efa10cb.17898773-b511-4852-a079-f2c55335d185" returned: 0 in 0.412s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9acd47d1-f9a2-42ee-8628-50e73f7e84ad tempest-SnapshotDependencyTests-954985534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-32823f82-2ecb-42e5-af31-07d48efa10cb.17898773-b511-4852-a079-f2c55335d185 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:34 devstack sudo[105666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-32823f82-2ecb-42e5-af31-07d48efa10cb.17898773-b511-4852-a079-f2c55335d185 Sep 28 15:10:34 devstack sudo[105666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:35 devstack sudo[105666]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9acd47d1-f9a2-42ee-8628-50e73f7e84ad tempest-SnapshotDependencyTests-954985534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-32823f82-2ecb-42e5-af31-07d48efa10cb.17898773-b511-4852-a079-f2c55335d185" returned: 0 in 0.312s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:35 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9acd47d1-f9a2-42ee-8628-50e73f7e84ad tempest-SnapshotDependencyTests-954985534 None] Lock "cinder-quobyte-17898773-b511-4852-a079-f2c55335d185" released by "_delete_snapshot" :: held 1.951s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:35 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9acd47d1-f9a2-42ee-8628-50e73f7e84ad tempest-SnapshotDependencyTests-954985534 None] Lock "cinder-quobyte-32823f82-2ecb-42e5-af31-07d48efa10cb" released by "delete_snapshot" :: held 1.977s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:35 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-9acd47d1-f9a2-42ee-8628-50e73f7e84ad tempest-SnapshotDependencyTests-954985534 None] Created reservations ['a88d39fa-8d41-4ac7-98f4-03525c8f4c2f', 'dde88d00-f748-4a59-9ae1-69f0b2b393b9', 'c92e31f7-56a2-479b-8895-05cb4684e7c0', '0eaa2c4b-b74f-476f-9b38-947250fdd345'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:10:35 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-9acd47d1-f9a2-42ee-8628-50e73f7e84ad tempest-SnapshotDependencyTests-954985534 None] Delete snapshot completed successfully. Sep 28 15:10:35 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9acd47d1-f9a2-42ee-8628-50e73f7e84ad tempest-SnapshotDependencyTests-954985534 None] Lock "cinder-17898773-b511-4852-a079-f2c55335d185-delete_snapshot" released by "delete_snapshot" :: held 2.155s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:35 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-94408657-9d51-47cc-96f1-d4917a5813b1 req-46bdf733-e1ea-4a2a-9ebe-aa6d10d6fbb5 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Terminate volume connection completed successfully. Sep 28 15:10:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-94408657-9d51-47cc-96f1-d4917a5813b1 req-46bdf733-e1ea-4a2a-9ebe-aa6d10d6fbb5 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Deleting attachment 4993847f-3fbf-4dbd-af45-53de082327c1. {{(pid=87116) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:10:36 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-612d29e2-fb1a-4852-a9ad-d96dd207a1d8 tempest-SnapshotDependencyTests-954985534 None] Acquiring lock "cinder-32823f82-2ecb-42e5-af31-07d48efa10cb-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:36 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-612d29e2-fb1a-4852-a9ad-d96dd207a1d8 tempest-SnapshotDependencyTests-954985534 None] Lock "cinder-32823f82-2ecb-42e5-af31-07d48efa10cb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:36 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-612d29e2-fb1a-4852-a9ad-d96dd207a1d8 tempest-SnapshotDependencyTests-954985534 None] Acquiring lock "cinder-quobyte-32823f82-2ecb-42e5-af31-07d48efa10cb" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:36 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-612d29e2-fb1a-4852-a9ad-d96dd207a1d8 tempest-SnapshotDependencyTests-954985534 None] Lock "cinder-quobyte-32823f82-2ecb-42e5-af31-07d48efa10cb" acquired by "delete_volume" :: waited 0.017s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:36 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4fbb50-26da-4e03-a9fd-1e5db4e7921e]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-612d29e2-fb1a-4852-a9ad-d96dd207a1d8 tempest-SnapshotDependencyTests-954985534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-32823f82-2ecb-42e5-af31-07d48efa10cb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:36 devstack sudo[105700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-32823f82-2ecb-42e5-af31-07d48efa10cb Sep 28 15:10:36 devstack sudo[105700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:36 devstack sudo[105700]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-612d29e2-fb1a-4852-a9ad-d96dd207a1d8 tempest-SnapshotDependencyTests-954985534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-32823f82-2ecb-42e5-af31-07d48efa10cb" returned: 0 in 0.485s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-612d29e2-fb1a-4852-a9ad-d96dd207a1d8 tempest-SnapshotDependencyTests-954985534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-32823f82-2ecb-42e5-af31-07d48efa10cb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:36 devstack sudo[105705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-32823f82-2ecb-42e5-af31-07d48efa10cb Sep 28 15:10:36 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:37 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-612d29e2-fb1a-4852-a9ad-d96dd207a1d8 tempest-SnapshotDependencyTests-954985534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-32823f82-2ecb-42e5-af31-07d48efa10cb" returned: 0 in 0.316s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:37 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-612d29e2-fb1a-4852-a9ad-d96dd207a1d8 tempest-SnapshotDependencyTests-954985534 None] Lock "cinder-quobyte-32823f82-2ecb-42e5-af31-07d48efa10cb" released by "delete_volume" :: held 0.942s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:37 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-612d29e2-fb1a-4852-a9ad-d96dd207a1d8 tempest-SnapshotDependencyTests-954985534 None] Created reservations ['7b477a1f-8a80-4310-9e9a-6cb5c932b614', 'a5dc2bb9-15e9-4795-a66e-5761e025a748', '225feb25-39fd-4a56-a1b3-1094a661ab83', '5f907421-4ebb-4a9e-aacc-5831898b9519'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:10:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-612d29e2-fb1a-4852-a9ad-d96dd207a1d8 tempest-SnapshotDependencyTests-954985534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-612d29e2-fb1a-4852-a9ad-d96dd207a1d8 tempest-SnapshotDependencyTests-954985534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:37 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-612d29e2-fb1a-4852-a9ad-d96dd207a1d8 tempest-SnapshotDependencyTests-954985534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:10:37 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-612d29e2-fb1a-4852-a9ad-d96dd207a1d8 tempest-SnapshotDependencyTests-954985534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:10:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-612d29e2-fb1a-4852-a9ad-d96dd207a1d8 tempest-SnapshotDependencyTests-954985534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-612d29e2-fb1a-4852-a9ad-d96dd207a1d8 tempest-SnapshotDependencyTests-954985534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:37 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2e837fbd-02c9-4268-b027-d20adb3d0dfb tempest-SnapshotDependencyTests-954985534 None] Acquiring lock "cinder-a40cf92a-7f8b-4adf-83d2-e95a212e566f-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:37 devstack sudo[105730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:10:37 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:37 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2e837fbd-02c9-4268-b027-d20adb3d0dfb tempest-SnapshotDependencyTests-954985534 None] Lock "cinder-a40cf92a-7f8b-4adf-83d2-e95a212e566f-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:37 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2e837fbd-02c9-4268-b027-d20adb3d0dfb tempest-SnapshotDependencyTests-954985534 None] Acquiring lock "cinder-quobyte-a40cf92a-7f8b-4adf-83d2-e95a212e566f" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:37 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2e837fbd-02c9-4268-b027-d20adb3d0dfb tempest-SnapshotDependencyTests-954985534 None] Lock "cinder-quobyte-a40cf92a-7f8b-4adf-83d2-e95a212e566f" acquired by "delete_volume" :: waited 0.041s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:37 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[06202183-096c-43e8-b7dd-287602ec1cd7]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2e837fbd-02c9-4268-b027-d20adb3d0dfb tempest-SnapshotDependencyTests-954985534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a40cf92a-7f8b-4adf-83d2-e95a212e566f {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:38 devstack sudo[105757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a40cf92a-7f8b-4adf-83d2-e95a212e566f Sep 28 15:10:38 devstack sudo[105757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:38 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-612d29e2-fb1a-4852-a9ad-d96dd207a1d8 tempest-SnapshotDependencyTests-954985534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.430s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:38 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-612d29e2-fb1a-4852-a9ad-d96dd207a1d8 tempest-SnapshotDependencyTests-954985534 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:10:38 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-612d29e2-fb1a-4852-a9ad-d96dd207a1d8 tempest-SnapshotDependencyTests-954985534 None] Deleted volume successfully. Sep 28 15:10:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-612d29e2-fb1a-4852-a9ad-d96dd207a1d8 tempest-SnapshotDependencyTests-954985534 None] Lock "cinder-32823f82-2ecb-42e5-af31-07d48efa10cb-delete_volume" released by "delete_volume" :: held 1.811s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:38 devstack sudo[105757]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2e837fbd-02c9-4268-b027-d20adb3d0dfb tempest-SnapshotDependencyTests-954985534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a40cf92a-7f8b-4adf-83d2-e95a212e566f" returned: 0 in 0.576s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2e837fbd-02c9-4268-b027-d20adb3d0dfb tempest-SnapshotDependencyTests-954985534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a40cf92a-7f8b-4adf-83d2-e95a212e566f {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:38 devstack sudo[105775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a40cf92a-7f8b-4adf-83d2-e95a212e566f Sep 28 15:10:38 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:38 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2e837fbd-02c9-4268-b027-d20adb3d0dfb tempest-SnapshotDependencyTests-954985534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a40cf92a-7f8b-4adf-83d2-e95a212e566f" returned: 0 in 0.397s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2e837fbd-02c9-4268-b027-d20adb3d0dfb tempest-SnapshotDependencyTests-954985534 None] Lock "cinder-quobyte-a40cf92a-7f8b-4adf-83d2-e95a212e566f" released by "delete_volume" :: held 1.054s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:38 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-2e837fbd-02c9-4268-b027-d20adb3d0dfb tempest-SnapshotDependencyTests-954985534 None] Created reservations ['49f347ef-9795-4528-a534-fca32cd11b57', '287bb453-f319-4633-836f-2f5441ea1dac', 'ca517e84-1320-443d-a9f4-dcff53bdab68', 'a9335cf7-61ca-4c97-bfb6-a1beea747145'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:10:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2e837fbd-02c9-4268-b027-d20adb3d0dfb tempest-SnapshotDependencyTests-954985534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2e837fbd-02c9-4268-b027-d20adb3d0dfb tempest-SnapshotDependencyTests-954985534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2e837fbd-02c9-4268-b027-d20adb3d0dfb tempest-SnapshotDependencyTests-954985534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:10:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2e837fbd-02c9-4268-b027-d20adb3d0dfb tempest-SnapshotDependencyTests-954985534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:10:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2e837fbd-02c9-4268-b027-d20adb3d0dfb tempest-SnapshotDependencyTests-954985534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2e837fbd-02c9-4268-b027-d20adb3d0dfb tempest-SnapshotDependencyTests-954985534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:39 devstack sudo[105781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:10:39 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:39 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2e837fbd-02c9-4268-b027-d20adb3d0dfb tempest-SnapshotDependencyTests-954985534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.299s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:39 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-2e837fbd-02c9-4268-b027-d20adb3d0dfb tempest-SnapshotDependencyTests-954985534 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:10:39 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-2e837fbd-02c9-4268-b027-d20adb3d0dfb tempest-SnapshotDependencyTests-954985534 None] Deleted volume successfully. Sep 28 15:10:39 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2e837fbd-02c9-4268-b027-d20adb3d0dfb tempest-SnapshotDependencyTests-954985534 None] Lock "cinder-a40cf92a-7f8b-4adf-83d2-e95a212e566f-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1b0ae40f-a2eb-44a4-b055-d12fb89933ce tempest-TestServerVolumeAttachmentScenario-1741783026 None] Acquiring lock "cinder-c8ed775a-f25e-49e9-811a-7936b3fa2e49-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1b0ae40f-a2eb-44a4-b055-d12fb89933ce tempest-TestServerVolumeAttachmentScenario-1741783026 None] Lock "cinder-c8ed775a-f25e-49e9-811a-7936b3fa2e49-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:42 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1b0ae40f-a2eb-44a4-b055-d12fb89933ce tempest-TestServerVolumeAttachmentScenario-1741783026 None] Acquiring lock "cinder-quobyte-c8ed775a-f25e-49e9-811a-7936b3fa2e49" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:42 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1b0ae40f-a2eb-44a4-b055-d12fb89933ce tempest-TestServerVolumeAttachmentScenario-1741783026 None] Lock "cinder-quobyte-c8ed775a-f25e-49e9-811a-7936b3fa2e49" acquired by "delete_volume" :: waited 0.025s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:42 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d63e0d-6bb0-4715-bbd9-59c8df284d19]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1b0ae40f-a2eb-44a4-b055-d12fb89933ce tempest-TestServerVolumeAttachmentScenario-1741783026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c8ed775a-f25e-49e9-811a-7936b3fa2e49 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:42 devstack sudo[105787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c8ed775a-f25e-49e9-811a-7936b3fa2e49 Sep 28 15:10:42 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:42 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1b0ae40f-a2eb-44a4-b055-d12fb89933ce tempest-TestServerVolumeAttachmentScenario-1741783026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c8ed775a-f25e-49e9-811a-7936b3fa2e49" returned: 0 in 0.439s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1b0ae40f-a2eb-44a4-b055-d12fb89933ce tempest-TestServerVolumeAttachmentScenario-1741783026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c8ed775a-f25e-49e9-811a-7936b3fa2e49 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:42 devstack sudo[105792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c8ed775a-f25e-49e9-811a-7936b3fa2e49 Sep 28 15:10:42 devstack sudo[105792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:42 devstack sudo[105792]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1b0ae40f-a2eb-44a4-b055-d12fb89933ce tempest-TestServerVolumeAttachmentScenario-1741783026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-c8ed775a-f25e-49e9-811a-7936b3fa2e49" returned: 0 in 0.322s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:42 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1b0ae40f-a2eb-44a4-b055-d12fb89933ce tempest-TestServerVolumeAttachmentScenario-1741783026 None] Lock "cinder-quobyte-c8ed775a-f25e-49e9-811a-7936b3fa2e49" released by "delete_volume" :: held 0.855s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:42 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-1b0ae40f-a2eb-44a4-b055-d12fb89933ce tempest-TestServerVolumeAttachmentScenario-1741783026 None] Created reservations ['c035246e-9d95-4606-b9b1-b68ed62f5776', '7c611312-3774-48ba-9109-d9feb49f0766', '02d409fe-860f-4871-ae5b-7ddae26bc051', '28753fee-e473-450d-8c99-d57a860a3771'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:10:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1b0ae40f-a2eb-44a4-b055-d12fb89933ce tempest-TestServerVolumeAttachmentScenario-1741783026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1b0ae40f-a2eb-44a4-b055-d12fb89933ce tempest-TestServerVolumeAttachmentScenario-1741783026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:43 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1b0ae40f-a2eb-44a4-b055-d12fb89933ce tempest-TestServerVolumeAttachmentScenario-1741783026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:10:43 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1b0ae40f-a2eb-44a4-b055-d12fb89933ce tempest-TestServerVolumeAttachmentScenario-1741783026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:10:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1b0ae40f-a2eb-44a4-b055-d12fb89933ce tempest-TestServerVolumeAttachmentScenario-1741783026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1b0ae40f-a2eb-44a4-b055-d12fb89933ce tempest-TestServerVolumeAttachmentScenario-1741783026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:43 devstack sudo[105795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:10:43 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4dae21e7-877c-450e-b858-048b403037e0 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Acquiring lock "cinder-49516da9-31e9-4f1b-8f2c-85e807c806f7-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4dae21e7-877c-450e-b858-048b403037e0 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Lock "cinder-49516da9-31e9-4f1b-8f2c-85e807c806f7-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4dae21e7-877c-450e-b858-048b403037e0 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Acquiring lock "cinder-quobyte-49516da9-31e9-4f1b-8f2c-85e807c806f7" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4dae21e7-877c-450e-b858-048b403037e0 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Lock "cinder-quobyte-49516da9-31e9-4f1b-8f2c-85e807c806f7" acquired by "delete_volume" :: waited 0.015s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:43 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[31daf3ce-0c2a-4c76-8067-594a8c0d5458]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4dae21e7-877c-450e-b858-048b403037e0 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-49516da9-31e9-4f1b-8f2c-85e807c806f7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:43 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1b0ae40f-a2eb-44a4-b055-d12fb89933ce tempest-TestServerVolumeAttachmentScenario-1741783026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.409s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:43 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-1b0ae40f-a2eb-44a4-b055-d12fb89933ce tempest-TestServerVolumeAttachmentScenario-1741783026 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:10:43 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-1b0ae40f-a2eb-44a4-b055-d12fb89933ce tempest-TestServerVolumeAttachmentScenario-1741783026 None] Deleted volume successfully. Sep 28 15:10:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1b0ae40f-a2eb-44a4-b055-d12fb89933ce tempest-TestServerVolumeAttachmentScenario-1741783026 None] Lock "cinder-c8ed775a-f25e-49e9-811a-7936b3fa2e49-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:43 devstack sudo[105798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-49516da9-31e9-4f1b-8f2c-85e807c806f7 Sep 28 15:10:43 devstack sudo[105798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:43 devstack sudo[105798]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4dae21e7-877c-450e-b858-048b403037e0 tempest-TestServerVolumeAttachmentScenario-1741783026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-49516da9-31e9-4f1b-8f2c-85e807c806f7" returned: 0 in 0.432s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4dae21e7-877c-450e-b858-048b403037e0 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-49516da9-31e9-4f1b-8f2c-85e807c806f7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:43 devstack sudo[105803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-49516da9-31e9-4f1b-8f2c-85e807c806f7 Sep 28 15:10:43 devstack sudo[105803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:44 devstack sudo[105803]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4dae21e7-877c-450e-b858-048b403037e0 tempest-TestServerVolumeAttachmentScenario-1741783026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-49516da9-31e9-4f1b-8f2c-85e807c806f7" returned: 0 in 0.281s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:44 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4dae21e7-877c-450e-b858-048b403037e0 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Lock "cinder-quobyte-49516da9-31e9-4f1b-8f2c-85e807c806f7" released by "delete_volume" :: held 0.783s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:44 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-4dae21e7-877c-450e-b858-048b403037e0 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Created reservations ['b1b0bb82-011e-41b4-90b8-f3e67070504e', '44e52974-97e2-4a46-9db8-8cea5b7087a0', '0b95b9ea-6790-4ace-8d06-115431f4edf3', '5da9be11-a4f0-46a8-a691-65571325901d'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:10:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4dae21e7-877c-450e-b858-048b403037e0 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4dae21e7-877c-450e-b858-048b403037e0 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:44 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4dae21e7-877c-450e-b858-048b403037e0 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:10:44 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4dae21e7-877c-450e-b858-048b403037e0 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:10:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4dae21e7-877c-450e-b858-048b403037e0 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4dae21e7-877c-450e-b858-048b403037e0 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:44 devstack sudo[105806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:10:44 devstack sudo[105806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:44 devstack sudo[105806]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4dae21e7-877c-450e-b858-048b403037e0 tempest-TestServerVolumeAttachmentScenario-1741783026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.514s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:44 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-4dae21e7-877c-450e-b858-048b403037e0 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:10:44 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-4dae21e7-877c-450e-b858-048b403037e0 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Deleted volume successfully. Sep 28 15:10:44 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4dae21e7-877c-450e-b858-048b403037e0 tempest-TestServerVolumeAttachmentScenario-1741783026 None] Lock "cinder-49516da9-31e9-4f1b-8f2c-85e807c806f7-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:54 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=48,cinder:UPDATE=50,cinder:INSERT=10,cinder:DELETE=4 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:10:54 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=51,cinder:UPDATE=46,cinder:INSERT=13,cinder:DELETE=3 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:11:17 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:11:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:11:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:11:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:17 devstack sudo[105822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:11:17 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:17 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.300s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:17 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:11:17 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running periodic task VolumeManager._thread_info {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:11:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] thread count: 28 {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:11:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] thread info: [<_MainThread(MainThread, started 135146735652992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:11:24 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-cef98730-d881-47a7-801e-9fb142d36fb8 tempest-TestImageHashVerification-412624164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:11:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-cef98730-d881-47a7-801e-9fb142d36fb8 tempest-TestImageHashVerification-412624164 None] Flow 'volume_create_manager' (26391633-4ed8-4a98-bae8-16e317f4010d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-cef98730-d881-47a7-801e-9fb142d36fb8 tempest-TestImageHashVerification-412624164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50154fbb-be78-4860-80a9-0c13d0857dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-cef98730-d881-47a7-801e-9fb142d36fb8 tempest-TestImageHashVerification-412624164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50154fbb-be78-4860-80a9-0c13d0857dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-82747402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=511b9fd5-9815-47b9-81b9-b874f54edb38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf026914a38e4397977a4f742911e86c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:24Z,use_quota=True,user_id='09cce90deb564dd98c5328a0fe798579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-cef98730-d881-47a7-801e-9fb142d36fb8 tempest-TestImageHashVerification-412624164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74831f63-3214-4308-a7f5-8beb59441bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-cef98730-d881-47a7-801e-9fb142d36fb8 tempest-TestImageHashVerification-412624164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74831f63-3214-4308-a7f5-8beb59441bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-cef98730-d881-47a7-801e-9fb142d36fb8 tempest-TestImageHashVerification-412624164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc60d5aa-3ddc-44b8-afb3-21f8c24c8bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-cef98730-d881-47a7-801e-9fb142d36fb8 tempest-TestImageHashVerification-412624164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc60d5aa-3ddc-44b8-afb3-21f8c24c8bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '511b9fd5-9815-47b9-81b9-b874f54edb38', 'volume_name': 'volume-511b9fd5-9815-47b9-81b9-b874f54edb38', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-cef98730-d881-47a7-801e-9fb142d36fb8 tempest-TestImageHashVerification-412624164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aacb56bf-8649-449e-801b-3f4fb5b7ba38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-cef98730-d881-47a7-801e-9fb142d36fb8 tempest-TestImageHashVerification-412624164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aacb56bf-8649-449e-801b-3f4fb5b7ba38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-cef98730-d881-47a7-801e-9fb142d36fb8 tempest-TestImageHashVerification-412624164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8267d485-6dc9-4ae6-aa19-04ab573f8488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:24 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-cef98730-d881-47a7-801e-9fb142d36fb8 tempest-TestImageHashVerification-412624164 None] Volume 511b9fd5-9815-47b9-81b9-b874f54edb38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-511b9fd5-9815-47b9-81b9-b874f54edb38', 'volume_size': 1} Sep 28 15:11:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-cef98730-d881-47a7-801e-9fb142d36fb8 tempest-TestImageHashVerification-412624164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-cef98730-d881-47a7-801e-9fb142d36fb8 tempest-TestImageHashVerification-412624164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:24 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-cef98730-d881-47a7-801e-9fb142d36fb8 tempest-TestImageHashVerification-412624164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-82747402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=511b9fd5-9815-47b9-81b9-b874f54edb38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf026914a38e4397977a4f742911e86c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:24Z,use_quota=True,user_id='09cce90deb564dd98c5328a0fe798579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:11:24 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-cef98730-d881-47a7-801e-9fb142d36fb8 tempest-TestImageHashVerification-412624164 None] Creating volume 511b9fd5-9815-47b9-81b9-b874f54edb38 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:11:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-cef98730-d881-47a7-801e-9fb142d36fb8 tempest-TestImageHashVerification-412624164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-cef98730-d881-47a7-801e-9fb142d36fb8 tempest-TestImageHashVerification-412624164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:24 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-cef98730-d881-47a7-801e-9fb142d36fb8 tempest-TestImageHashVerification-412624164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:11:24 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-cef98730-d881-47a7-801e-9fb142d36fb8 tempest-TestImageHashVerification-412624164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:11:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-cef98730-d881-47a7-801e-9fb142d36fb8 tempest-TestImageHashVerification-412624164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:24 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-cef98730-d881-47a7-801e-9fb142d36fb8 tempest-TestImageHashVerification-412624164 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:11:24 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-cef98730-d881-47a7-801e-9fb142d36fb8 tempest-TestImageHashVerification-412624164 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:11:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cef98730-d881-47a7-801e-9fb142d36fb8 tempest-TestImageHashVerification-412624164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-511b9fd5-9815-47b9-81b9-b874f54edb38 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:24 devstack sudo[105826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-511b9fd5-9815-47b9-81b9-b874f54edb38 1073741824 Sep 28 15:11:24 devstack sudo[105826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:24 devstack sudo[105826]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cef98730-d881-47a7-801e-9fb142d36fb8 tempest-TestImageHashVerification-412624164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-511b9fd5-9815-47b9-81b9-b874f54edb38 1073741824" returned: 0 in 0.487s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cef98730-d881-47a7-801e-9fb142d36fb8 tempest-TestImageHashVerification-412624164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-511b9fd5-9815-47b9-81b9-b874f54edb38 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:24 devstack sudo[105832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-511b9fd5-9815-47b9-81b9-b874f54edb38 Sep 28 15:11:24 devstack sudo[105832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:25 devstack sudo[105832]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cef98730-d881-47a7-801e-9fb142d36fb8 tempest-TestImageHashVerification-412624164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-511b9fd5-9815-47b9-81b9-b874f54edb38" returned: 0 in 0.298s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:25 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-cef98730-d881-47a7-801e-9fb142d36fb8 tempest-TestImageHashVerification-412624164 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:11:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-cef98730-d881-47a7-801e-9fb142d36fb8 tempest-TestImageHashVerification-412624164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-cef98730-d881-47a7-801e-9fb142d36fb8 tempest-TestImageHashVerification-412624164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8267d485-6dc9-4ae6-aa19-04ab573f8488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-511b9fd5-9815-47b9-81b9-b874f54edb38', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-cef98730-d881-47a7-801e-9fb142d36fb8 tempest-TestImageHashVerification-412624164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (336ad06b-7ee8-4f44-9429-b0689a7969f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:25 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-cef98730-d881-47a7-801e-9fb142d36fb8 tempest-TestImageHashVerification-412624164 None] Volume volume-511b9fd5-9815-47b9-81b9-b874f54edb38 (511b9fd5-9815-47b9-81b9-b874f54edb38): created successfully Sep 28 15:11:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-cef98730-d881-47a7-801e-9fb142d36fb8 tempest-TestImageHashVerification-412624164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (336ad06b-7ee8-4f44-9429-b0689a7969f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-cef98730-d881-47a7-801e-9fb142d36fb8 tempest-TestImageHashVerification-412624164 None] Flow 'volume_create_manager' (26391633-4ed8-4a98-bae8-16e317f4010d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:25 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-cef98730-d881-47a7-801e-9fb142d36fb8 tempest-TestImageHashVerification-412624164 None] Created volume successfully. Sep 28 15:11:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3f8ce94a-6b71-4b0b-b0dc-71db6a049a36 tempest-TestImageHashVerification-412624164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3f8ce94a-6b71-4b0b-b0dc-71db6a049a36 tempest-TestImageHashVerification-412624164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:27 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ef5798-9d5b-4b54-bef0-f0062856d91c]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3f8ce94a-6b71-4b0b-b0dc-71db6a049a36 tempest-TestImageHashVerification-412624164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-511b9fd5-9815-47b9-81b9-b874f54edb38 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:27 devstack sudo[105835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-511b9fd5-9815-47b9-81b9-b874f54edb38 Sep 28 15:11:27 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:27 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3f8ce94a-6b71-4b0b-b0dc-71db6a049a36 tempest-TestImageHashVerification-412624164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-511b9fd5-9815-47b9-81b9-b874f54edb38" returned: 0 in 0.437s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:27 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1744236-a6f0-4332-a08b-619f4a2f9242]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3f8ce94a-6b71-4b0b-b0dc-71db6a049a36 tempest-TestImageHashVerification-412624164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-511b9fd5-9815-47b9-81b9-b874f54edb38 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:27 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-511b9fd5-9815-47b9-81b9-b874f54edb38 Sep 28 15:11:27 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:28 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3f8ce94a-6b71-4b0b-b0dc-71db6a049a36 tempest-TestImageHashVerification-412624164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-511b9fd5-9815-47b9-81b9-b874f54edb38" returned: 0 in 0.423s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3f8ce94a-6b71-4b0b-b0dc-71db6a049a36 tempest-TestImageHashVerification-412624164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-511b9fd5-9815-47b9-81b9-b874f54edb38 /opt/stack/data/cinder/conversion/511b9fd5-9815-47b9-81b9-b874f54edb38.temp_image.3a001b6f-0fa7-48cd-84bc-e8c286a0982cczuf63w_.img {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:28 devstack sudo[105845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-511b9fd5-9815-47b9-81b9-b874f54edb38 /opt/stack/data/cinder/conversion/511b9fd5-9815-47b9-81b9-b874f54edb38.temp_image.3a001b6f-0fa7-48cd-84bc-e8c286a0982cczuf63w_.img Sep 28 15:11:28 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:34 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3f8ce94a-6b71-4b0b-b0dc-71db6a049a36 tempest-TestImageHashVerification-412624164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-511b9fd5-9815-47b9-81b9-b874f54edb38 /opt/stack/data/cinder/conversion/511b9fd5-9815-47b9-81b9-b874f54edb38.temp_image.3a001b6f-0fa7-48cd-84bc-e8c286a0982cczuf63w_.img" returned: 0 in 5.903s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:34 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b753cd-086b-462b-82c6-f6148745a45c]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3f8ce94a-6b71-4b0b-b0dc-71db6a049a36 tempest-TestImageHashVerification-412624164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-511b9fd5-9815-47b9-81b9-b874f54edb38 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:34 devstack sudo[105868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-511b9fd5-9815-47b9-81b9-b874f54edb38 Sep 28 15:11:34 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:34 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3f8ce94a-6b71-4b0b-b0dc-71db6a049a36 tempest-TestImageHashVerification-412624164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-511b9fd5-9815-47b9-81b9-b874f54edb38" returned: 0 in 0.556s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:34 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-3f8ce94a-6b71-4b0b-b0dc-71db6a049a36 tempest-TestImageHashVerification-412624164 None] Image conversion details: src /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-511b9fd5-9815-47b9-81b9-b874f54edb38, size 1024.00 MB, duration 5.90 sec, destination /opt/stack/data/cinder/conversion/511b9fd5-9815-47b9-81b9-b874f54edb38.temp_image.3a001b6f-0fa7-48cd-84bc-e8c286a0982cczuf63w_.img {{(pid=87116) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:11:34 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-3f8ce94a-6b71-4b0b-b0dc-71db6a049a36 tempest-TestImageHashVerification-412624164 None] Converted 1024.00 MB image at 173.43 MB/s Sep 28 15:11:34 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-3f8ce94a-6b71-4b0b-b0dc-71db6a049a36 tempest-TestImageHashVerification-412624164 None] 3a001b6f-0fa7-48cd-84bc-e8c286a0982c was raw, no need to convert to raw {{(pid=87116) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 28 15:11:44 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=3,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:11:50 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:11:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3f8ce94a-6b71-4b0b-b0dc-71db6a049a36 tempest-TestImageHashVerification-412624164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.530s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:55 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3f8ce94a-6b71-4b0b-b0dc-71db6a049a36 tempest-TestImageHashVerification-412624164 None] Uploaded volume to glance image-id: 3a001b6f-0fa7-48cd-84bc-e8c286a0982c. {{(pid=87116) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 15:11:55 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-3f8ce94a-6b71-4b0b-b0dc-71db6a049a36 tempest-TestImageHashVerification-412624164 None] Copy volume to image completed successfully. Sep 28 15:11:57 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b6bad363-6eac-4be6-a422-feeaa37d6157 tempest-TestImageHashVerification-412624164 None] Acquiring lock "cinder-511b9fd5-9815-47b9-81b9-b874f54edb38-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:57 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b6bad363-6eac-4be6-a422-feeaa37d6157 tempest-TestImageHashVerification-412624164 None] Lock "cinder-511b9fd5-9815-47b9-81b9-b874f54edb38-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:57 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b6bad363-6eac-4be6-a422-feeaa37d6157 tempest-TestImageHashVerification-412624164 None] Acquiring lock "cinder-quobyte-511b9fd5-9815-47b9-81b9-b874f54edb38" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:57 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b6bad363-6eac-4be6-a422-feeaa37d6157 tempest-TestImageHashVerification-412624164 None] Lock "cinder-quobyte-511b9fd5-9815-47b9-81b9-b874f54edb38" acquired by "delete_volume" :: waited 0.017s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:57 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[058384f3-a046-4db8-91cf-b74050fd9b97]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b6bad363-6eac-4be6-a422-feeaa37d6157 tempest-TestImageHashVerification-412624164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-511b9fd5-9815-47b9-81b9-b874f54edb38 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:57 devstack sudo[105912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-511b9fd5-9815-47b9-81b9-b874f54edb38 Sep 28 15:11:57 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:57 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b6bad363-6eac-4be6-a422-feeaa37d6157 tempest-TestImageHashVerification-412624164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-511b9fd5-9815-47b9-81b9-b874f54edb38" returned: 0 in 0.421s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b6bad363-6eac-4be6-a422-feeaa37d6157 tempest-TestImageHashVerification-412624164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-511b9fd5-9815-47b9-81b9-b874f54edb38 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:57 devstack sudo[105917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-511b9fd5-9815-47b9-81b9-b874f54edb38 Sep 28 15:11:57 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:57 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b6bad363-6eac-4be6-a422-feeaa37d6157 tempest-TestImageHashVerification-412624164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-511b9fd5-9815-47b9-81b9-b874f54edb38" returned: 0 in 0.297s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:57 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b6bad363-6eac-4be6-a422-feeaa37d6157 tempest-TestImageHashVerification-412624164 None] Lock "cinder-quobyte-511b9fd5-9815-47b9-81b9-b874f54edb38" released by "delete_volume" :: held 0.772s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:58 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-b6bad363-6eac-4be6-a422-feeaa37d6157 tempest-TestImageHashVerification-412624164 None] Created reservations ['7e10f315-ef30-4bf5-a4ab-50b5bc5df87c', '08ba1eaf-7037-46fc-82f0-09b477f31c3f', '0f2ce895-e129-44ff-893d-b2d487d346a0', '36d71607-2c86-4573-a2d4-d54830de2936'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:11:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b6bad363-6eac-4be6-a422-feeaa37d6157 tempest-TestImageHashVerification-412624164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b6bad363-6eac-4be6-a422-feeaa37d6157 tempest-TestImageHashVerification-412624164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b6bad363-6eac-4be6-a422-feeaa37d6157 tempest-TestImageHashVerification-412624164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:11:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b6bad363-6eac-4be6-a422-feeaa37d6157 tempest-TestImageHashVerification-412624164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:11:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b6bad363-6eac-4be6-a422-feeaa37d6157 tempest-TestImageHashVerification-412624164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b6bad363-6eac-4be6-a422-feeaa37d6157 tempest-TestImageHashVerification-412624164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:58 devstack sudo[105920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:11:58 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:58 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b6bad363-6eac-4be6-a422-feeaa37d6157 tempest-TestImageHashVerification-412624164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.274s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:58 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-b6bad363-6eac-4be6-a422-feeaa37d6157 tempest-TestImageHashVerification-412624164 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:11:58 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-b6bad363-6eac-4be6-a422-feeaa37d6157 tempest-TestImageHashVerification-412624164 None] Deleted volume successfully. Sep 28 15:11:58 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b6bad363-6eac-4be6-a422-feeaa37d6157 tempest-TestImageHashVerification-412624164 None] Lock "cinder-511b9fd5-9815-47b9-81b9-b874f54edb38-delete_volume" released by "delete_volume" :: held 1.303s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:08 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=7,cinder:UPDATE=7,cinder:INSERT=2 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:12:08 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:UPDATE=10,cinder:SELECT=4,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:12:17 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:12:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:12:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:12:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:17 devstack sudo[105931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:12:17 devstack sudo[105931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:17 devstack sudo[105931]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.326s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:17 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:12:17 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running periodic task VolumeManager._thread_info {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:12:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] thread count: 28 {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:12:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] thread info: [<_MainThread(MainThread, started 135146735652992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:12:38 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-e32ab33a-6f2d-46f2-9980-8d7155a0db91 tempest-TestStampPattern-749254378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:12:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e32ab33a-6f2d-46f2-9980-8d7155a0db91 tempest-TestStampPattern-749254378 None] Flow 'volume_create_manager' (a4c459dc-1e83-49c1-91aa-77cbcef58816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:12:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e32ab33a-6f2d-46f2-9980-8d7155a0db91 tempest-TestStampPattern-749254378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9414cc1c-9d31-41ba-a1f4-e8efa2200e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e32ab33a-6f2d-46f2-9980-8d7155a0db91 tempest-TestStampPattern-749254378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9414cc1c-9d31-41ba-a1f4-e8efa2200e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1668798979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64e461e8-912c-4c0f-baba-7e6094a0324b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de243a082e2f416ca6eb6f1db630c8fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:12:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:12:39Z,use_quota=True,user_id='1b5f8e15349641a2a9f580b79704ef2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e32ab33a-6f2d-46f2-9980-8d7155a0db91 tempest-TestStampPattern-749254378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1ba9470-3d1c-4238-8582-93a394fc6484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e32ab33a-6f2d-46f2-9980-8d7155a0db91 tempest-TestStampPattern-749254378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1ba9470-3d1c-4238-8582-93a394fc6484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e32ab33a-6f2d-46f2-9980-8d7155a0db91 tempest-TestStampPattern-749254378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d7aca73-9fce-404f-8300-eebbba9f1bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e32ab33a-6f2d-46f2-9980-8d7155a0db91 tempest-TestStampPattern-749254378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d7aca73-9fce-404f-8300-eebbba9f1bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64e461e8-912c-4c0f-baba-7e6094a0324b', 'volume_name': 'volume-64e461e8-912c-4c0f-baba-7e6094a0324b', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e32ab33a-6f2d-46f2-9980-8d7155a0db91 tempest-TestStampPattern-749254378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ee09080-acbc-4f57-b44d-746a0e1f2c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e32ab33a-6f2d-46f2-9980-8d7155a0db91 tempest-TestStampPattern-749254378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ee09080-acbc-4f57-b44d-746a0e1f2c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e32ab33a-6f2d-46f2-9980-8d7155a0db91 tempest-TestStampPattern-749254378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (940929b7-53a5-4b3e-9d70-67dc2c3bd853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:39 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-e32ab33a-6f2d-46f2-9980-8d7155a0db91 tempest-TestStampPattern-749254378 None] Volume 64e461e8-912c-4c0f-baba-7e6094a0324b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64e461e8-912c-4c0f-baba-7e6094a0324b', 'volume_size': 1} Sep 28 15:12:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e32ab33a-6f2d-46f2-9980-8d7155a0db91 tempest-TestStampPattern-749254378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e32ab33a-6f2d-46f2-9980-8d7155a0db91 tempest-TestStampPattern-749254378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e32ab33a-6f2d-46f2-9980-8d7155a0db91 tempest-TestStampPattern-749254378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1668798979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64e461e8-912c-4c0f-baba-7e6094a0324b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de243a082e2f416ca6eb6f1db630c8fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:12:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:12:39Z,use_quota=True,user_id='1b5f8e15349641a2a9f580b79704ef2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:12:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-e32ab33a-6f2d-46f2-9980-8d7155a0db91 tempest-TestStampPattern-749254378 None] Creating volume 64e461e8-912c-4c0f-baba-7e6094a0324b {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:12:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e32ab33a-6f2d-46f2-9980-8d7155a0db91 tempest-TestStampPattern-749254378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e32ab33a-6f2d-46f2-9980-8d7155a0db91 tempest-TestStampPattern-749254378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e32ab33a-6f2d-46f2-9980-8d7155a0db91 tempest-TestStampPattern-749254378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:12:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e32ab33a-6f2d-46f2-9980-8d7155a0db91 tempest-TestStampPattern-749254378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:12:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e32ab33a-6f2d-46f2-9980-8d7155a0db91 tempest-TestStampPattern-749254378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e32ab33a-6f2d-46f2-9980-8d7155a0db91 tempest-TestStampPattern-749254378 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:12:39 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-e32ab33a-6f2d-46f2-9980-8d7155a0db91 tempest-TestStampPattern-749254378 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:12:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e32ab33a-6f2d-46f2-9980-8d7155a0db91 tempest-TestStampPattern-749254378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-64e461e8-912c-4c0f-baba-7e6094a0324b 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:39 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-64e461e8-912c-4c0f-baba-7e6094a0324b 1073741824 Sep 28 15:12:39 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:39 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e32ab33a-6f2d-46f2-9980-8d7155a0db91 tempest-TestStampPattern-749254378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-64e461e8-912c-4c0f-baba-7e6094a0324b 1073741824" returned: 0 in 0.567s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e32ab33a-6f2d-46f2-9980-8d7155a0db91 tempest-TestStampPattern-749254378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-64e461e8-912c-4c0f-baba-7e6094a0324b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:39 devstack sudo[105986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-64e461e8-912c-4c0f-baba-7e6094a0324b Sep 28 15:12:39 devstack sudo[105986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:39 devstack sudo[105986]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e32ab33a-6f2d-46f2-9980-8d7155a0db91 tempest-TestStampPattern-749254378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-64e461e8-912c-4c0f-baba-7e6094a0324b" returned: 0 in 0.275s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e32ab33a-6f2d-46f2-9980-8d7155a0db91 tempest-TestStampPattern-749254378 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:12:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e32ab33a-6f2d-46f2-9980-8d7155a0db91 tempest-TestStampPattern-749254378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e32ab33a-6f2d-46f2-9980-8d7155a0db91 tempest-TestStampPattern-749254378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (940929b7-53a5-4b3e-9d70-67dc2c3bd853) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64e461e8-912c-4c0f-baba-7e6094a0324b', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e32ab33a-6f2d-46f2-9980-8d7155a0db91 tempest-TestStampPattern-749254378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (909631e7-0c39-43f3-8cd8-9d89c302f2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:39 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-e32ab33a-6f2d-46f2-9980-8d7155a0db91 tempest-TestStampPattern-749254378 None] Volume volume-64e461e8-912c-4c0f-baba-7e6094a0324b (64e461e8-912c-4c0f-baba-7e6094a0324b): created successfully Sep 28 15:12:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e32ab33a-6f2d-46f2-9980-8d7155a0db91 tempest-TestStampPattern-749254378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (909631e7-0c39-43f3-8cd8-9d89c302f2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e32ab33a-6f2d-46f2-9980-8d7155a0db91 tempest-TestStampPattern-749254378 None] Flow 'volume_create_manager' (a4c459dc-1e83-49c1-91aa-77cbcef58816) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:12:40 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-e32ab33a-6f2d-46f2-9980-8d7155a0db91 tempest-TestStampPattern-749254378 None] Created volume successfully. Sep 28 15:12:50 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:12:50 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:13:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-e0d5b644-ca4c-4dae-b85c-d0c9d042e04b req-e0ed0a77-a075-4a72-9951-a5770df03bd7 tempest-TestStampPattern-749254378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-e0d5b644-ca4c-4dae-b85c-d0c9d042e04b req-e0ed0a77-a075-4a72-9951-a5770df03bd7 tempest-TestStampPattern-749254378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-e0d5b644-ca4c-4dae-b85c-d0c9d042e04b req-e0ed0a77-a075-4a72-9951-a5770df03bd7 tempest-TestStampPattern-749254378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:11 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-e0d5b644-ca4c-4dae-b85c-d0c9d042e04b req-e0ed0a77-a075-4a72-9951-a5770df03bd7 tempest-TestStampPattern-749254378 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1', 'name': 'volume-64e461e8-912c-4c0f-baba-7e6094a0324b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '192e6ebf-86f7-46e6-8cb6-2f447d4bb8d3', 'enforce_multipath': True} {{(pid=87116) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:13:11 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-e0d5b644-ca4c-4dae-b85c-d0c9d042e04b req-e0ed0a77-a075-4a72-9951-a5770df03bd7 tempest-TestStampPattern-749254378 None] attachment_update completed successfully. Sep 28 15:13:17 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:13:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:13:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:13:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:17 devstack sudo[106579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:13:17 devstack sudo[106579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:17 devstack sudo[106579]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.341s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:17 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:13:17 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running periodic task VolumeManager._thread_info {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:13:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] thread count: 28 {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:13:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] thread info: [<_MainThread(MainThread, started 135146735652992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:13:17 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-38d5fccd-f402-41bd-808b-28588f65e292 req-e01899d7-b263-4f12-ba79-d87ded7a54d4 tempest-TestStampPattern-749254378 None] Terminate volume connection completed successfully. Sep 28 15:13:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-38d5fccd-f402-41bd-808b-28588f65e292 req-e01899d7-b263-4f12-ba79-d87ded7a54d4 tempest-TestStampPattern-749254378 None] Deleting attachment 192e6ebf-86f7-46e6-8cb6-2f447d4bb8d3. {{(pid=87116) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:13:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6f30e7a4-3f1e-47b0-9d64-2369efad203b tempest-TestStampPattern-749254378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6f30e7a4-3f1e-47b0-9d64-2369efad203b tempest-TestStampPattern-749254378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-6f30e7a4-3f1e-47b0-9d64-2369efad203b tempest-TestStampPattern-749254378 None] Creating offline snapshot 9eea5e2c-4aa5-4054-888b-265138b6fbeb of volume 64e461e8-912c-4c0f-baba-7e6094a0324b {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:13:18 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[214f83a6-1a95-4a7d-8069-b3740b0e7aa5]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:13:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6f30e7a4-3f1e-47b0-9d64-2369efad203b tempest-TestStampPattern-749254378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-64e461e8-912c-4c0f-baba-7e6094a0324b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:18 devstack sudo[106613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-64e461e8-912c-4c0f-baba-7e6094a0324b Sep 28 15:13:18 devstack sudo[106613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:19 devstack sudo[106613]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6f30e7a4-3f1e-47b0-9d64-2369efad203b tempest-TestStampPattern-749254378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-64e461e8-912c-4c0f-baba-7e6094a0324b" returned: 0 in 0.396s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6f30e7a4-3f1e-47b0-9d64-2369efad203b tempest-TestStampPattern-749254378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-64e461e8-912c-4c0f-baba-7e6094a0324b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-64e461e8-912c-4c0f-baba-7e6094a0324b.9eea5e2c-4aa5-4054-888b-265138b6fbeb 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:19 devstack sudo[106618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-64e461e8-912c-4c0f-baba-7e6094a0324b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-64e461e8-912c-4c0f-baba-7e6094a0324b.9eea5e2c-4aa5-4054-888b-265138b6fbeb 1G Sep 28 15:13:19 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:19 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6f30e7a4-3f1e-47b0-9d64-2369efad203b tempest-TestStampPattern-749254378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-64e461e8-912c-4c0f-baba-7e6094a0324b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-64e461e8-912c-4c0f-baba-7e6094a0324b.9eea5e2c-4aa5-4054-888b-265138b6fbeb 1G" returned: 0 in 0.485s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6f30e7a4-3f1e-47b0-9d64-2369efad203b tempest-TestStampPattern-749254378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64e461e8-912c-4c0f-baba-7e6094a0324b -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-64e461e8-912c-4c0f-baba-7e6094a0324b.9eea5e2c-4aa5-4054-888b-265138b6fbeb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:19 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64e461e8-912c-4c0f-baba-7e6094a0324b -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-64e461e8-912c-4c0f-baba-7e6094a0324b.9eea5e2c-4aa5-4054-888b-265138b6fbeb Sep 28 15:13:19 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:19 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6f30e7a4-3f1e-47b0-9d64-2369efad203b tempest-TestStampPattern-749254378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64e461e8-912c-4c0f-baba-7e6094a0324b -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-64e461e8-912c-4c0f-baba-7e6094a0324b.9eea5e2c-4aa5-4054-888b-265138b6fbeb" returned: 0 in 0.305s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:19 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-6f30e7a4-3f1e-47b0-9d64-2369efad203b tempest-TestStampPattern-749254378 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-64e461e8-912c-4c0f-baba-7e6094a0324b.9eea5e2c-4aa5-4054-888b-265138b6fbeb is being set with open permissions: ugo+rw Sep 28 15:13:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6f30e7a4-3f1e-47b0-9d64-2369efad203b tempest-TestStampPattern-749254378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-64e461e8-912c-4c0f-baba-7e6094a0324b.9eea5e2c-4aa5-4054-888b-265138b6fbeb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:19 devstack sudo[106628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-64e461e8-912c-4c0f-baba-7e6094a0324b.9eea5e2c-4aa5-4054-888b-265138b6fbeb Sep 28 15:13:19 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:20 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6f30e7a4-3f1e-47b0-9d64-2369efad203b tempest-TestStampPattern-749254378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-64e461e8-912c-4c0f-baba-7e6094a0324b.9eea5e2c-4aa5-4054-888b-265138b6fbeb" returned: 0 in 0.261s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6f30e7a4-3f1e-47b0-9d64-2369efad203b tempest-TestStampPattern-749254378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-64e461e8-912c-4c0f-baba-7e6094a0324b.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:20 devstack sudo[106631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-64e461e8-912c-4c0f-baba-7e6094a0324b.info Sep 28 15:13:20 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:20 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6f30e7a4-3f1e-47b0-9d64-2369efad203b tempest-TestStampPattern-749254378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-64e461e8-912c-4c0f-baba-7e6094a0324b.info" returned: 0 in 0.251s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:20 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-6f30e7a4-3f1e-47b0-9d64-2369efad203b tempest-TestStampPattern-749254378 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-64e461e8-912c-4c0f-baba-7e6094a0324b.info is being set with open permissions: ugo+rw Sep 28 15:13:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6f30e7a4-3f1e-47b0-9d64-2369efad203b tempest-TestStampPattern-749254378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-64e461e8-912c-4c0f-baba-7e6094a0324b.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:20 devstack sudo[106634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-64e461e8-912c-4c0f-baba-7e6094a0324b.info Sep 28 15:13:20 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:20 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6f30e7a4-3f1e-47b0-9d64-2369efad203b tempest-TestStampPattern-749254378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-64e461e8-912c-4c0f-baba-7e6094a0324b.info" returned: 0 in 0.247s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6f30e7a4-3f1e-47b0-9d64-2369efad203b tempest-TestStampPattern-749254378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.052s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:20 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-6f30e7a4-3f1e-47b0-9d64-2369efad203b tempest-TestStampPattern-749254378 None] Create snapshot completed successfully Sep 28 15:13:29 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-19e1555a-9746-4be3-8749-9b1a9eb3169d tempest-TestStampPattern-749254378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:13:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-19e1555a-9746-4be3-8749-9b1a9eb3169d tempest-TestStampPattern-749254378 None] Flow 'volume_create_manager' (13345c92-c61f-4bac-a72f-1d0a9cc07602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:13:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-19e1555a-9746-4be3-8749-9b1a9eb3169d tempest-TestStampPattern-749254378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4246fff-b467-48f6-a034-af0ba7de8bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-19e1555a-9746-4be3-8749-9b1a9eb3169d tempest-TestStampPattern-749254378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4246fff-b467-48f6-a034-af0ba7de8bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:13:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-183296827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0693681a-4f88-4b56-941f-a581256e8484,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de243a082e2f416ca6eb6f1db630c8fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9eea5e2c-4aa5-4054-888b-265138b6fbeb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:13:30Z,use_quota=True,user_id='1b5f8e15349641a2a9f580b79704ef2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-19e1555a-9746-4be3-8749-9b1a9eb3169d tempest-TestStampPattern-749254378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2376c6e1-0b21-40c6-bf4b-1358933894a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-19e1555a-9746-4be3-8749-9b1a9eb3169d tempest-TestStampPattern-749254378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2376c6e1-0b21-40c6-bf4b-1358933894a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-19e1555a-9746-4be3-8749-9b1a9eb3169d tempest-TestStampPattern-749254378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd0f7e65-8057-4d33-a657-4c964b1f0a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-19e1555a-9746-4be3-8749-9b1a9eb3169d tempest-TestStampPattern-749254378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd0f7e65-8057-4d33-a657-4c964b1f0a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0693681a-4f88-4b56-941f-a581256e8484', 'volume_name': 'volume-0693681a-4f88-4b56-941f-a581256e8484', 'volume_size': 1, 'snapshot_id': '9eea5e2c-4aa5-4054-888b-265138b6fbeb'}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-19e1555a-9746-4be3-8749-9b1a9eb3169d tempest-TestStampPattern-749254378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c53e74e-365a-4aeb-b61c-2c73f8e16f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-19e1555a-9746-4be3-8749-9b1a9eb3169d tempest-TestStampPattern-749254378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c53e74e-365a-4aeb-b61c-2c73f8e16f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-19e1555a-9746-4be3-8749-9b1a9eb3169d tempest-TestStampPattern-749254378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4905b78d-a1bc-43ff-a95f-05f25d5ee9b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:29 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-19e1555a-9746-4be3-8749-9b1a9eb3169d tempest-TestStampPattern-749254378 None] Volume 0693681a-4f88-4b56-941f-a581256e8484: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0693681a-4f88-4b56-941f-a581256e8484', 'volume_size': 1, 'snapshot_id': '9eea5e2c-4aa5-4054-888b-265138b6fbeb'} Sep 28 15:13:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-19e1555a-9746-4be3-8749-9b1a9eb3169d tempest-TestStampPattern-749254378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-19e1555a-9746-4be3-8749-9b1a9eb3169d tempest-TestStampPattern-749254378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-19e1555a-9746-4be3-8749-9b1a9eb3169d tempest-TestStampPattern-749254378 None] Acquiring lock "cinder-quobyte-9eea5e2c-4aa5-4054-888b-265138b6fbeb-0693681a-4f88-4b56-941f-a581256e8484" by "_create_volume_from_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-19e1555a-9746-4be3-8749-9b1a9eb3169d tempest-TestStampPattern-749254378 None] Lock "cinder-quobyte-9eea5e2c-4aa5-4054-888b-265138b6fbeb-0693681a-4f88-4b56-941f-a581256e8484" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-19e1555a-9746-4be3-8749-9b1a9eb3169d tempest-TestStampPattern-749254378 None] Creating volume 0693681a-4f88-4b56-941f-a581256e8484 from snapshot 9eea5e2c-4aa5-4054-888b-265138b6fbeb {{(pid=87116) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 15:13:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-19e1555a-9746-4be3-8749-9b1a9eb3169d tempest-TestStampPattern-749254378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-19e1555a-9746-4be3-8749-9b1a9eb3169d tempest-TestStampPattern-749254378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-19e1555a-9746-4be3-8749-9b1a9eb3169d tempest-TestStampPattern-749254378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:13:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-19e1555a-9746-4be3-8749-9b1a9eb3169d tempest-TestStampPattern-749254378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:13:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-19e1555a-9746-4be3-8749-9b1a9eb3169d tempest-TestStampPattern-749254378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-19e1555a-9746-4be3-8749-9b1a9eb3169d tempest-TestStampPattern-749254378 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:13:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-19e1555a-9746-4be3-8749-9b1a9eb3169d tempest-TestStampPattern-749254378 None] Acquiring lock "cinder-quobyte-0693681a-4f88-4b56-941f-a581256e8484" by "_copy_volume_from_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-19e1555a-9746-4be3-8749-9b1a9eb3169d tempest-TestStampPattern-749254378 None] Lock "cinder-quobyte-0693681a-4f88-4b56-941f-a581256e8484" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-19e1555a-9746-4be3-8749-9b1a9eb3169d tempest-TestStampPattern-749254378 None] snapshot: 9eea5e2c-4aa5-4054-888b-265138b6fbeb, volume: 0693681a-4f88-4b56-941f-a581256e8484, {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 15:13:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-19e1555a-9746-4be3-8749-9b1a9eb3169d tempest-TestStampPattern-749254378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-19e1555a-9746-4be3-8749-9b1a9eb3169d tempest-TestStampPattern-749254378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-19e1555a-9746-4be3-8749-9b1a9eb3169d tempest-TestStampPattern-749254378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:13:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-19e1555a-9746-4be3-8749-9b1a9eb3169d tempest-TestStampPattern-749254378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:13:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-19e1555a-9746-4be3-8749-9b1a9eb3169d tempest-TestStampPattern-749254378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:30 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[797abfb2-f0f7-4114-99de-f4be5d4a9c83]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:13:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-19e1555a-9746-4be3-8749-9b1a9eb3169d tempest-TestStampPattern-749254378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-64e461e8-912c-4c0f-baba-7e6094a0324b.9eea5e2c-4aa5-4054-888b-265138b6fbeb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:30 devstack sudo[106669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-64e461e8-912c-4c0f-baba-7e6094a0324b.9eea5e2c-4aa5-4054-888b-265138b6fbeb Sep 28 15:13:30 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:30 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-19e1555a-9746-4be3-8749-9b1a9eb3169d tempest-TestStampPattern-749254378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-64e461e8-912c-4c0f-baba-7e6094a0324b.9eea5e2c-4aa5-4054-888b-265138b6fbeb" returned: 0 in 0.438s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-19e1555a-9746-4be3-8749-9b1a9eb3169d tempest-TestStampPattern-749254378 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64e461e8-912c-4c0f-baba-7e6094a0324b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:13:30 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f292485-2b50-4ef8-a527-5dd1044e01d9]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:13:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-19e1555a-9746-4be3-8749-9b1a9eb3169d tempest-TestStampPattern-749254378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-64e461e8-912c-4c0f-baba-7e6094a0324b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:30 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-64e461e8-912c-4c0f-baba-7e6094a0324b Sep 28 15:13:30 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:31 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-19e1555a-9746-4be3-8749-9b1a9eb3169d tempest-TestStampPattern-749254378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-64e461e8-912c-4c0f-baba-7e6094a0324b" returned: 0 in 0.455s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:31 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-19e1555a-9746-4be3-8749-9b1a9eb3169d tempest-TestStampPattern-749254378 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-64e461e8-912c-4c0f-baba-7e6094a0324b {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 15:13:31 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-19e1555a-9746-4be3-8749-9b1a9eb3169d tempest-TestStampPattern-749254378 None] Creating direct copy from snapshot {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 15:13:31 devstack cinder-volume[87116]: DEBUG cinder.utils [None req-19e1555a-9746-4be3-8749-9b1a9eb3169d tempest-TestStampPattern-749254378 None] Path /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0693681a-4f88-4b56-941f-a581256e8484 not found in is_blk_device check {{(pid=87116) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 15:13:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-19e1555a-9746-4be3-8749-9b1a9eb3169d tempest-TestStampPattern-749254378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-64e461e8-912c-4c0f-baba-7e6094a0324b /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0693681a-4f88-4b56-941f-a581256e8484 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:31 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-64e461e8-912c-4c0f-baba-7e6094a0324b /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0693681a-4f88-4b56-941f-a581256e8484 Sep 28 15:13:31 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:39 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:13:40 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=14,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:13:41 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-19e1555a-9746-4be3-8749-9b1a9eb3169d tempest-TestStampPattern-749254378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-64e461e8-912c-4c0f-baba-7e6094a0324b /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0693681a-4f88-4b56-941f-a581256e8484" returned: 0 in 10.259s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:41 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-19e1555a-9746-4be3-8749-9b1a9eb3169d tempest-TestStampPattern-749254378 None] Image conversion details: src /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-64e461e8-912c-4c0f-baba-7e6094a0324b, size 1024.00 MB, duration 10.26 sec, destination /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0693681a-4f88-4b56-941f-a581256e8484 {{(pid=87116) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:13:41 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-19e1555a-9746-4be3-8749-9b1a9eb3169d tempest-TestStampPattern-749254378 None] Converted 1024.00 MB image at 99.80 MB/s Sep 28 15:13:41 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-19e1555a-9746-4be3-8749-9b1a9eb3169d tempest-TestStampPattern-749254378 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0693681a-4f88-4b56-941f-a581256e8484 is being set with open permissions: ugo+rw Sep 28 15:13:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-19e1555a-9746-4be3-8749-9b1a9eb3169d tempest-TestStampPattern-749254378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0693681a-4f88-4b56-941f-a581256e8484 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:41 devstack sudo[106797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0693681a-4f88-4b56-941f-a581256e8484 Sep 28 15:13:41 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:41 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-19e1555a-9746-4be3-8749-9b1a9eb3169d tempest-TestStampPattern-749254378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0693681a-4f88-4b56-941f-a581256e8484" returned: 0 in 0.434s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-19e1555a-9746-4be3-8749-9b1a9eb3169d tempest-TestStampPattern-749254378 None] Lock "cinder-quobyte-0693681a-4f88-4b56-941f-a581256e8484" released by "_copy_volume_from_snapshot" :: held 11.703s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-19e1555a-9746-4be3-8749-9b1a9eb3169d tempest-TestStampPattern-749254378 None] Lock "cinder-quobyte-9eea5e2c-4aa5-4054-888b-265138b6fbeb-0693681a-4f88-4b56-941f-a581256e8484" released by "_create_volume_from_snapshot" :: held 11.797s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-19e1555a-9746-4be3-8749-9b1a9eb3169d tempest-TestStampPattern-749254378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.819s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-19e1555a-9746-4be3-8749-9b1a9eb3169d tempest-TestStampPattern-749254378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4905b78d-a1bc-43ff-a95f-05f25d5ee9b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0693681a-4f88-4b56-941f-a581256e8484', 'volume_size': 1, 'snapshot_id': '9eea5e2c-4aa5-4054-888b-265138b6fbeb'}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-19e1555a-9746-4be3-8749-9b1a9eb3169d tempest-TestStampPattern-749254378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37ade10b-7f58-4a02-aa55-42d470419352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:41 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-19e1555a-9746-4be3-8749-9b1a9eb3169d tempest-TestStampPattern-749254378 None] Volume volume-0693681a-4f88-4b56-941f-a581256e8484 (0693681a-4f88-4b56-941f-a581256e8484): created successfully Sep 28 15:13:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-19e1555a-9746-4be3-8749-9b1a9eb3169d tempest-TestStampPattern-749254378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37ade10b-7f58-4a02-aa55-42d470419352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-19e1555a-9746-4be3-8749-9b1a9eb3169d tempest-TestStampPattern-749254378 None] Flow 'volume_create_manager' (13345c92-c61f-4bac-a72f-1d0a9cc07602) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:13:41 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-19e1555a-9746-4be3-8749-9b1a9eb3169d tempest-TestStampPattern-749254378 None] Created volume successfully. Sep 28 15:13:51 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=3,cinder:UPDATE=5 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:13:51 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:14:17 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:14:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:14:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:14:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:17 devstack sudo[106863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:14:17 devstack sudo[106863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:17 devstack sudo[106863]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.353s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:17 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:14:17 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running periodic task VolumeManager._thread_info {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:14:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] thread count: 28 {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:14:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] thread info: [<_MainThread(MainThread, started 135146735652992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:14:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-2751d9f7-63e5-4293-858a-9cf0d46594c0 req-efb73267-8d8d-4f02-bc5f-5e3e3fab91c2 tempest-TestStampPattern-749254378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-2751d9f7-63e5-4293-858a-9cf0d46594c0 req-efb73267-8d8d-4f02-bc5f-5e3e3fab91c2 tempest-TestStampPattern-749254378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-2751d9f7-63e5-4293-858a-9cf0d46594c0 req-efb73267-8d8d-4f02-bc5f-5e3e3fab91c2 tempest-TestStampPattern-749254378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-2751d9f7-63e5-4293-858a-9cf0d46594c0 req-efb73267-8d8d-4f02-bc5f-5e3e3fab91c2 tempest-TestStampPattern-749254378 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1', 'name': 'volume-0693681a-4f88-4b56-941f-a581256e8484', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5d0746d2-f903-4993-9dce-a75a25d25cd9', 'enforce_multipath': True} {{(pid=87116) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:14:24 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-2751d9f7-63e5-4293-858a-9cf0d46594c0 req-efb73267-8d8d-4f02-bc5f-5e3e3fab91c2 tempest-TestStampPattern-749254378 None] attachment_update completed successfully. Sep 28 15:14:28 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-1a64165a-2341-4a91-8c78-3bec7647aa70 req-de8e84a3-10e5-4151-adac-895a278d46f0 tempest-TestStampPattern-749254378 None] Terminate volume connection completed successfully. Sep 28 15:14:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-1a64165a-2341-4a91-8c78-3bec7647aa70 req-de8e84a3-10e5-4151-adac-895a278d46f0 tempest-TestStampPattern-749254378 None] Deleting attachment 5d0746d2-f903-4993-9dce-a75a25d25cd9. {{(pid=87116) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:14:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f06fc8c7-8b74-4083-857e-4eef6e3b7380 tempest-TestStampPattern-749254378 None] Acquiring lock "cinder-0693681a-4f88-4b56-941f-a581256e8484-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f06fc8c7-8b74-4083-857e-4eef6e3b7380 tempest-TestStampPattern-749254378 None] Lock "cinder-0693681a-4f88-4b56-941f-a581256e8484-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f06fc8c7-8b74-4083-857e-4eef6e3b7380 tempest-TestStampPattern-749254378 None] Acquiring lock "cinder-quobyte-0693681a-4f88-4b56-941f-a581256e8484" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f06fc8c7-8b74-4083-857e-4eef6e3b7380 tempest-TestStampPattern-749254378 None] Lock "cinder-quobyte-0693681a-4f88-4b56-941f-a581256e8484" acquired by "delete_volume" :: waited 0.024s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:33 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a90536-4739-4c9f-a2da-50bd04095ee1]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:14:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f06fc8c7-8b74-4083-857e-4eef6e3b7380 tempest-TestStampPattern-749254378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0693681a-4f88-4b56-941f-a581256e8484 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:33 devstack sudo[107379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0693681a-4f88-4b56-941f-a581256e8484 Sep 28 15:14:33 devstack sudo[107379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:33 devstack sudo[107379]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f06fc8c7-8b74-4083-857e-4eef6e3b7380 tempest-TestStampPattern-749254378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0693681a-4f88-4b56-941f-a581256e8484" returned: 0 in 0.410s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f06fc8c7-8b74-4083-857e-4eef6e3b7380 tempest-TestStampPattern-749254378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0693681a-4f88-4b56-941f-a581256e8484 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:33 devstack sudo[107390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0693681a-4f88-4b56-941f-a581256e8484 Sep 28 15:14:33 devstack sudo[107390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:33 devstack sudo[107390]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f06fc8c7-8b74-4083-857e-4eef6e3b7380 tempest-TestStampPattern-749254378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0693681a-4f88-4b56-941f-a581256e8484" returned: 0 in 0.282s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:34 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f06fc8c7-8b74-4083-857e-4eef6e3b7380 tempest-TestStampPattern-749254378 None] Lock "cinder-quobyte-0693681a-4f88-4b56-941f-a581256e8484" released by "delete_volume" :: held 0.746s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:34 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-f06fc8c7-8b74-4083-857e-4eef6e3b7380 tempest-TestStampPattern-749254378 None] Created reservations ['7c63b32a-b9b3-481f-a979-21d61fa33745', '792dc68b-3187-4ebd-8f5e-386cf55fa6ab', '8e49a37c-c0cf-403b-976f-020f2318b11e', 'b87f81d7-f039-4db3-866f-08b1102387e9'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:14:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f06fc8c7-8b74-4083-857e-4eef6e3b7380 tempest-TestStampPattern-749254378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f06fc8c7-8b74-4083-857e-4eef6e3b7380 tempest-TestStampPattern-749254378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:34 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f06fc8c7-8b74-4083-857e-4eef6e3b7380 tempest-TestStampPattern-749254378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:14:34 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f06fc8c7-8b74-4083-857e-4eef6e3b7380 tempest-TestStampPattern-749254378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:14:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f06fc8c7-8b74-4083-857e-4eef6e3b7380 tempest-TestStampPattern-749254378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f06fc8c7-8b74-4083-857e-4eef6e3b7380 tempest-TestStampPattern-749254378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:34 devstack sudo[107393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:14:34 devstack sudo[107393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:34 devstack sudo[107393]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f06fc8c7-8b74-4083-857e-4eef6e3b7380 tempest-TestStampPattern-749254378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.286s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:34 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-f06fc8c7-8b74-4083-857e-4eef6e3b7380 tempest-TestStampPattern-749254378 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:14:34 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-f06fc8c7-8b74-4083-857e-4eef6e3b7380 tempest-TestStampPattern-749254378 None] Deleted volume successfully. Sep 28 15:14:34 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f06fc8c7-8b74-4083-857e-4eef6e3b7380 tempest-TestStampPattern-749254378 None] Lock "cinder-0693681a-4f88-4b56-941f-a581256e8484-delete_volume" released by "delete_volume" :: held 1.287s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:34 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-eecdfaa1-d8f4-4a17-8f69-0552fa2b3be6 tempest-TestStampPattern-749254378 None] Acquiring lock "cinder-9eea5e2c-4aa5-4054-888b-265138b6fbeb-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:34 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-eecdfaa1-d8f4-4a17-8f69-0552fa2b3be6 tempest-TestStampPattern-749254378 None] Lock "cinder-9eea5e2c-4aa5-4054-888b-265138b6fbeb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:34 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-eecdfaa1-d8f4-4a17-8f69-0552fa2b3be6 tempest-TestStampPattern-749254378 None] Acquiring lock "cinder-quobyte-64e461e8-912c-4c0f-baba-7e6094a0324b" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:34 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-eecdfaa1-d8f4-4a17-8f69-0552fa2b3be6 tempest-TestStampPattern-749254378 None] Lock "cinder-quobyte-64e461e8-912c-4c0f-baba-7e6094a0324b" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:34 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-eecdfaa1-d8f4-4a17-8f69-0552fa2b3be6 tempest-TestStampPattern-749254378 None] Acquiring lock "cinder-quobyte-9eea5e2c-4aa5-4054-888b-265138b6fbeb" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:34 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-eecdfaa1-d8f4-4a17-8f69-0552fa2b3be6 tempest-TestStampPattern-749254378 None] Lock "cinder-quobyte-9eea5e2c-4aa5-4054-888b-265138b6fbeb" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:34 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-eecdfaa1-d8f4-4a17-8f69-0552fa2b3be6 tempest-TestStampPattern-749254378 None] Deleting offline snapshot 9eea5e2c-4aa5-4054-888b-265138b6fbeb of volume 64e461e8-912c-4c0f-baba-7e6094a0324b {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:14:34 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-eecdfaa1-d8f4-4a17-8f69-0552fa2b3be6 tempest-TestStampPattern-749254378 None] snapshot_file for this snap is: volume-64e461e8-912c-4c0f-baba-7e6094a0324b.9eea5e2c-4aa5-4054-888b-265138b6fbeb {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:14:34 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe2693a-24ab-428a-b85e-d80a5b3d08a8]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:14:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-eecdfaa1-d8f4-4a17-8f69-0552fa2b3be6 tempest-TestStampPattern-749254378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-64e461e8-912c-4c0f-baba-7e6094a0324b.9eea5e2c-4aa5-4054-888b-265138b6fbeb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:35 devstack sudo[107396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-64e461e8-912c-4c0f-baba-7e6094a0324b.9eea5e2c-4aa5-4054-888b-265138b6fbeb Sep 28 15:14:35 devstack sudo[107396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:35 devstack sudo[107396]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-eecdfaa1-d8f4-4a17-8f69-0552fa2b3be6 tempest-TestStampPattern-749254378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-64e461e8-912c-4c0f-baba-7e6094a0324b.9eea5e2c-4aa5-4054-888b-265138b6fbeb" returned: 0 in 0.414s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-eecdfaa1-d8f4-4a17-8f69-0552fa2b3be6 tempest-TestStampPattern-749254378 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64e461e8-912c-4c0f-baba-7e6094a0324b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:14:35 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c7da46-63ec-4b4d-8c4f-3340055579dd]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:14:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-eecdfaa1-d8f4-4a17-8f69-0552fa2b3be6 tempest-TestStampPattern-749254378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-64e461e8-912c-4c0f-baba-7e6094a0324b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:35 devstack sudo[107401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-64e461e8-912c-4c0f-baba-7e6094a0324b Sep 28 15:14:35 devstack sudo[107401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:36 devstack sudo[107401]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-eecdfaa1-d8f4-4a17-8f69-0552fa2b3be6 tempest-TestStampPattern-749254378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-64e461e8-912c-4c0f-baba-7e6094a0324b" returned: 0 in 0.656s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-eecdfaa1-d8f4-4a17-8f69-0552fa2b3be6 tempest-TestStampPattern-749254378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-64e461e8-912c-4c0f-baba-7e6094a0324b.9eea5e2c-4aa5-4054-888b-265138b6fbeb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:36 devstack sudo[107406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-64e461e8-912c-4c0f-baba-7e6094a0324b.9eea5e2c-4aa5-4054-888b-265138b6fbeb Sep 28 15:14:36 devstack sudo[107406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:36 devstack sudo[107406]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-eecdfaa1-d8f4-4a17-8f69-0552fa2b3be6 tempest-TestStampPattern-749254378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-64e461e8-912c-4c0f-baba-7e6094a0324b.9eea5e2c-4aa5-4054-888b-265138b6fbeb" returned: 0 in 0.373s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-eecdfaa1-d8f4-4a17-8f69-0552fa2b3be6 tempest-TestStampPattern-749254378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-64e461e8-912c-4c0f-baba-7e6094a0324b.9eea5e2c-4aa5-4054-888b-265138b6fbeb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:36 devstack sudo[107411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-64e461e8-912c-4c0f-baba-7e6094a0324b.9eea5e2c-4aa5-4054-888b-265138b6fbeb Sep 28 15:14:36 devstack sudo[107411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:36 devstack sudo[107411]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-eecdfaa1-d8f4-4a17-8f69-0552fa2b3be6 tempest-TestStampPattern-749254378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-64e461e8-912c-4c0f-baba-7e6094a0324b.9eea5e2c-4aa5-4054-888b-265138b6fbeb" returned: 0 in 0.296s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:36 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-eecdfaa1-d8f4-4a17-8f69-0552fa2b3be6 tempest-TestStampPattern-749254378 None] Lock "cinder-quobyte-9eea5e2c-4aa5-4054-888b-265138b6fbeb" released by "_delete_snapshot" :: held 1.861s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:36 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-eecdfaa1-d8f4-4a17-8f69-0552fa2b3be6 tempest-TestStampPattern-749254378 None] Lock "cinder-quobyte-64e461e8-912c-4c0f-baba-7e6094a0324b" released by "delete_snapshot" :: held 1.886s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:36 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-eecdfaa1-d8f4-4a17-8f69-0552fa2b3be6 tempest-TestStampPattern-749254378 None] Created reservations ['e01ad5a8-12e6-43b4-9f31-962d9367d1f6', '0c10ef0e-7b52-4662-9b38-7b5a11dace07', '0c9fc65a-94dd-49d3-9044-98831df6253b', '618cce4b-18ad-48ef-bd02-4fd23a0d5269'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:14:36 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-eecdfaa1-d8f4-4a17-8f69-0552fa2b3be6 tempest-TestStampPattern-749254378 None] Delete snapshot completed successfully. Sep 28 15:14:36 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-eecdfaa1-d8f4-4a17-8f69-0552fa2b3be6 tempest-TestStampPattern-749254378 None] Lock "cinder-9eea5e2c-4aa5-4054-888b-265138b6fbeb-delete_snapshot" released by "delete_snapshot" :: held 2.051s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:40 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-68ed7351-b1fd-4040-9ac5-e376a421890e tempest-TestStampPattern-749254378 None] Acquiring lock "cinder-64e461e8-912c-4c0f-baba-7e6094a0324b-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:40 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-68ed7351-b1fd-4040-9ac5-e376a421890e tempest-TestStampPattern-749254378 None] Lock "cinder-64e461e8-912c-4c0f-baba-7e6094a0324b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:40 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-68ed7351-b1fd-4040-9ac5-e376a421890e tempest-TestStampPattern-749254378 None] Acquiring lock "cinder-quobyte-64e461e8-912c-4c0f-baba-7e6094a0324b" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:40 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-68ed7351-b1fd-4040-9ac5-e376a421890e tempest-TestStampPattern-749254378 None] Lock "cinder-quobyte-64e461e8-912c-4c0f-baba-7e6094a0324b" acquired by "delete_volume" :: waited 0.021s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:40 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55a34dd-c16e-4979-badf-aeac28f3aed5]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:14:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-68ed7351-b1fd-4040-9ac5-e376a421890e tempest-TestStampPattern-749254378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-64e461e8-912c-4c0f-baba-7e6094a0324b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:41 devstack sudo[107445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-64e461e8-912c-4c0f-baba-7e6094a0324b Sep 28 15:14:41 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:41 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-68ed7351-b1fd-4040-9ac5-e376a421890e tempest-TestStampPattern-749254378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-64e461e8-912c-4c0f-baba-7e6094a0324b" returned: 0 in 0.393s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-68ed7351-b1fd-4040-9ac5-e376a421890e tempest-TestStampPattern-749254378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-64e461e8-912c-4c0f-baba-7e6094a0324b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:41 devstack sudo[107451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-64e461e8-912c-4c0f-baba-7e6094a0324b Sep 28 15:14:41 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:41 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-68ed7351-b1fd-4040-9ac5-e376a421890e tempest-TestStampPattern-749254378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-64e461e8-912c-4c0f-baba-7e6094a0324b" returned: 0 in 0.270s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-68ed7351-b1fd-4040-9ac5-e376a421890e tempest-TestStampPattern-749254378 None] Lock "cinder-quobyte-64e461e8-912c-4c0f-baba-7e6094a0324b" released by "delete_volume" :: held 0.734s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:41 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-68ed7351-b1fd-4040-9ac5-e376a421890e tempest-TestStampPattern-749254378 None] Created reservations ['097e903a-e64a-4ca0-8416-9a661dbd7847', 'cc3bd921-49a9-41d3-bad6-df741daed65b', 'b6ac0a49-7e02-476f-a0ad-5f80fc38f7c3', 'cde43586-3d6a-4708-abbf-ef2755ca168f'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:14:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-68ed7351-b1fd-4040-9ac5-e376a421890e tempest-TestStampPattern-749254378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-68ed7351-b1fd-4040-9ac5-e376a421890e tempest-TestStampPattern-749254378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:41 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-68ed7351-b1fd-4040-9ac5-e376a421890e tempest-TestStampPattern-749254378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:14:41 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-68ed7351-b1fd-4040-9ac5-e376a421890e tempest-TestStampPattern-749254378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:14:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-68ed7351-b1fd-4040-9ac5-e376a421890e tempest-TestStampPattern-749254378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-68ed7351-b1fd-4040-9ac5-e376a421890e tempest-TestStampPattern-749254378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:41 devstack sudo[107488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:14:41 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:42 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-68ed7351-b1fd-4040-9ac5-e376a421890e tempest-TestStampPattern-749254378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.389s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:42 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-68ed7351-b1fd-4040-9ac5-e376a421890e tempest-TestStampPattern-749254378 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:14:42 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-68ed7351-b1fd-4040-9ac5-e376a421890e tempest-TestStampPattern-749254378 None] Deleted volume successfully. Sep 28 15:14:42 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-68ed7351-b1fd-4040-9ac5-e376a421890e tempest-TestStampPattern-749254378 None] Lock "cinder-64e461e8-912c-4c0f-baba-7e6094a0324b-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:51 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=19,cinder:UPDATE=21,cinder:INSERT=7 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:14:52 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=27,cinder:UPDATE=25,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:15:00 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:15:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Flow 'volume_create_manager' (17033e77-c7ce-41fe-a573-2992da33a360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:15:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d88cb6d8-4fc0-4786-908a-49f7ebd6fafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d88cb6d8-4fc0-4786-908a-49f7ebd6fafd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae913980-a732-40c2-a9e6-b5de0c818744,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20b99efcee1f4331941dfbe6cbe30861',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:00Z,use_quota=True,user_id='f96402ff58a74c6a8bb9f7442e40e0b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e0559aa-5f5e-47c7-a8fe-03502014424e),volume_type_id=6e0559aa-5f5e-47c7-a8fe-03502014424e)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0e8e006-e2eb-48e9-858b-abceaf257fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0e8e006-e2eb-48e9-858b-abceaf257fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ede09857-72f7-45a0-ad4c-c1eb3a23137b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:00 devstack cinder-volume[87116]: DEBUG cinder.image.glance [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Creating Keystone auth plugin from conf {{(pid=87116) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 15:15:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ede09857-72f7-45a0-ad4c-c1eb3a23137b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ae913980-a732-40c2-a9e6-b5de0c818744', 'volume_name': 'volume-ae913980-a732-40c2-a9e6-b5de0c818744', 'volume_size': 1, 'image_id': 'f57990eb-2050-4162-bb53-4f4b206d0b3c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f57990eb-2050-4162-bb53-4f4b206d0b3c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e67c9205c3a96faca7714478162321fe', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '20b99efcee1f4331941dfbe6cbe30861', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '108af1ceb61dfc264cda194dda52aa0ecb6f0de18c4e46d354a74c98f776345c69aa07a0976779f4bb443c931aff4149dbb73248f7c62cd9952612d6205f11bb', 'id': 'f57990eb-2050-4162-bb53-4f4b206d0b3c', 'created_at': datetime.datetime(2026, 9, 28, 13, 14, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 14, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f57990eb-2050-4162-bb53-4f4b206d0b3c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07a57ea9-86df-4e07-8fe6-1aa4fa3ce36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07a57ea9-86df-4e07-8fe6-1aa4fa3ce36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1247ca6d-421c-4f07-8498-728053af5797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:00 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Volume ae913980-a732-40c2-a9e6-b5de0c818744: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ae913980-a732-40c2-a9e6-b5de0c818744', 'volume_size': 1, 'image_id': 'f57990eb-2050-4162-bb53-4f4b206d0b3c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f57990eb-2050-4162-bb53-4f4b206d0b3c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e67c9205c3a96faca7714478162321fe', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '20b99efcee1f4331941dfbe6cbe30861', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '108af1ceb61dfc264cda194dda52aa0ecb6f0de18c4e46d354a74c98f776345c69aa07a0976779f4bb443c931aff4149dbb73248f7c62cd9952612d6205f11bb', 'id': 'f57990eb-2050-4162-bb53-4f4b206d0b3c', 'created_at': datetime.datetime(2026, 9, 28, 13, 14, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 14, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f57990eb-2050-4162-bb53-4f4b206d0b3c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 28 15:15:00 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Trying to clone ae913980-a732-40c2-a9e6-b5de0c818744 from image f57990eb-2050-4162-bb53-4f4b206d0b3c at location (None, [{'url': 'file:///opt/stack/data/glance/images/f57990eb-2050-4162-bb53-4f4b206d0b3c', 'metadata': {}}]). {{(pid=87116) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 15:15:00 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f57990eb-2050-4162-bb53-4f4b206d0b3c_vca881vndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87116) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 15:15:00 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Image download 0.00 MB at 0.00 MB/s Sep 28 15:15:00 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf151bb3-62ab-4d75-bc05-47de7d2afa15]: (4, 'raw') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f57990eb-2050-4162-bb53-4f4b206d0b3c_vca881vndevstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:00 devstack sudo[107500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f57990eb-2050-4162-bb53-4f4b206d0b3c_vca881vndevstack@QuobyteHD Sep 28 15:15:00 devstack sudo[107500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:01 devstack sudo[107500]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f57990eb-2050-4162-bb53-4f4b206d0b3c_vca881vndevstack@QuobyteHD" returned: 0 in 0.387s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f57990eb-2050-4162-bb53-4f4b206d0b3c_vca881vndevstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:01 devstack sudo[107507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f57990eb-2050-4162-bb53-4f4b206d0b3c_vca881vndevstack@QuobyteHD Sep 28 15:15:01 devstack sudo[107507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:01 devstack sudo[107507]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f57990eb-2050-4162-bb53-4f4b206d0b3c_vca881vndevstack@QuobyteHD" returned: 1 in 0.466s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f57990eb-2050-4162-bb53-4f4b206d0b3c_vca881vndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:15:01 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Temporary image f57990eb-2050-4162-bb53-4f4b206d0b3c is fetched for user f96402ff58a74c6a8bb9f7442e40e0b1. {{(pid=87116) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 15:15:01 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[78558639-f6e5-4a68-a317-7edfd399f9fe]: (4, 'raw') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f57990eb-2050-4162-bb53-4f4b206d0b3c_vca881vndevstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:01 devstack sudo[107513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f57990eb-2050-4162-bb53-4f4b206d0b3c_vca881vndevstack@QuobyteHD Sep 28 15:15:01 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:02 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f57990eb-2050-4162-bb53-4f4b206d0b3c_vca881vndevstack@QuobyteHD" returned: 0 in 0.370s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f57990eb-2050-4162-bb53-4f4b206d0b3c_vca881vndevstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:02 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f57990eb-2050-4162-bb53-4f4b206d0b3c_vca881vndevstack@QuobyteHD Sep 28 15:15:02 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:02 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f57990eb-2050-4162-bb53-4f4b206d0b3c_vca881vndevstack@QuobyteHD" returned: 1 in 0.371s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f57990eb-2050-4162-bb53-4f4b206d0b3c_vca881vndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:15:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae913980-a732-40c2-a9e6-b5de0c818744,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20b99efcee1f4331941dfbe6cbe30861',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:00Z,use_quota=True,user_id='f96402ff58a74c6a8bb9f7442e40e0b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e0559aa-5f5e-47c7-a8fe-03502014424e),volume_type_id=6e0559aa-5f5e-47c7-a8fe-03502014424e)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:15:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Creating volume ae913980-a732-40c2-a9e6-b5de0c818744 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:15:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:15:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:15:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:15:02 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:15:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae913980-a732-40c2-a9e6-b5de0c818744 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:02 devstack sudo[107522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae913980-a732-40c2-a9e6-b5de0c818744 1073741824 Sep 28 15:15:02 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:02 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae913980-a732-40c2-a9e6-b5de0c818744 1073741824" returned: 0 in 0.519s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae913980-a732-40c2-a9e6-b5de0c818744 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:03 devstack sudo[107528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae913980-a732-40c2-a9e6-b5de0c818744 Sep 28 15:15:03 devstack sudo[107528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:03 devstack sudo[107528]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae913980-a732-40c2-a9e6-b5de0c818744" returned: 0 in 0.289s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:15:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:03 devstack cinder-volume[87116]: DEBUG cinder.volume.volume_utils [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Attempting download of f57990eb-2050-4162-bb53-4f4b206d0b3c ((None, [{'url': 'file:///opt/stack/data/glance/images/f57990eb-2050-4162-bb53-4f4b206d0b3c', 'metadata': {}}])) to volume ae913980-a732-40c2-a9e6-b5de0c818744. {{(pid=87116) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1208}} Sep 28 15:15:03 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[36878726-1617-412a-9e96-3f2d8e1805a2]: (4, 'raw') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f57990eb-2050-4162-bb53-4f4b206d0b3c_n0zrk_51 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:03 devstack sudo[107531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f57990eb-2050-4162-bb53-4f4b206d0b3c_n0zrk_51 Sep 28 15:15:03 devstack sudo[107531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:03 devstack sudo[107531]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f57990eb-2050-4162-bb53-4f4b206d0b3c_n0zrk_51" returned: 0 in 0.380s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f57990eb-2050-4162-bb53-4f4b206d0b3c_n0zrk_51 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:03 devstack sudo[107536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f57990eb-2050-4162-bb53-4f4b206d0b3c_n0zrk_51 Sep 28 15:15:03 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:04 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f57990eb-2050-4162-bb53-4f4b206d0b3c_n0zrk_51" returned: 1 in 0.381s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f57990eb-2050-4162-bb53-4f4b206d0b3c_n0zrk_51' failed. Not Retrying. {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:15:04 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c139582-64f5-403c-bba1-73089599789d]: (4, 'raw') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f57990eb-2050-4162-bb53-4f4b206d0b3c_vca881vndevstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:04 devstack sudo[107540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f57990eb-2050-4162-bb53-4f4b206d0b3c_vca881vndevstack@QuobyteHD Sep 28 15:15:04 devstack sudo[107540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:04 devstack sudo[107540]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f57990eb-2050-4162-bb53-4f4b206d0b3c_vca881vndevstack@QuobyteHD" returned: 0 in 0.362s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f57990eb-2050-4162-bb53-4f4b206d0b3c_vca881vndevstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:04 devstack sudo[107544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f57990eb-2050-4162-bb53-4f4b206d0b3c_vca881vndevstack@QuobyteHD Sep 28 15:15:04 devstack sudo[107544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:04 devstack sudo[107544]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f57990eb-2050-4162-bb53-4f4b206d0b3c_vca881vndevstack@QuobyteHD" returned: 1 in 0.352s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f57990eb-2050-4162-bb53-4f4b206d0b3c_vca881vndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:15:04 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] f57990eb-2050-4162-bb53-4f4b206d0b3c was raw, converting to qcow2 {{(pid=87116) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 15:15:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f57990eb-2050-4162-bb53-4f4b206d0b3c_vca881vndevstack@QuobyteHD /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae913980-a732-40c2-a9e6-b5de0c818744 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:04 devstack sudo[107549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f57990eb-2050-4162-bb53-4f4b206d0b3c_vca881vndevstack@QuobyteHD /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae913980-a732-40c2-a9e6-b5de0c818744 Sep 28 15:15:04 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:05 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f57990eb-2050-4162-bb53-4f4b206d0b3c_vca881vndevstack@QuobyteHD /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae913980-a732-40c2-a9e6-b5de0c818744" returned: 0 in 0.491s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:05 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f57990eb-2050-4162-bb53-4f4b206d0b3c_vca881vndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae913980-a732-40c2-a9e6-b5de0c818744 {{(pid=87116) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:15:05 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 15:15:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae913980-a732-40c2-a9e6-b5de0c818744 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:05 devstack sudo[107555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae913980-a732-40c2-a9e6-b5de0c818744 1G Sep 28 15:15:05 devstack sudo[107555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:05 devstack sudo[107555]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae913980-a732-40c2-a9e6-b5de0c818744 1G" returned: 0 in 0.350s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:05 devstack cinder-volume[87116]: DEBUG cinder.volume.volume_utils [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Downloaded image f57990eb-2050-4162-bb53-4f4b206d0b3c ((None, [{'url': 'file:///opt/stack/data/glance/images/f57990eb-2050-4162-bb53-4f4b206d0b3c', 'metadata': {}}])) to volume ae913980-a732-40c2-a9e6-b5de0c818744 successfully. {{(pid=87116) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1253}} Sep 28 15:15:05 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Temporary image f57990eb-2050-4162-bb53-4f4b206d0b3c for user f96402ff58a74c6a8bb9f7442e40e0b1 is deleted. {{(pid=87116) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 15:15:05 devstack cinder-volume[87116]: DEBUG cinder.volume.volume_utils [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Marking volume ae913980-a732-40c2-a9e6-b5de0c818744 as bootable. {{(pid=87116) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1157}} Sep 28 15:15:05 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Copying metadata from image f57990eb-2050-4162-bb53-4f4b206d0b3c to ae913980-a732-40c2-a9e6-b5de0c818744. {{(pid=87116) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 15:15:05 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Creating volume glance metadata for volume ae913980-a732-40c2-a9e6-b5de0c818744 backed by image f57990eb-2050-4162-bb53-4f4b206d0b3c with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'f57990eb-2050-4162-bb53-4f4b206d0b3c', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'e67c9205c3a96faca7714478162321fe', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87116) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 15:15:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1247ca6d-421c-4f07-8498-728053af5797) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae913980-a732-40c2-a9e6-b5de0c818744', 'volume_size': 1, 'image_id': 'f57990eb-2050-4162-bb53-4f4b206d0b3c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f57990eb-2050-4162-bb53-4f4b206d0b3c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e67c9205c3a96faca7714478162321fe', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '20b99efcee1f4331941dfbe6cbe30861', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '108af1ceb61dfc264cda194dda52aa0ecb6f0de18c4e46d354a74c98f776345c69aa07a0976779f4bb443c931aff4149dbb73248f7c62cd9952612d6205f11bb', 'id': 'f57990eb-2050-4162-bb53-4f4b206d0b3c', 'created_at': datetime.datetime(2026, 9, 28, 13, 14, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 14, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f57990eb-2050-4162-bb53-4f4b206d0b3c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f2e0591-1007-4b36-a2dc-7a7c5bb03d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:05 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Volume volume-ae913980-a732-40c2-a9e6-b5de0c818744 (ae913980-a732-40c2-a9e6-b5de0c818744): created successfully Sep 28 15:15:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f2e0591-1007-4b36-a2dc-7a7c5bb03d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Flow 'volume_create_manager' (17033e77-c7ce-41fe-a573-2992da33a360) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:15:05 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-30c1ca8a-c781-485a-af05-3bd75529c1bb tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Created volume successfully. Sep 28 15:15:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e5196bc4-caf1-44b7-a5d4-817ec35edcae tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Acquiring lock "cinder-ae913980-a732-40c2-a9e6-b5de0c818744-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e5196bc4-caf1-44b7-a5d4-817ec35edcae tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Lock "cinder-ae913980-a732-40c2-a9e6-b5de0c818744-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e5196bc4-caf1-44b7-a5d4-817ec35edcae tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Acquiring lock "cinder-quobyte-ae913980-a732-40c2-a9e6-b5de0c818744" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e5196bc4-caf1-44b7-a5d4-817ec35edcae tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Lock "cinder-quobyte-ae913980-a732-40c2-a9e6-b5de0c818744" acquired by "delete_volume" :: waited 0.019s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:06 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[23edd8e0-923f-43c7-9b92-24244c6999d2]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e5196bc4-caf1-44b7-a5d4-817ec35edcae tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae913980-a732-40c2-a9e6-b5de0c818744 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:06 devstack sudo[107560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae913980-a732-40c2-a9e6-b5de0c818744 Sep 28 15:15:06 devstack sudo[107560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:07 devstack sudo[107560]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e5196bc4-caf1-44b7-a5d4-817ec35edcae tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae913980-a732-40c2-a9e6-b5de0c818744" returned: 0 in 0.387s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e5196bc4-caf1-44b7-a5d4-817ec35edcae tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae913980-a732-40c2-a9e6-b5de0c818744 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:07 devstack sudo[107565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae913980-a732-40c2-a9e6-b5de0c818744 Sep 28 15:15:07 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:07 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e5196bc4-caf1-44b7-a5d4-817ec35edcae tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ae913980-a732-40c2-a9e6-b5de0c818744" returned: 0 in 0.323s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:07 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e5196bc4-caf1-44b7-a5d4-817ec35edcae tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Lock "cinder-quobyte-ae913980-a732-40c2-a9e6-b5de0c818744" released by "delete_volume" :: held 0.764s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:15:07 devstack cinder-volume[87116]: WARNING cinder.quota [None req-e5196bc4-caf1-44b7-a5d4-817ec35edcae tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:15:07 devstack cinder-volume[87116]: WARNING cinder.quota [None req-e5196bc4-caf1-44b7-a5d4-817ec35edcae tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:15:07 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-e5196bc4-caf1-44b7-a5d4-817ec35edcae tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Created reservations ['14b1c837-85df-45e7-a674-ee6d1478fafe', '73b2b5ae-4102-4601-917c-4961a4a361f7', '73ad9a52-baed-42cc-9cc2-f2e090abd7dd', '60b137f0-4c63-45c6-ba0d-f569ceb897d3'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:15:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e5196bc4-caf1-44b7-a5d4-817ec35edcae tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e5196bc4-caf1-44b7-a5d4-817ec35edcae tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:07 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e5196bc4-caf1-44b7-a5d4-817ec35edcae tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:15:07 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e5196bc4-caf1-44b7-a5d4-817ec35edcae tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:15:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e5196bc4-caf1-44b7-a5d4-817ec35edcae tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e5196bc4-caf1-44b7-a5d4-817ec35edcae tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:07 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:15:07 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:07 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e5196bc4-caf1-44b7-a5d4-817ec35edcae tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.315s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:07 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-e5196bc4-caf1-44b7-a5d4-817ec35edcae tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:15:07 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-e5196bc4-caf1-44b7-a5d4-817ec35edcae tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Deleted volume successfully. Sep 28 15:15:07 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e5196bc4-caf1-44b7-a5d4-817ec35edcae tempest-VolumeAndVolumeTypeFromImageTest-203361331 None] Lock "cinder-ae913980-a732-40c2-a9e6-b5de0c818744-delete_volume" released by "delete_volume" :: held 1.334s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:15:12 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-dda2b808-dce7-4348-8a5d-ba997f1d128a tempest-CreateVolumesFromSnapshotTest-1458448126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:15:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dda2b808-dce7-4348-8a5d-ba997f1d128a tempest-CreateVolumesFromSnapshotTest-1458448126 None] Flow 'volume_create_manager' (c3b7dd72-37e3-44e5-82a6-d6451c862c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:15:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dda2b808-dce7-4348-8a5d-ba997f1d128a tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f68d7b5f-eb35-4e4f-9007-ee4d0aa1c91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dda2b808-dce7-4348-8a5d-ba997f1d128a tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f68d7b5f-eb35-4e4f-9007-ee4d0aa1c91a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-256651675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8c71922-7190-4e68-933c-92aaf14f7800,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22edb32356fe4f099f80aab0f39388f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:13Z,use_quota=True,user_id='2f59116fac6d4d93af9c8dfe7c4833a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dda2b808-dce7-4348-8a5d-ba997f1d128a tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59909d39-25e6-43ab-b09c-24be84f15ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:13 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dda2b808-dce7-4348-8a5d-ba997f1d128a tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59909d39-25e6-43ab-b09c-24be84f15ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:13 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dda2b808-dce7-4348-8a5d-ba997f1d128a tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (624c6202-2b08-4da0-9cc4-b2fa7ec831ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:13 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dda2b808-dce7-4348-8a5d-ba997f1d128a tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (624c6202-2b08-4da0-9cc4-b2fa7ec831ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8c71922-7190-4e68-933c-92aaf14f7800', 'volume_name': 'volume-b8c71922-7190-4e68-933c-92aaf14f7800', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:13 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dda2b808-dce7-4348-8a5d-ba997f1d128a tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (865566c8-232f-42dc-9812-13632b8bdd16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:13 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dda2b808-dce7-4348-8a5d-ba997f1d128a tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (865566c8-232f-42dc-9812-13632b8bdd16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:13 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dda2b808-dce7-4348-8a5d-ba997f1d128a tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e21563ce-d049-481a-b298-3a1933b8aa13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:13 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-dda2b808-dce7-4348-8a5d-ba997f1d128a tempest-CreateVolumesFromSnapshotTest-1458448126 None] Volume b8c71922-7190-4e68-933c-92aaf14f7800: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8c71922-7190-4e68-933c-92aaf14f7800', 'volume_size': 1} Sep 28 15:15:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dda2b808-dce7-4348-8a5d-ba997f1d128a tempest-CreateVolumesFromSnapshotTest-1458448126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dda2b808-dce7-4348-8a5d-ba997f1d128a tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:13 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-dda2b808-dce7-4348-8a5d-ba997f1d128a tempest-CreateVolumesFromSnapshotTest-1458448126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-256651675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8c71922-7190-4e68-933c-92aaf14f7800,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22edb32356fe4f099f80aab0f39388f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:13Z,use_quota=True,user_id='2f59116fac6d4d93af9c8dfe7c4833a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:15:13 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-dda2b808-dce7-4348-8a5d-ba997f1d128a tempest-CreateVolumesFromSnapshotTest-1458448126 None] Creating volume b8c71922-7190-4e68-933c-92aaf14f7800 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:15:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dda2b808-dce7-4348-8a5d-ba997f1d128a tempest-CreateVolumesFromSnapshotTest-1458448126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dda2b808-dce7-4348-8a5d-ba997f1d128a tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:13 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-dda2b808-dce7-4348-8a5d-ba997f1d128a tempest-CreateVolumesFromSnapshotTest-1458448126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:15:13 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-dda2b808-dce7-4348-8a5d-ba997f1d128a tempest-CreateVolumesFromSnapshotTest-1458448126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:15:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dda2b808-dce7-4348-8a5d-ba997f1d128a tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:13 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-dda2b808-dce7-4348-8a5d-ba997f1d128a tempest-CreateVolumesFromSnapshotTest-1458448126 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:15:13 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-dda2b808-dce7-4348-8a5d-ba997f1d128a tempest-CreateVolumesFromSnapshotTest-1458448126 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:15:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dda2b808-dce7-4348-8a5d-ba997f1d128a tempest-CreateVolumesFromSnapshotTest-1458448126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b8c71922-7190-4e68-933c-92aaf14f7800 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:13 devstack sudo[107572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b8c71922-7190-4e68-933c-92aaf14f7800 1073741824 Sep 28 15:15:13 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:13 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dda2b808-dce7-4348-8a5d-ba997f1d128a tempest-CreateVolumesFromSnapshotTest-1458448126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b8c71922-7190-4e68-933c-92aaf14f7800 1073741824" returned: 0 in 0.500s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dda2b808-dce7-4348-8a5d-ba997f1d128a tempest-CreateVolumesFromSnapshotTest-1458448126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b8c71922-7190-4e68-933c-92aaf14f7800 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:13 devstack sudo[107577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b8c71922-7190-4e68-933c-92aaf14f7800 Sep 28 15:15:13 devstack sudo[107577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:13 devstack sudo[107577]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dda2b808-dce7-4348-8a5d-ba997f1d128a tempest-CreateVolumesFromSnapshotTest-1458448126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b8c71922-7190-4e68-933c-92aaf14f7800" returned: 0 in 0.298s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:13 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-dda2b808-dce7-4348-8a5d-ba997f1d128a tempest-CreateVolumesFromSnapshotTest-1458448126 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:15:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dda2b808-dce7-4348-8a5d-ba997f1d128a tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:13 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dda2b808-dce7-4348-8a5d-ba997f1d128a tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e21563ce-d049-481a-b298-3a1933b8aa13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8c71922-7190-4e68-933c-92aaf14f7800', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:13 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dda2b808-dce7-4348-8a5d-ba997f1d128a tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b71759f-6ca5-4c09-9f22-a36e2d2ac593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:13 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-dda2b808-dce7-4348-8a5d-ba997f1d128a tempest-CreateVolumesFromSnapshotTest-1458448126 None] Volume volume-b8c71922-7190-4e68-933c-92aaf14f7800 (b8c71922-7190-4e68-933c-92aaf14f7800): created successfully Sep 28 15:15:13 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dda2b808-dce7-4348-8a5d-ba997f1d128a tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b71759f-6ca5-4c09-9f22-a36e2d2ac593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:13 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dda2b808-dce7-4348-8a5d-ba997f1d128a tempest-CreateVolumesFromSnapshotTest-1458448126 None] Flow 'volume_create_manager' (c3b7dd72-37e3-44e5-82a6-d6451c862c85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:15:13 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-dda2b808-dce7-4348-8a5d-ba997f1d128a tempest-CreateVolumesFromSnapshotTest-1458448126 None] Created volume successfully. Sep 28 15:15:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a45a637b-393d-4dc1-ae42-b4b083e0eb52 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a45a637b-393d-4dc1-ae42-b4b083e0eb52 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-a45a637b-393d-4dc1-ae42-b4b083e0eb52 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Creating offline snapshot c872dad8-13c9-490f-a04e-540066893672 of volume b8c71922-7190-4e68-933c-92aaf14f7800 {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:15:15 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc7dd9b-9fbd-48a3-b77f-f37c64f4b9c4]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a45a637b-393d-4dc1-ae42-b4b083e0eb52 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b8c71922-7190-4e68-933c-92aaf14f7800 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:15 devstack sudo[107580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b8c71922-7190-4e68-933c-92aaf14f7800 Sep 28 15:15:15 devstack sudo[107580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:15 devstack sudo[107580]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a45a637b-393d-4dc1-ae42-b4b083e0eb52 tempest-CreateVolumesFromSnapshotTest-1458448126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b8c71922-7190-4e68-933c-92aaf14f7800" returned: 0 in 0.389s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a45a637b-393d-4dc1-ae42-b4b083e0eb52 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b8c71922-7190-4e68-933c-92aaf14f7800,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b8c71922-7190-4e68-933c-92aaf14f7800.c872dad8-13c9-490f-a04e-540066893672 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:15 devstack sudo[107585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b8c71922-7190-4e68-933c-92aaf14f7800,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b8c71922-7190-4e68-933c-92aaf14f7800.c872dad8-13c9-490f-a04e-540066893672 1G Sep 28 15:15:15 devstack sudo[107585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:16 devstack sudo[107585]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a45a637b-393d-4dc1-ae42-b4b083e0eb52 tempest-CreateVolumesFromSnapshotTest-1458448126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b8c71922-7190-4e68-933c-92aaf14f7800,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b8c71922-7190-4e68-933c-92aaf14f7800.c872dad8-13c9-490f-a04e-540066893672 1G" returned: 0 in 0.462s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a45a637b-393d-4dc1-ae42-b4b083e0eb52 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8c71922-7190-4e68-933c-92aaf14f7800 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b8c71922-7190-4e68-933c-92aaf14f7800.c872dad8-13c9-490f-a04e-540066893672 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:16 devstack sudo[107591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8c71922-7190-4e68-933c-92aaf14f7800 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b8c71922-7190-4e68-933c-92aaf14f7800.c872dad8-13c9-490f-a04e-540066893672 Sep 28 15:15:16 devstack sudo[107591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:16 devstack sudo[107591]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a45a637b-393d-4dc1-ae42-b4b083e0eb52 tempest-CreateVolumesFromSnapshotTest-1458448126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8c71922-7190-4e68-933c-92aaf14f7800 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b8c71922-7190-4e68-933c-92aaf14f7800.c872dad8-13c9-490f-a04e-540066893672" returned: 0 in 0.325s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:16 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-a45a637b-393d-4dc1-ae42-b4b083e0eb52 tempest-CreateVolumesFromSnapshotTest-1458448126 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b8c71922-7190-4e68-933c-92aaf14f7800.c872dad8-13c9-490f-a04e-540066893672 is being set with open permissions: ugo+rw Sep 28 15:15:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a45a637b-393d-4dc1-ae42-b4b083e0eb52 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b8c71922-7190-4e68-933c-92aaf14f7800.c872dad8-13c9-490f-a04e-540066893672 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:16 devstack sudo[107596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b8c71922-7190-4e68-933c-92aaf14f7800.c872dad8-13c9-490f-a04e-540066893672 Sep 28 15:15:16 devstack sudo[107596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:16 devstack sudo[107596]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a45a637b-393d-4dc1-ae42-b4b083e0eb52 tempest-CreateVolumesFromSnapshotTest-1458448126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b8c71922-7190-4e68-933c-92aaf14f7800.c872dad8-13c9-490f-a04e-540066893672" returned: 0 in 0.290s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a45a637b-393d-4dc1-ae42-b4b083e0eb52 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b8c71922-7190-4e68-933c-92aaf14f7800.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:16 devstack sudo[107599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b8c71922-7190-4e68-933c-92aaf14f7800.info Sep 28 15:15:16 devstack sudo[107599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:17 devstack sudo[107599]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a45a637b-393d-4dc1-ae42-b4b083e0eb52 tempest-CreateVolumesFromSnapshotTest-1458448126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b8c71922-7190-4e68-933c-92aaf14f7800.info" returned: 0 in 0.269s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:17 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-a45a637b-393d-4dc1-ae42-b4b083e0eb52 tempest-CreateVolumesFromSnapshotTest-1458448126 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b8c71922-7190-4e68-933c-92aaf14f7800.info is being set with open permissions: ugo+rw Sep 28 15:15:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a45a637b-393d-4dc1-ae42-b4b083e0eb52 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b8c71922-7190-4e68-933c-92aaf14f7800.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:17 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:15:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:15:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:15:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:17 devstack sudo[107602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b8c71922-7190-4e68-933c-92aaf14f7800.info Sep 28 15:15:17 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:17 devstack sudo[107604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:15:17 devstack sudo[107604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:17 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a45a637b-393d-4dc1-ae42-b4b083e0eb52 tempest-CreateVolumesFromSnapshotTest-1458448126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b8c71922-7190-4e68-933c-92aaf14f7800.info" returned: 0 in 0.275s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a45a637b-393d-4dc1-ae42-b4b083e0eb52 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.120s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:17 devstack sudo[107604]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.289s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:17 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:15:17 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running periodic task VolumeManager._thread_info {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:15:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] thread count: 28 {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:15:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] thread info: [<_MainThread(MainThread, started 135146735652992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:15:17 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-a45a637b-393d-4dc1-ae42-b4b083e0eb52 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Create snapshot completed successfully Sep 28 15:15:18 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f85c1e8-f359-44b6-b316-c0575338a4dc tempest-CreateVolumesFromSnapshotTest-1458448126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:15:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3f85c1e8-f359-44b6-b316-c0575338a4dc tempest-CreateVolumesFromSnapshotTest-1458448126 None] Flow 'volume_create_manager' (ccee942c-ba4e-4f4c-bb4c-cb7a8ea3e78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:15:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3f85c1e8-f359-44b6-b316-c0575338a4dc tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5c50ee9-f480-4a9c-9838-cfdf2f214d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3f85c1e8-f359-44b6-b316-c0575338a4dc tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5c50ee9-f480-4a9c-9838-cfdf2f214d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-259071612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbc701db-3c6b-4384-a1ca-d2c9968033b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22edb32356fe4f099f80aab0f39388f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:19Z,use_quota=True,user_id='2f59116fac6d4d93af9c8dfe7c4833a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3f85c1e8-f359-44b6-b316-c0575338a4dc tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d3a2480-1ea6-4d74-bfe4-8ec2a87e5ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3f85c1e8-f359-44b6-b316-c0575338a4dc tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d3a2480-1ea6-4d74-bfe4-8ec2a87e5ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3f85c1e8-f359-44b6-b316-c0575338a4dc tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed9f7d7d-2ab4-4fe8-a785-a5c8c1078fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3f85c1e8-f359-44b6-b316-c0575338a4dc tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed9f7d7d-2ab4-4fe8-a785-a5c8c1078fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbc701db-3c6b-4384-a1ca-d2c9968033b6', 'volume_name': 'volume-cbc701db-3c6b-4384-a1ca-d2c9968033b6', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3f85c1e8-f359-44b6-b316-c0575338a4dc tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (025d42af-a2bc-4df5-8683-bb87df6ab6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3f85c1e8-f359-44b6-b316-c0575338a4dc tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (025d42af-a2bc-4df5-8683-bb87df6ab6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3f85c1e8-f359-44b6-b316-c0575338a4dc tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75884583-b9b8-489e-9987-43aa695f1c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:19 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-3f85c1e8-f359-44b6-b316-c0575338a4dc tempest-CreateVolumesFromSnapshotTest-1458448126 None] Volume cbc701db-3c6b-4384-a1ca-d2c9968033b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbc701db-3c6b-4384-a1ca-d2c9968033b6', 'volume_size': 1} Sep 28 15:15:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3f85c1e8-f359-44b6-b316-c0575338a4dc tempest-CreateVolumesFromSnapshotTest-1458448126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3f85c1e8-f359-44b6-b316-c0575338a4dc tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3f85c1e8-f359-44b6-b316-c0575338a4dc tempest-CreateVolumesFromSnapshotTest-1458448126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-259071612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbc701db-3c6b-4384-a1ca-d2c9968033b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22edb32356fe4f099f80aab0f39388f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:19Z,use_quota=True,user_id='2f59116fac6d4d93af9c8dfe7c4833a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:15:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-3f85c1e8-f359-44b6-b316-c0575338a4dc tempest-CreateVolumesFromSnapshotTest-1458448126 None] Creating volume cbc701db-3c6b-4384-a1ca-d2c9968033b6 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:15:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3f85c1e8-f359-44b6-b316-c0575338a4dc tempest-CreateVolumesFromSnapshotTest-1458448126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3f85c1e8-f359-44b6-b316-c0575338a4dc tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3f85c1e8-f359-44b6-b316-c0575338a4dc tempest-CreateVolumesFromSnapshotTest-1458448126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:15:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3f85c1e8-f359-44b6-b316-c0575338a4dc tempest-CreateVolumesFromSnapshotTest-1458448126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:15:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3f85c1e8-f359-44b6-b316-c0575338a4dc tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3f85c1e8-f359-44b6-b316-c0575338a4dc tempest-CreateVolumesFromSnapshotTest-1458448126 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:15:19 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-3f85c1e8-f359-44b6-b316-c0575338a4dc tempest-CreateVolumesFromSnapshotTest-1458448126 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:15:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3f85c1e8-f359-44b6-b316-c0575338a4dc tempest-CreateVolumesFromSnapshotTest-1458448126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cbc701db-3c6b-4384-a1ca-d2c9968033b6 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:19 devstack sudo[107608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cbc701db-3c6b-4384-a1ca-d2c9968033b6 1073741824 Sep 28 15:15:19 devstack sudo[107608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:19 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-f523cf90-1623-44ce-8100-1bf36970891f tempest-CreateVolumesFromSnapshotTest-1458448126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:15:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f523cf90-1623-44ce-8100-1bf36970891f tempest-CreateVolumesFromSnapshotTest-1458448126 None] Flow 'volume_create_manager' (2d9d6eb7-2590-4525-a645-f7746fe151b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:15:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f523cf90-1623-44ce-8100-1bf36970891f tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0879f489-a686-4e55-8477-d031f5de0269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f523cf90-1623-44ce-8100-1bf36970891f tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0879f489-a686-4e55-8477-d031f5de0269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1072865430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8063ab1-196f-40ba-b969-f90335ea24db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22edb32356fe4f099f80aab0f39388f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:19Z,use_quota=True,user_id='2f59116fac6d4d93af9c8dfe7c4833a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f523cf90-1623-44ce-8100-1bf36970891f tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da9242af-e2d1-4243-875a-7b04929df649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f523cf90-1623-44ce-8100-1bf36970891f tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da9242af-e2d1-4243-875a-7b04929df649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f523cf90-1623-44ce-8100-1bf36970891f tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a4c4abe-7d3e-4668-b943-aebba681f115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f523cf90-1623-44ce-8100-1bf36970891f tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a4c4abe-7d3e-4668-b943-aebba681f115) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8063ab1-196f-40ba-b969-f90335ea24db', 'volume_name': 'volume-b8063ab1-196f-40ba-b969-f90335ea24db', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f523cf90-1623-44ce-8100-1bf36970891f tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea2a1d44-e631-476b-bc1c-95aad188c172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f523cf90-1623-44ce-8100-1bf36970891f tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea2a1d44-e631-476b-bc1c-95aad188c172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f523cf90-1623-44ce-8100-1bf36970891f tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b29261d-872a-4df2-9438-1aa58cec1e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:19 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-f523cf90-1623-44ce-8100-1bf36970891f tempest-CreateVolumesFromSnapshotTest-1458448126 None] Volume b8063ab1-196f-40ba-b969-f90335ea24db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8063ab1-196f-40ba-b969-f90335ea24db', 'volume_size': 1} Sep 28 15:15:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f523cf90-1623-44ce-8100-1bf36970891f tempest-CreateVolumesFromSnapshotTest-1458448126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:19 devstack sudo[107608]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3f85c1e8-f359-44b6-b316-c0575338a4dc tempest-CreateVolumesFromSnapshotTest-1458448126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cbc701db-3c6b-4384-a1ca-d2c9968033b6 1073741824" returned: 0 in 0.576s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3f85c1e8-f359-44b6-b316-c0575338a4dc tempest-CreateVolumesFromSnapshotTest-1458448126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cbc701db-3c6b-4384-a1ca-d2c9968033b6 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:19 devstack sudo[107614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cbc701db-3c6b-4384-a1ca-d2c9968033b6 Sep 28 15:15:19 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:19 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-17d37921-4444-4121-aa8b-6f679c397213 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:15:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-17d37921-4444-4121-aa8b-6f679c397213 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Flow 'volume_create_manager' (8e70a3f7-e9f1-4639-b680-7b20a835c7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:15:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-17d37921-4444-4121-aa8b-6f679c397213 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18d3f4be-b15d-4881-9012-537a29ad83cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-17d37921-4444-4121-aa8b-6f679c397213 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18d3f4be-b15d-4881-9012-537a29ad83cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-253530544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c084286-db13-4d6e-936d-af399c8aa345,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22edb32356fe4f099f80aab0f39388f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:20Z,use_quota=True,user_id='2f59116fac6d4d93af9c8dfe7c4833a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-17d37921-4444-4121-aa8b-6f679c397213 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (954f026d-8a51-404c-a3db-27163f2ddbc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-17d37921-4444-4121-aa8b-6f679c397213 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (954f026d-8a51-404c-a3db-27163f2ddbc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-17d37921-4444-4121-aa8b-6f679c397213 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e0e37a1-557b-4121-b7e2-1eac9716737a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-17d37921-4444-4121-aa8b-6f679c397213 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e0e37a1-557b-4121-b7e2-1eac9716737a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c084286-db13-4d6e-936d-af399c8aa345', 'volume_name': 'volume-0c084286-db13-4d6e-936d-af399c8aa345', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-17d37921-4444-4121-aa8b-6f679c397213 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aee49ae-2b7b-46ac-b7ef-0a73bb5ec464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-17d37921-4444-4121-aa8b-6f679c397213 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aee49ae-2b7b-46ac-b7ef-0a73bb5ec464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-17d37921-4444-4121-aa8b-6f679c397213 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07e77f4c-c83c-48fd-9d42-cc38b2797e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:19 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-17d37921-4444-4121-aa8b-6f679c397213 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Volume 0c084286-db13-4d6e-936d-af399c8aa345: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c084286-db13-4d6e-936d-af399c8aa345', 'volume_size': 1} Sep 28 15:15:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-17d37921-4444-4121-aa8b-6f679c397213 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:19 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3f85c1e8-f359-44b6-b316-c0575338a4dc tempest-CreateVolumesFromSnapshotTest-1458448126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cbc701db-3c6b-4384-a1ca-d2c9968033b6" returned: 0 in 0.351s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:20 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3f85c1e8-f359-44b6-b316-c0575338a4dc tempest-CreateVolumesFromSnapshotTest-1458448126 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:15:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3f85c1e8-f359-44b6-b316-c0575338a4dc tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f523cf90-1623-44ce-8100-1bf36970891f tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.548s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:20 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f523cf90-1623-44ce-8100-1bf36970891f tempest-CreateVolumesFromSnapshotTest-1458448126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1072865430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8063ab1-196f-40ba-b969-f90335ea24db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22edb32356fe4f099f80aab0f39388f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:19Z,use_quota=True,user_id='2f59116fac6d4d93af9c8dfe7c4833a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:15:20 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-f523cf90-1623-44ce-8100-1bf36970891f tempest-CreateVolumesFromSnapshotTest-1458448126 None] Creating volume b8063ab1-196f-40ba-b969-f90335ea24db {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:15:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f523cf90-1623-44ce-8100-1bf36970891f tempest-CreateVolumesFromSnapshotTest-1458448126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f523cf90-1623-44ce-8100-1bf36970891f tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:20 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f523cf90-1623-44ce-8100-1bf36970891f tempest-CreateVolumesFromSnapshotTest-1458448126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:15:20 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f523cf90-1623-44ce-8100-1bf36970891f tempest-CreateVolumesFromSnapshotTest-1458448126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:15:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f523cf90-1623-44ce-8100-1bf36970891f tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:20 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f523cf90-1623-44ce-8100-1bf36970891f tempest-CreateVolumesFromSnapshotTest-1458448126 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:15:20 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-f523cf90-1623-44ce-8100-1bf36970891f tempest-CreateVolumesFromSnapshotTest-1458448126 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:15:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f523cf90-1623-44ce-8100-1bf36970891f tempest-CreateVolumesFromSnapshotTest-1458448126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b8063ab1-196f-40ba-b969-f90335ea24db 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3f85c1e8-f359-44b6-b316-c0575338a4dc tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75884583-b9b8-489e-9987-43aa695f1c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbc701db-3c6b-4384-a1ca-d2c9968033b6', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3f85c1e8-f359-44b6-b316-c0575338a4dc tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d33b1d2-fc7b-4cb6-a0da-7cb6ab409b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:20 devstack sudo[107617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b8063ab1-196f-40ba-b969-f90335ea24db 1073741824 Sep 28 15:15:20 devstack sudo[107617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:20 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-3f85c1e8-f359-44b6-b316-c0575338a4dc tempest-CreateVolumesFromSnapshotTest-1458448126 None] Volume volume-cbc701db-3c6b-4384-a1ca-d2c9968033b6 (cbc701db-3c6b-4384-a1ca-d2c9968033b6): created successfully Sep 28 15:15:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3f85c1e8-f359-44b6-b316-c0575338a4dc tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d33b1d2-fc7b-4cb6-a0da-7cb6ab409b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3f85c1e8-f359-44b6-b316-c0575338a4dc tempest-CreateVolumesFromSnapshotTest-1458448126 None] Flow 'volume_create_manager' (ccee942c-ba4e-4f4c-bb4c-cb7a8ea3e78c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:15:20 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-3f85c1e8-f359-44b6-b316-c0575338a4dc tempest-CreateVolumesFromSnapshotTest-1458448126 None] Created volume successfully. Sep 28 15:15:20 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d08bf9b-d544-4790-8b46-63b7a99d75f8 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:15:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2d08bf9b-d544-4790-8b46-63b7a99d75f8 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Flow 'volume_create_manager' (84773a64-bc91-48d2-bf07-4f7cc2226f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:15:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2d08bf9b-d544-4790-8b46-63b7a99d75f8 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53e9510b-35a8-468b-bb21-eb9ed37905fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2d08bf9b-d544-4790-8b46-63b7a99d75f8 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53e9510b-35a8-468b-bb21-eb9ed37905fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-405640364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24a20260-8305-4634-b6c9-cb83b7fbda0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22edb32356fe4f099f80aab0f39388f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:20Z,use_quota=True,user_id='2f59116fac6d4d93af9c8dfe7c4833a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2d08bf9b-d544-4790-8b46-63b7a99d75f8 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c699be8-494d-4568-b9b9-f39a62802601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2d08bf9b-d544-4790-8b46-63b7a99d75f8 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c699be8-494d-4568-b9b9-f39a62802601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2d08bf9b-d544-4790-8b46-63b7a99d75f8 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26ae7c67-4c7d-4fda-8d90-3c6e62d17ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2d08bf9b-d544-4790-8b46-63b7a99d75f8 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26ae7c67-4c7d-4fda-8d90-3c6e62d17ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24a20260-8305-4634-b6c9-cb83b7fbda0b', 'volume_name': 'volume-24a20260-8305-4634-b6c9-cb83b7fbda0b', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2d08bf9b-d544-4790-8b46-63b7a99d75f8 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aac9bf0f-56a7-471d-947d-b63f073252ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2d08bf9b-d544-4790-8b46-63b7a99d75f8 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aac9bf0f-56a7-471d-947d-b63f073252ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2d08bf9b-d544-4790-8b46-63b7a99d75f8 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adb9b5fd-4ac6-4d1b-8d1a-86dd24729772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:20 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-2d08bf9b-d544-4790-8b46-63b7a99d75f8 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Volume 24a20260-8305-4634-b6c9-cb83b7fbda0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24a20260-8305-4634-b6c9-cb83b7fbda0b', 'volume_size': 1} Sep 28 15:15:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2d08bf9b-d544-4790-8b46-63b7a99d75f8 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:20 devstack sudo[107617]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f523cf90-1623-44ce-8100-1bf36970891f tempest-CreateVolumesFromSnapshotTest-1458448126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b8063ab1-196f-40ba-b969-f90335ea24db 1073741824" returned: 0 in 0.651s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f523cf90-1623-44ce-8100-1bf36970891f tempest-CreateVolumesFromSnapshotTest-1458448126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b8063ab1-196f-40ba-b969-f90335ea24db {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:20 devstack sudo[107623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b8063ab1-196f-40ba-b969-f90335ea24db Sep 28 15:15:20 devstack sudo[107623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:20 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-699718c6-e2f8-4719-b776-9966eb3ef05b tempest-CreateVolumesFromSnapshotTest-1458448126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:15:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-699718c6-e2f8-4719-b776-9966eb3ef05b tempest-CreateVolumesFromSnapshotTest-1458448126 None] Flow 'volume_create_manager' (c752737f-3b94-44c0-ab42-1e25a3b88a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:15:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-699718c6-e2f8-4719-b776-9966eb3ef05b tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e1dec8c-f28b-4634-9088-daf0699594c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-699718c6-e2f8-4719-b776-9966eb3ef05b tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e1dec8c-f28b-4634-9088-daf0699594c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-206394683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=137b2bd3-bad4-4600-b5cf-bc43b03e0df6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22edb32356fe4f099f80aab0f39388f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:21Z,use_quota=True,user_id='2f59116fac6d4d93af9c8dfe7c4833a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-699718c6-e2f8-4719-b776-9966eb3ef05b tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0d7b9bd-6be8-46c7-b07c-233546989d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-699718c6-e2f8-4719-b776-9966eb3ef05b tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0d7b9bd-6be8-46c7-b07c-233546989d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-699718c6-e2f8-4719-b776-9966eb3ef05b tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6606f6c-5046-4486-b511-43a85b21bd1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-699718c6-e2f8-4719-b776-9966eb3ef05b tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6606f6c-5046-4486-b511-43a85b21bd1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '137b2bd3-bad4-4600-b5cf-bc43b03e0df6', 'volume_name': 'volume-137b2bd3-bad4-4600-b5cf-bc43b03e0df6', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-699718c6-e2f8-4719-b776-9966eb3ef05b tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da34385e-081c-42a1-bf5e-30f045319085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-699718c6-e2f8-4719-b776-9966eb3ef05b tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da34385e-081c-42a1-bf5e-30f045319085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-699718c6-e2f8-4719-b776-9966eb3ef05b tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c52e26a0-b958-4180-8b88-2d39962ab34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:20 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-699718c6-e2f8-4719-b776-9966eb3ef05b tempest-CreateVolumesFromSnapshotTest-1458448126 None] Volume 137b2bd3-bad4-4600-b5cf-bc43b03e0df6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-137b2bd3-bad4-4600-b5cf-bc43b03e0df6', 'volume_size': 1} Sep 28 15:15:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-699718c6-e2f8-4719-b776-9966eb3ef05b tempest-CreateVolumesFromSnapshotTest-1458448126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:21 devstack sudo[107623]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f523cf90-1623-44ce-8100-1bf36970891f tempest-CreateVolumesFromSnapshotTest-1458448126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b8063ab1-196f-40ba-b969-f90335ea24db" returned: 0 in 0.357s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:21 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f523cf90-1623-44ce-8100-1bf36970891f tempest-CreateVolumesFromSnapshotTest-1458448126 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:15:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f523cf90-1623-44ce-8100-1bf36970891f tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-17d37921-4444-4121-aa8b-6f679c397213 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.172s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:21 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-17d37921-4444-4121-aa8b-6f679c397213 tempest-CreateVolumesFromSnapshotTest-1458448126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-253530544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c084286-db13-4d6e-936d-af399c8aa345,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22edb32356fe4f099f80aab0f39388f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:20Z,use_quota=True,user_id='2f59116fac6d4d93af9c8dfe7c4833a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:15:21 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-17d37921-4444-4121-aa8b-6f679c397213 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Creating volume 0c084286-db13-4d6e-936d-af399c8aa345 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:15:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-17d37921-4444-4121-aa8b-6f679c397213 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-17d37921-4444-4121-aa8b-6f679c397213 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:21 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-17d37921-4444-4121-aa8b-6f679c397213 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:15:21 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-17d37921-4444-4121-aa8b-6f679c397213 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:15:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-17d37921-4444-4121-aa8b-6f679c397213 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:21 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-17d37921-4444-4121-aa8b-6f679c397213 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:15:21 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-17d37921-4444-4121-aa8b-6f679c397213 tempest-CreateVolumesFromSnapshotTest-1458448126 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:15:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-17d37921-4444-4121-aa8b-6f679c397213 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0c084286-db13-4d6e-936d-af399c8aa345 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:21 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f523cf90-1623-44ce-8100-1bf36970891f tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b29261d-872a-4df2-9438-1aa58cec1e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8063ab1-196f-40ba-b969-f90335ea24db', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:21 devstack sudo[107626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0c084286-db13-4d6e-936d-af399c8aa345 1073741824 Sep 28 15:15:21 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:21 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f523cf90-1623-44ce-8100-1bf36970891f tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (045161ea-c989-41fd-b9e7-131455cf400e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:21 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-f523cf90-1623-44ce-8100-1bf36970891f tempest-CreateVolumesFromSnapshotTest-1458448126 None] Volume volume-b8063ab1-196f-40ba-b969-f90335ea24db (b8063ab1-196f-40ba-b969-f90335ea24db): created successfully Sep 28 15:15:21 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f523cf90-1623-44ce-8100-1bf36970891f tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (045161ea-c989-41fd-b9e7-131455cf400e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:21 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f523cf90-1623-44ce-8100-1bf36970891f tempest-CreateVolumesFromSnapshotTest-1458448126 None] Flow 'volume_create_manager' (2d9d6eb7-2590-4525-a645-f7746fe151b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:15:21 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-f523cf90-1623-44ce-8100-1bf36970891f tempest-CreateVolumesFromSnapshotTest-1458448126 None] Created volume successfully. Sep 28 15:15:21 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-17d37921-4444-4121-aa8b-6f679c397213 tempest-CreateVolumesFromSnapshotTest-1458448126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0c084286-db13-4d6e-936d-af399c8aa345 1073741824" returned: 0 in 0.519s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-17d37921-4444-4121-aa8b-6f679c397213 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0c084286-db13-4d6e-936d-af399c8aa345 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:21 devstack sudo[107632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0c084286-db13-4d6e-936d-af399c8aa345 Sep 28 15:15:21 devstack sudo[107632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:21 devstack sudo[107632]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-17d37921-4444-4121-aa8b-6f679c397213 tempest-CreateVolumesFromSnapshotTest-1458448126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0c084286-db13-4d6e-936d-af399c8aa345" returned: 0 in 0.272s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:21 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-17d37921-4444-4121-aa8b-6f679c397213 tempest-CreateVolumesFromSnapshotTest-1458448126 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:15:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-17d37921-4444-4121-aa8b-6f679c397213 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2d08bf9b-d544-4790-8b46-63b7a99d75f8 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.471s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:21 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2d08bf9b-d544-4790-8b46-63b7a99d75f8 tempest-CreateVolumesFromSnapshotTest-1458448126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-405640364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24a20260-8305-4634-b6c9-cb83b7fbda0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22edb32356fe4f099f80aab0f39388f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:20Z,use_quota=True,user_id='2f59116fac6d4d93af9c8dfe7c4833a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:15:21 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-2d08bf9b-d544-4790-8b46-63b7a99d75f8 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Creating volume 24a20260-8305-4634-b6c9-cb83b7fbda0b {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:15:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2d08bf9b-d544-4790-8b46-63b7a99d75f8 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2d08bf9b-d544-4790-8b46-63b7a99d75f8 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:21 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2d08bf9b-d544-4790-8b46-63b7a99d75f8 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:15:21 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2d08bf9b-d544-4790-8b46-63b7a99d75f8 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:15:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2d08bf9b-d544-4790-8b46-63b7a99d75f8 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:21 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2d08bf9b-d544-4790-8b46-63b7a99d75f8 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:15:21 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-2d08bf9b-d544-4790-8b46-63b7a99d75f8 tempest-CreateVolumesFromSnapshotTest-1458448126 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:15:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2d08bf9b-d544-4790-8b46-63b7a99d75f8 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-24a20260-8305-4634-b6c9-cb83b7fbda0b 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:21 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-17d37921-4444-4121-aa8b-6f679c397213 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07e77f4c-c83c-48fd-9d42-cc38b2797e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c084286-db13-4d6e-936d-af399c8aa345', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:21 devstack sudo[107635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-24a20260-8305-4634-b6c9-cb83b7fbda0b 1073741824 Sep 28 15:15:21 devstack sudo[107635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:21 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-17d37921-4444-4121-aa8b-6f679c397213 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1629b8a6-782a-4c2b-ae01-86de8f948d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:22 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-17d37921-4444-4121-aa8b-6f679c397213 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Volume volume-0c084286-db13-4d6e-936d-af399c8aa345 (0c084286-db13-4d6e-936d-af399c8aa345): created successfully Sep 28 15:15:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-17d37921-4444-4121-aa8b-6f679c397213 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1629b8a6-782a-4c2b-ae01-86de8f948d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-17d37921-4444-4121-aa8b-6f679c397213 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Flow 'volume_create_manager' (8e70a3f7-e9f1-4639-b680-7b20a835c7bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:15:22 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-17d37921-4444-4121-aa8b-6f679c397213 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Created volume successfully. Sep 28 15:15:22 devstack sudo[107635]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2d08bf9b-d544-4790-8b46-63b7a99d75f8 tempest-CreateVolumesFromSnapshotTest-1458448126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-24a20260-8305-4634-b6c9-cb83b7fbda0b 1073741824" returned: 0 in 0.478s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2d08bf9b-d544-4790-8b46-63b7a99d75f8 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-24a20260-8305-4634-b6c9-cb83b7fbda0b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:22 devstack sudo[107640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-24a20260-8305-4634-b6c9-cb83b7fbda0b Sep 28 15:15:22 devstack sudo[107640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:22 devstack sudo[107640]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2d08bf9b-d544-4790-8b46-63b7a99d75f8 tempest-CreateVolumesFromSnapshotTest-1458448126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-24a20260-8305-4634-b6c9-cb83b7fbda0b" returned: 0 in 0.272s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:22 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2d08bf9b-d544-4790-8b46-63b7a99d75f8 tempest-CreateVolumesFromSnapshotTest-1458448126 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:15:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2d08bf9b-d544-4790-8b46-63b7a99d75f8 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-699718c6-e2f8-4719-b776-9966eb3ef05b tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.829s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:22 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-699718c6-e2f8-4719-b776-9966eb3ef05b tempest-CreateVolumesFromSnapshotTest-1458448126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-206394683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=137b2bd3-bad4-4600-b5cf-bc43b03e0df6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22edb32356fe4f099f80aab0f39388f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:21Z,use_quota=True,user_id='2f59116fac6d4d93af9c8dfe7c4833a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:15:22 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-699718c6-e2f8-4719-b776-9966eb3ef05b tempest-CreateVolumesFromSnapshotTest-1458448126 None] Creating volume 137b2bd3-bad4-4600-b5cf-bc43b03e0df6 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:15:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-699718c6-e2f8-4719-b776-9966eb3ef05b tempest-CreateVolumesFromSnapshotTest-1458448126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-699718c6-e2f8-4719-b776-9966eb3ef05b tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:22 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-699718c6-e2f8-4719-b776-9966eb3ef05b tempest-CreateVolumesFromSnapshotTest-1458448126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:15:22 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-699718c6-e2f8-4719-b776-9966eb3ef05b tempest-CreateVolumesFromSnapshotTest-1458448126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:15:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-699718c6-e2f8-4719-b776-9966eb3ef05b tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:22 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-699718c6-e2f8-4719-b776-9966eb3ef05b tempest-CreateVolumesFromSnapshotTest-1458448126 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:15:22 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-699718c6-e2f8-4719-b776-9966eb3ef05b tempest-CreateVolumesFromSnapshotTest-1458448126 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:15:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-699718c6-e2f8-4719-b776-9966eb3ef05b tempest-CreateVolumesFromSnapshotTest-1458448126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-137b2bd3-bad4-4600-b5cf-bc43b03e0df6 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:22 devstack sudo[107643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-137b2bd3-bad4-4600-b5cf-bc43b03e0df6 1073741824 Sep 28 15:15:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2d08bf9b-d544-4790-8b46-63b7a99d75f8 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adb9b5fd-4ac6-4d1b-8d1a-86dd24729772) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24a20260-8305-4634-b6c9-cb83b7fbda0b', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:22 devstack sudo[107643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2d08bf9b-d544-4790-8b46-63b7a99d75f8 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b52b3a2d-5347-4780-adc8-300fa154f313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:22 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-2d08bf9b-d544-4790-8b46-63b7a99d75f8 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Volume volume-24a20260-8305-4634-b6c9-cb83b7fbda0b (24a20260-8305-4634-b6c9-cb83b7fbda0b): created successfully Sep 28 15:15:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2d08bf9b-d544-4790-8b46-63b7a99d75f8 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b52b3a2d-5347-4780-adc8-300fa154f313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2d08bf9b-d544-4790-8b46-63b7a99d75f8 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Flow 'volume_create_manager' (84773a64-bc91-48d2-bf07-4f7cc2226f6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:15:22 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-2d08bf9b-d544-4790-8b46-63b7a99d75f8 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Created volume successfully. Sep 28 15:15:23 devstack sudo[107643]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-699718c6-e2f8-4719-b776-9966eb3ef05b tempest-CreateVolumesFromSnapshotTest-1458448126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-137b2bd3-bad4-4600-b5cf-bc43b03e0df6 1073741824" returned: 0 in 0.520s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-699718c6-e2f8-4719-b776-9966eb3ef05b tempest-CreateVolumesFromSnapshotTest-1458448126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-137b2bd3-bad4-4600-b5cf-bc43b03e0df6 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:23 devstack sudo[107648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-137b2bd3-bad4-4600-b5cf-bc43b03e0df6 Sep 28 15:15:23 devstack sudo[107648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:23 devstack sudo[107648]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-699718c6-e2f8-4719-b776-9966eb3ef05b tempest-CreateVolumesFromSnapshotTest-1458448126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-137b2bd3-bad4-4600-b5cf-bc43b03e0df6" returned: 0 in 0.296s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:23 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-699718c6-e2f8-4719-b776-9966eb3ef05b tempest-CreateVolumesFromSnapshotTest-1458448126 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:15:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-699718c6-e2f8-4719-b776-9966eb3ef05b tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-699718c6-e2f8-4719-b776-9966eb3ef05b tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c52e26a0-b958-4180-8b88-2d39962ab34b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-137b2bd3-bad4-4600-b5cf-bc43b03e0df6', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-699718c6-e2f8-4719-b776-9966eb3ef05b tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf178ced-e186-409b-a64d-21b70ad21fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:23 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-699718c6-e2f8-4719-b776-9966eb3ef05b tempest-CreateVolumesFromSnapshotTest-1458448126 None] Volume volume-137b2bd3-bad4-4600-b5cf-bc43b03e0df6 (137b2bd3-bad4-4600-b5cf-bc43b03e0df6): created successfully Sep 28 15:15:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-699718c6-e2f8-4719-b776-9966eb3ef05b tempest-CreateVolumesFromSnapshotTest-1458448126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf178ced-e186-409b-a64d-21b70ad21fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-699718c6-e2f8-4719-b776-9966eb3ef05b tempest-CreateVolumesFromSnapshotTest-1458448126 None] Flow 'volume_create_manager' (c752737f-3b94-44c0-ab42-1e25a3b88a7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:15:23 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-699718c6-e2f8-4719-b776-9966eb3ef05b tempest-CreateVolumesFromSnapshotTest-1458448126 None] Created volume successfully. Sep 28 15:15:24 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-67725b62-45ea-48bf-8283-2a9b2ec43fa8 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Acquiring lock "cinder-137b2bd3-bad4-4600-b5cf-bc43b03e0df6-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:24 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-67725b62-45ea-48bf-8283-2a9b2ec43fa8 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "cinder-137b2bd3-bad4-4600-b5cf-bc43b03e0df6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:24 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-67725b62-45ea-48bf-8283-2a9b2ec43fa8 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Acquiring lock "cinder-quobyte-137b2bd3-bad4-4600-b5cf-bc43b03e0df6" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:24 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-67725b62-45ea-48bf-8283-2a9b2ec43fa8 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "cinder-quobyte-137b2bd3-bad4-4600-b5cf-bc43b03e0df6" acquired by "delete_volume" :: waited 0.019s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:24 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8dbd9d-9974-4402-b803-ab93316bccf7]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-67725b62-45ea-48bf-8283-2a9b2ec43fa8 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-137b2bd3-bad4-4600-b5cf-bc43b03e0df6 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:24 devstack sudo[107651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-137b2bd3-bad4-4600-b5cf-bc43b03e0df6 Sep 28 15:15:24 devstack sudo[107651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:24 devstack sudo[107651]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-67725b62-45ea-48bf-8283-2a9b2ec43fa8 tempest-CreateVolumesFromSnapshotTest-1458448126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-137b2bd3-bad4-4600-b5cf-bc43b03e0df6" returned: 0 in 0.447s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-67725b62-45ea-48bf-8283-2a9b2ec43fa8 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-137b2bd3-bad4-4600-b5cf-bc43b03e0df6 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:24 devstack sudo[107656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-137b2bd3-bad4-4600-b5cf-bc43b03e0df6 Sep 28 15:15:24 devstack sudo[107656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:25 devstack sudo[107656]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-67725b62-45ea-48bf-8283-2a9b2ec43fa8 tempest-CreateVolumesFromSnapshotTest-1458448126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-137b2bd3-bad4-4600-b5cf-bc43b03e0df6" returned: 0 in 0.305s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:25 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-67725b62-45ea-48bf-8283-2a9b2ec43fa8 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "cinder-quobyte-137b2bd3-bad4-4600-b5cf-bc43b03e0df6" released by "delete_volume" :: held 0.801s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:15:25 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-67725b62-45ea-48bf-8283-2a9b2ec43fa8 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Created reservations ['7f1c719e-9eac-4979-afef-e60a0f0e432a', 'ca847878-1bdf-4c52-bf98-e16653a05f07', '3b5146be-0edb-48c6-bd70-35ec8b3d871f', 'd226a692-ba91-46dd-b490-586b67bb55e6'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:15:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-67725b62-45ea-48bf-8283-2a9b2ec43fa8 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-67725b62-45ea-48bf-8283-2a9b2ec43fa8 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:25 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-67725b62-45ea-48bf-8283-2a9b2ec43fa8 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:15:25 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-67725b62-45ea-48bf-8283-2a9b2ec43fa8 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:15:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-67725b62-45ea-48bf-8283-2a9b2ec43fa8 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-67725b62-45ea-48bf-8283-2a9b2ec43fa8 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:25 devstack sudo[107659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:15:25 devstack sudo[107659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:25 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ddd4f85a-2e45-4ff2-87b9-37919a40273b tempest-CreateVolumesFromSnapshotTest-1458448126 None] Acquiring lock "cinder-24a20260-8305-4634-b6c9-cb83b7fbda0b-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:25 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ddd4f85a-2e45-4ff2-87b9-37919a40273b tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "cinder-24a20260-8305-4634-b6c9-cb83b7fbda0b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:25 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ddd4f85a-2e45-4ff2-87b9-37919a40273b tempest-CreateVolumesFromSnapshotTest-1458448126 None] Acquiring lock "cinder-quobyte-24a20260-8305-4634-b6c9-cb83b7fbda0b" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:25 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ddd4f85a-2e45-4ff2-87b9-37919a40273b tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "cinder-quobyte-24a20260-8305-4634-b6c9-cb83b7fbda0b" acquired by "delete_volume" :: waited 0.021s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:25 devstack sudo[107659]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:25 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[67dfb8fe-46ea-4361-ab27-0bd368182de0]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ddd4f85a-2e45-4ff2-87b9-37919a40273b tempest-CreateVolumesFromSnapshotTest-1458448126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-24a20260-8305-4634-b6c9-cb83b7fbda0b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-67725b62-45ea-48bf-8283-2a9b2ec43fa8 tempest-CreateVolumesFromSnapshotTest-1458448126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.349s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:25 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-67725b62-45ea-48bf-8283-2a9b2ec43fa8 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:15:25 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-67725b62-45ea-48bf-8283-2a9b2ec43fa8 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Deleted volume successfully. Sep 28 15:15:25 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-67725b62-45ea-48bf-8283-2a9b2ec43fa8 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "cinder-137b2bd3-bad4-4600-b5cf-bc43b03e0df6-delete_volume" released by "delete_volume" :: held 1.408s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:15:25 devstack sudo[107662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-24a20260-8305-4634-b6c9-cb83b7fbda0b Sep 28 15:15:25 devstack sudo[107662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:26 devstack sudo[107662]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ddd4f85a-2e45-4ff2-87b9-37919a40273b tempest-CreateVolumesFromSnapshotTest-1458448126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-24a20260-8305-4634-b6c9-cb83b7fbda0b" returned: 0 in 0.407s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ddd4f85a-2e45-4ff2-87b9-37919a40273b tempest-CreateVolumesFromSnapshotTest-1458448126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-24a20260-8305-4634-b6c9-cb83b7fbda0b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:26 devstack sudo[107667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-24a20260-8305-4634-b6c9-cb83b7fbda0b Sep 28 15:15:26 devstack sudo[107667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:26 devstack sudo[107667]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ddd4f85a-2e45-4ff2-87b9-37919a40273b tempest-CreateVolumesFromSnapshotTest-1458448126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-24a20260-8305-4634-b6c9-cb83b7fbda0b" returned: 0 in 0.259s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ddd4f85a-2e45-4ff2-87b9-37919a40273b tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "cinder-quobyte-24a20260-8305-4634-b6c9-cb83b7fbda0b" released by "delete_volume" :: held 0.728s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:15:26 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-ddd4f85a-2e45-4ff2-87b9-37919a40273b tempest-CreateVolumesFromSnapshotTest-1458448126 None] Created reservations ['4d677134-529e-4b17-acad-934920e47776', 'b80a9930-61c1-41cb-ba50-ac0c14cea63d', '6260cdae-7859-49e2-b275-dfedb7fde43c', 'c1918500-0506-4a1f-b323-63c6ee209915'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:15:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ddd4f85a-2e45-4ff2-87b9-37919a40273b tempest-CreateVolumesFromSnapshotTest-1458448126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ddd4f85a-2e45-4ff2-87b9-37919a40273b tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ddd4f85a-2e45-4ff2-87b9-37919a40273b tempest-CreateVolumesFromSnapshotTest-1458448126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:15:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ddd4f85a-2e45-4ff2-87b9-37919a40273b tempest-CreateVolumesFromSnapshotTest-1458448126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:15:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ddd4f85a-2e45-4ff2-87b9-37919a40273b tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ddd4f85a-2e45-4ff2-87b9-37919a40273b tempest-CreateVolumesFromSnapshotTest-1458448126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:26 devstack sudo[107670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:15:26 devstack sudo[107670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9b15ebf9-5f60-43d1-9000-eb20694b6c7a tempest-CreateVolumesFromSnapshotTest-1458448126 None] Acquiring lock "cinder-0c084286-db13-4d6e-936d-af399c8aa345-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:26 devstack sudo[107670]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ddd4f85a-2e45-4ff2-87b9-37919a40273b tempest-CreateVolumesFromSnapshotTest-1458448126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.283s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:26 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-ddd4f85a-2e45-4ff2-87b9-37919a40273b tempest-CreateVolumesFromSnapshotTest-1458448126 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:15:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9b15ebf9-5f60-43d1-9000-eb20694b6c7a tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "cinder-0c084286-db13-4d6e-936d-af399c8aa345-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:26 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-ddd4f85a-2e45-4ff2-87b9-37919a40273b tempest-CreateVolumesFromSnapshotTest-1458448126 None] Deleted volume successfully. Sep 28 15:15:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ddd4f85a-2e45-4ff2-87b9-37919a40273b tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "cinder-24a20260-8305-4634-b6c9-cb83b7fbda0b-delete_volume" released by "delete_volume" :: held 1.287s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:15:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9b15ebf9-5f60-43d1-9000-eb20694b6c7a tempest-CreateVolumesFromSnapshotTest-1458448126 None] Acquiring lock "cinder-quobyte-0c084286-db13-4d6e-936d-af399c8aa345" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9b15ebf9-5f60-43d1-9000-eb20694b6c7a tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "cinder-quobyte-0c084286-db13-4d6e-936d-af399c8aa345" acquired by "delete_volume" :: waited 0.016s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:26 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81b868a-2ada-4d99-bfd9-62a559f58ee8]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9b15ebf9-5f60-43d1-9000-eb20694b6c7a tempest-CreateVolumesFromSnapshotTest-1458448126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0c084286-db13-4d6e-936d-af399c8aa345 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:27 devstack sudo[107673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0c084286-db13-4d6e-936d-af399c8aa345 Sep 28 15:15:27 devstack sudo[107673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:27 devstack sudo[107673]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9b15ebf9-5f60-43d1-9000-eb20694b6c7a tempest-CreateVolumesFromSnapshotTest-1458448126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0c084286-db13-4d6e-936d-af399c8aa345" returned: 0 in 0.411s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9b15ebf9-5f60-43d1-9000-eb20694b6c7a tempest-CreateVolumesFromSnapshotTest-1458448126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0c084286-db13-4d6e-936d-af399c8aa345 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:27 devstack sudo[107678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0c084286-db13-4d6e-936d-af399c8aa345 Sep 28 15:15:27 devstack sudo[107678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:27 devstack sudo[107678]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9b15ebf9-5f60-43d1-9000-eb20694b6c7a tempest-CreateVolumesFromSnapshotTest-1458448126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0c084286-db13-4d6e-936d-af399c8aa345" returned: 0 in 0.298s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:27 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9b15ebf9-5f60-43d1-9000-eb20694b6c7a tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "cinder-quobyte-0c084286-db13-4d6e-936d-af399c8aa345" released by "delete_volume" :: held 0.757s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:15:27 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-9b15ebf9-5f60-43d1-9000-eb20694b6c7a tempest-CreateVolumesFromSnapshotTest-1458448126 None] Created reservations ['f1bbb4be-8642-4c3d-bab6-b45ee045429c', '8a31cb62-74e0-4f15-b4e7-8d26710605b4', '042a3f54-fc6d-4df5-99a3-e336dad5d89e', '6807efbb-4df7-413c-b71f-817ee0152ced'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:15:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9b15ebf9-5f60-43d1-9000-eb20694b6c7a tempest-CreateVolumesFromSnapshotTest-1458448126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9b15ebf9-5f60-43d1-9000-eb20694b6c7a tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9b15ebf9-5f60-43d1-9000-eb20694b6c7a tempest-CreateVolumesFromSnapshotTest-1458448126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:15:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9b15ebf9-5f60-43d1-9000-eb20694b6c7a tempest-CreateVolumesFromSnapshotTest-1458448126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:15:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9b15ebf9-5f60-43d1-9000-eb20694b6c7a tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9b15ebf9-5f60-43d1-9000-eb20694b6c7a tempest-CreateVolumesFromSnapshotTest-1458448126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:27 devstack sudo[107681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:15:27 devstack sudo[107681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:28 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f6ce8317-77fe-4f53-a43b-ba93d310f9ed tempest-CreateVolumesFromSnapshotTest-1458448126 None] Acquiring lock "cinder-b8063ab1-196f-40ba-b969-f90335ea24db-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:28 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f6ce8317-77fe-4f53-a43b-ba93d310f9ed tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "cinder-b8063ab1-196f-40ba-b969-f90335ea24db-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:28 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f6ce8317-77fe-4f53-a43b-ba93d310f9ed tempest-CreateVolumesFromSnapshotTest-1458448126 None] Acquiring lock "cinder-quobyte-b8063ab1-196f-40ba-b969-f90335ea24db" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:28 devstack sudo[107681]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9b15ebf9-5f60-43d1-9000-eb20694b6c7a tempest-CreateVolumesFromSnapshotTest-1458448126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.300s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:28 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-9b15ebf9-5f60-43d1-9000-eb20694b6c7a tempest-CreateVolumesFromSnapshotTest-1458448126 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:15:28 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-9b15ebf9-5f60-43d1-9000-eb20694b6c7a tempest-CreateVolumesFromSnapshotTest-1458448126 None] Deleted volume successfully. Sep 28 15:15:28 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f6ce8317-77fe-4f53-a43b-ba93d310f9ed tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "cinder-quobyte-b8063ab1-196f-40ba-b969-f90335ea24db" acquired by "delete_volume" :: waited 0.026s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:28 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9b15ebf9-5f60-43d1-9000-eb20694b6c7a tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "cinder-0c084286-db13-4d6e-936d-af399c8aa345-delete_volume" released by "delete_volume" :: held 1.313s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:15:28 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[175f1af1-a931-4194-8b8f-6d1c5db4f1b0]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f6ce8317-77fe-4f53-a43b-ba93d310f9ed tempest-CreateVolumesFromSnapshotTest-1458448126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b8063ab1-196f-40ba-b969-f90335ea24db {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:28 devstack sudo[107684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b8063ab1-196f-40ba-b969-f90335ea24db Sep 28 15:15:28 devstack sudo[107684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:28 devstack sudo[107684]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f6ce8317-77fe-4f53-a43b-ba93d310f9ed tempest-CreateVolumesFromSnapshotTest-1458448126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b8063ab1-196f-40ba-b969-f90335ea24db" returned: 0 in 0.423s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f6ce8317-77fe-4f53-a43b-ba93d310f9ed tempest-CreateVolumesFromSnapshotTest-1458448126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b8063ab1-196f-40ba-b969-f90335ea24db {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:28 devstack sudo[107690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b8063ab1-196f-40ba-b969-f90335ea24db Sep 28 15:15:28 devstack sudo[107690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:28 devstack sudo[107690]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f6ce8317-77fe-4f53-a43b-ba93d310f9ed tempest-CreateVolumesFromSnapshotTest-1458448126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b8063ab1-196f-40ba-b969-f90335ea24db" returned: 0 in 0.291s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:28 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f6ce8317-77fe-4f53-a43b-ba93d310f9ed tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "cinder-quobyte-b8063ab1-196f-40ba-b969-f90335ea24db" released by "delete_volume" :: held 0.771s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:15:28 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-f6ce8317-77fe-4f53-a43b-ba93d310f9ed tempest-CreateVolumesFromSnapshotTest-1458448126 None] Created reservations ['8ef15de5-b98b-4b29-83bd-fc61031dab02', 'd4544078-0eba-4664-88a4-5a73a4be89a5', 'f8a8eda5-b9d2-45fa-acf1-790d0b90c248', 'd7f1d9b6-223f-4ac3-9790-d56dcaec34bb'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:15:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f6ce8317-77fe-4f53-a43b-ba93d310f9ed tempest-CreateVolumesFromSnapshotTest-1458448126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f6ce8317-77fe-4f53-a43b-ba93d310f9ed tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:29 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f6ce8317-77fe-4f53-a43b-ba93d310f9ed tempest-CreateVolumesFromSnapshotTest-1458448126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:15:29 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f6ce8317-77fe-4f53-a43b-ba93d310f9ed tempest-CreateVolumesFromSnapshotTest-1458448126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:15:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f6ce8317-77fe-4f53-a43b-ba93d310f9ed tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f6ce8317-77fe-4f53-a43b-ba93d310f9ed tempest-CreateVolumesFromSnapshotTest-1458448126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:29 devstack sudo[107693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:15:29 devstack sudo[107693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:29 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-63db8ee1-6801-4647-aa78-da9b9a47c895 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Acquiring lock "cinder-cbc701db-3c6b-4384-a1ca-d2c9968033b6-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:29 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-63db8ee1-6801-4647-aa78-da9b9a47c895 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "cinder-cbc701db-3c6b-4384-a1ca-d2c9968033b6-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:29 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-63db8ee1-6801-4647-aa78-da9b9a47c895 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Acquiring lock "cinder-quobyte-cbc701db-3c6b-4384-a1ca-d2c9968033b6" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:29 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-63db8ee1-6801-4647-aa78-da9b9a47c895 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "cinder-quobyte-cbc701db-3c6b-4384-a1ca-d2c9968033b6" acquired by "delete_volume" :: waited 0.022s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:29 devstack sudo[107693]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f6ce8317-77fe-4f53-a43b-ba93d310f9ed tempest-CreateVolumesFromSnapshotTest-1458448126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.345s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:29 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-f6ce8317-77fe-4f53-a43b-ba93d310f9ed tempest-CreateVolumesFromSnapshotTest-1458448126 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:15:29 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-f6ce8317-77fe-4f53-a43b-ba93d310f9ed tempest-CreateVolumesFromSnapshotTest-1458448126 None] Deleted volume successfully. Sep 28 15:15:29 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ae2012-eaf6-4255-8e82-da8d34b45076]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-63db8ee1-6801-4647-aa78-da9b9a47c895 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cbc701db-3c6b-4384-a1ca-d2c9968033b6 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:29 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f6ce8317-77fe-4f53-a43b-ba93d310f9ed tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "cinder-b8063ab1-196f-40ba-b969-f90335ea24db-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:15:29 devstack sudo[107696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cbc701db-3c6b-4384-a1ca-d2c9968033b6 Sep 28 15:15:29 devstack sudo[107696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:29 devstack sudo[107696]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-63db8ee1-6801-4647-aa78-da9b9a47c895 tempest-CreateVolumesFromSnapshotTest-1458448126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cbc701db-3c6b-4384-a1ca-d2c9968033b6" returned: 0 in 0.451s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-63db8ee1-6801-4647-aa78-da9b9a47c895 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cbc701db-3c6b-4384-a1ca-d2c9968033b6 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:29 devstack sudo[107701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cbc701db-3c6b-4384-a1ca-d2c9968033b6 Sep 28 15:15:29 devstack sudo[107701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:30 devstack sudo[107701]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-63db8ee1-6801-4647-aa78-da9b9a47c895 tempest-CreateVolumesFromSnapshotTest-1458448126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cbc701db-3c6b-4384-a1ca-d2c9968033b6" returned: 0 in 0.303s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-63db8ee1-6801-4647-aa78-da9b9a47c895 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "cinder-quobyte-cbc701db-3c6b-4384-a1ca-d2c9968033b6" released by "delete_volume" :: held 0.822s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:15:30 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-63db8ee1-6801-4647-aa78-da9b9a47c895 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Created reservations ['4beaf7ef-0735-406a-839d-715f94454843', 'dd850536-1bf0-48d1-8dd4-7291613efe02', '68a6d9e8-c7c3-4c07-8dd5-6579bc8624b0', 'fbb682ff-2457-497c-b515-88eab9bbdc5e'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:15:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-63db8ee1-6801-4647-aa78-da9b9a47c895 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-63db8ee1-6801-4647-aa78-da9b9a47c895 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-63db8ee1-6801-4647-aa78-da9b9a47c895 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:15:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-63db8ee1-6801-4647-aa78-da9b9a47c895 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:15:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-63db8ee1-6801-4647-aa78-da9b9a47c895 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-63db8ee1-6801-4647-aa78-da9b9a47c895 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:30 devstack sudo[107704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:15:30 devstack sudo[107704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c34cb757-8d31-4f4b-80b4-9ba742930520 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Acquiring lock "cinder-c872dad8-13c9-490f-a04e-540066893672-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c34cb757-8d31-4f4b-80b4-9ba742930520 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "cinder-c872dad8-13c9-490f-a04e-540066893672-delete_snapshot" acquired by "delete_snapshot" :: waited 0.064s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c34cb757-8d31-4f4b-80b4-9ba742930520 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Acquiring lock "cinder-quobyte-b8c71922-7190-4e68-933c-92aaf14f7800" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c34cb757-8d31-4f4b-80b4-9ba742930520 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "cinder-quobyte-b8c71922-7190-4e68-933c-92aaf14f7800" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c34cb757-8d31-4f4b-80b4-9ba742930520 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Acquiring lock "cinder-quobyte-c872dad8-13c9-490f-a04e-540066893672" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c34cb757-8d31-4f4b-80b4-9ba742930520 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "cinder-quobyte-c872dad8-13c9-490f-a04e-540066893672" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-c34cb757-8d31-4f4b-80b4-9ba742930520 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Deleting offline snapshot c872dad8-13c9-490f-a04e-540066893672 of volume b8c71922-7190-4e68-933c-92aaf14f7800 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:15:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-c34cb757-8d31-4f4b-80b4-9ba742930520 tempest-CreateVolumesFromSnapshotTest-1458448126 None] snapshot_file for this snap is: volume-b8c71922-7190-4e68-933c-92aaf14f7800.c872dad8-13c9-490f-a04e-540066893672 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:15:30 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[7898240a-7252-48e1-b920-31fe02ca2646]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c34cb757-8d31-4f4b-80b4-9ba742930520 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b8c71922-7190-4e68-933c-92aaf14f7800.c872dad8-13c9-490f-a04e-540066893672 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:30 devstack sudo[107704]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-63db8ee1-6801-4647-aa78-da9b9a47c895 tempest-CreateVolumesFromSnapshotTest-1458448126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.307s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:30 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-63db8ee1-6801-4647-aa78-da9b9a47c895 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:15:30 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-63db8ee1-6801-4647-aa78-da9b9a47c895 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Deleted volume successfully. Sep 28 15:15:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-63db8ee1-6801-4647-aa78-da9b9a47c895 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "cinder-cbc701db-3c6b-4384-a1ca-d2c9968033b6-delete_volume" released by "delete_volume" :: held 1.413s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:15:30 devstack sudo[107707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b8c71922-7190-4e68-933c-92aaf14f7800.c872dad8-13c9-490f-a04e-540066893672 Sep 28 15:15:30 devstack sudo[107707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:31 devstack sudo[107707]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c34cb757-8d31-4f4b-80b4-9ba742930520 tempest-CreateVolumesFromSnapshotTest-1458448126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b8c71922-7190-4e68-933c-92aaf14f7800.c872dad8-13c9-490f-a04e-540066893672" returned: 0 in 0.411s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:31 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-c34cb757-8d31-4f4b-80b4-9ba742930520 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8c71922-7190-4e68-933c-92aaf14f7800(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:15:31 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29a8a05-b23d-4d04-b39f-b5f156c22cb2]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c34cb757-8d31-4f4b-80b4-9ba742930520 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b8c71922-7190-4e68-933c-92aaf14f7800 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:31 devstack sudo[107714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b8c71922-7190-4e68-933c-92aaf14f7800 Sep 28 15:15:31 devstack sudo[107714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:31 devstack sudo[107714]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c34cb757-8d31-4f4b-80b4-9ba742930520 tempest-CreateVolumesFromSnapshotTest-1458448126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b8c71922-7190-4e68-933c-92aaf14f7800" returned: 0 in 0.417s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c34cb757-8d31-4f4b-80b4-9ba742930520 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b8c71922-7190-4e68-933c-92aaf14f7800.c872dad8-13c9-490f-a04e-540066893672 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:31 devstack sudo[107720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b8c71922-7190-4e68-933c-92aaf14f7800.c872dad8-13c9-490f-a04e-540066893672 Sep 28 15:15:31 devstack sudo[107720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:31 devstack sudo[107720]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c34cb757-8d31-4f4b-80b4-9ba742930520 tempest-CreateVolumesFromSnapshotTest-1458448126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b8c71922-7190-4e68-933c-92aaf14f7800.c872dad8-13c9-490f-a04e-540066893672" returned: 0 in 0.411s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c34cb757-8d31-4f4b-80b4-9ba742930520 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b8c71922-7190-4e68-933c-92aaf14f7800.c872dad8-13c9-490f-a04e-540066893672 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:31 devstack sudo[107725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b8c71922-7190-4e68-933c-92aaf14f7800.c872dad8-13c9-490f-a04e-540066893672 Sep 28 15:15:31 devstack sudo[107725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:32 devstack sudo[107725]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c34cb757-8d31-4f4b-80b4-9ba742930520 tempest-CreateVolumesFromSnapshotTest-1458448126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b8c71922-7190-4e68-933c-92aaf14f7800.c872dad8-13c9-490f-a04e-540066893672" returned: 0 in 0.303s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:32 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c34cb757-8d31-4f4b-80b4-9ba742930520 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "cinder-quobyte-c872dad8-13c9-490f-a04e-540066893672" released by "_delete_snapshot" :: held 1.677s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:15:32 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c34cb757-8d31-4f4b-80b4-9ba742930520 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "cinder-quobyte-b8c71922-7190-4e68-933c-92aaf14f7800" released by "delete_snapshot" :: held 1.708s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:15:32 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-c34cb757-8d31-4f4b-80b4-9ba742930520 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Created reservations ['d9383c07-641b-4695-9b06-0697e9426309', 'f230b02b-37da-49b2-9d0e-5f3e631ea922', '0d6c767f-0e1d-4bf3-b83a-f132443e7677', '9ce38b2d-f497-4407-aed9-7625c0ed2287'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:15:32 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-c34cb757-8d31-4f4b-80b4-9ba742930520 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Delete snapshot completed successfully. Sep 28 15:15:32 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c34cb757-8d31-4f4b-80b4-9ba742930520 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "cinder-c872dad8-13c9-490f-a04e-540066893672-delete_snapshot" released by "delete_snapshot" :: held 1.881s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:15:32 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ee8580ad-17d3-4258-9379-e92818c8b423 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Acquiring lock "cinder-b8c71922-7190-4e68-933c-92aaf14f7800-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:32 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ee8580ad-17d3-4258-9379-e92818c8b423 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "cinder-b8c71922-7190-4e68-933c-92aaf14f7800-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:32 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ee8580ad-17d3-4258-9379-e92818c8b423 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Acquiring lock "cinder-quobyte-b8c71922-7190-4e68-933c-92aaf14f7800" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:32 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ee8580ad-17d3-4258-9379-e92818c8b423 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "cinder-quobyte-b8c71922-7190-4e68-933c-92aaf14f7800" acquired by "delete_volume" :: waited 0.017s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:32 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b39116b-eb01-42ba-8220-0b1f63eb560a]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ee8580ad-17d3-4258-9379-e92818c8b423 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b8c71922-7190-4e68-933c-92aaf14f7800 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:32 devstack sudo[107728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b8c71922-7190-4e68-933c-92aaf14f7800 Sep 28 15:15:32 devstack sudo[107728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:33 devstack sudo[107728]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ee8580ad-17d3-4258-9379-e92818c8b423 tempest-CreateVolumesFromSnapshotTest-1458448126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b8c71922-7190-4e68-933c-92aaf14f7800" returned: 0 in 0.457s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ee8580ad-17d3-4258-9379-e92818c8b423 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b8c71922-7190-4e68-933c-92aaf14f7800 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:33 devstack sudo[107733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b8c71922-7190-4e68-933c-92aaf14f7800 Sep 28 15:15:33 devstack sudo[107733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:33 devstack sudo[107733]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ee8580ad-17d3-4258-9379-e92818c8b423 tempest-CreateVolumesFromSnapshotTest-1458448126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-b8c71922-7190-4e68-933c-92aaf14f7800" returned: 0 in 0.273s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ee8580ad-17d3-4258-9379-e92818c8b423 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "cinder-quobyte-b8c71922-7190-4e68-933c-92aaf14f7800" released by "delete_volume" :: held 0.803s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:15:33 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-ee8580ad-17d3-4258-9379-e92818c8b423 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Created reservations ['75875843-40b4-4d0c-bd43-74c9fdc7fcd8', '45f80fe3-a662-4f87-9ee4-9fd4dfaf584b', '790be288-32d1-4fe9-bc0c-6add1d5e80e5', 'e8ae32b4-2c53-4b62-a89b-7f390bcbcc28'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:15:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ee8580ad-17d3-4258-9379-e92818c8b423 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ee8580ad-17d3-4258-9379-e92818c8b423 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:33 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ee8580ad-17d3-4258-9379-e92818c8b423 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:15:33 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ee8580ad-17d3-4258-9379-e92818c8b423 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:15:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ee8580ad-17d3-4258-9379-e92818c8b423 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ee8580ad-17d3-4258-9379-e92818c8b423 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:33 devstack sudo[107742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:15:33 devstack sudo[107742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:33 devstack sudo[107742]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ee8580ad-17d3-4258-9379-e92818c8b423 tempest-CreateVolumesFromSnapshotTest-1458448126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.307s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:33 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-ee8580ad-17d3-4258-9379-e92818c8b423 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:15:33 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-ee8580ad-17d3-4258-9379-e92818c8b423 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Deleted volume successfully. Sep 28 15:15:34 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ee8580ad-17d3-4258-9379-e92818c8b423 tempest-CreateVolumesFromSnapshotTest-1458448126 None] Lock "cinder-b8c71922-7190-4e68-933c-92aaf14f7800-delete_volume" released by "delete_volume" :: held 1.336s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:15:44 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=65,cinder:INSERT=23,cinder:UPDATE=89,cinder:DELETE=8 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:15:48 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-9238f8f0-a9bc-4d10-b207-94698bd251ec tempest-CreateVolumesFromSnapshotTest-1830645918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:15:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9238f8f0-a9bc-4d10-b207-94698bd251ec tempest-CreateVolumesFromSnapshotTest-1830645918 None] Flow 'volume_create_manager' (9cf2fbbf-dfdb-4fe5-9c70-e7c394b28f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:15:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9238f8f0-a9bc-4d10-b207-94698bd251ec tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe52b7f3-f1d0-4375-9f15-ad1c2aba41ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9238f8f0-a9bc-4d10-b207-94698bd251ec tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe52b7f3-f1d0-4375-9f15-ad1c2aba41ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2036430319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7691df8-36ca-431a-bfc9-dbd2f7a572f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e725adeaa964354a1deed499e319b0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:48Z,use_quota=True,user_id='09dc7200bb394ef7bffaf8ff0caa55a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9238f8f0-a9bc-4d10-b207-94698bd251ec tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (473b8217-0535-4173-90ca-77bf48be70f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9238f8f0-a9bc-4d10-b207-94698bd251ec tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (473b8217-0535-4173-90ca-77bf48be70f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9238f8f0-a9bc-4d10-b207-94698bd251ec tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (635bddaa-abda-4f3b-b47b-32a10c630c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9238f8f0-a9bc-4d10-b207-94698bd251ec tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (635bddaa-abda-4f3b-b47b-32a10c630c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7691df8-36ca-431a-bfc9-dbd2f7a572f9', 'volume_name': 'volume-e7691df8-36ca-431a-bfc9-dbd2f7a572f9', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9238f8f0-a9bc-4d10-b207-94698bd251ec tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39c81548-457f-4fa4-b42e-17484941b6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9238f8f0-a9bc-4d10-b207-94698bd251ec tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39c81548-457f-4fa4-b42e-17484941b6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9238f8f0-a9bc-4d10-b207-94698bd251ec tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05fde603-2d2b-4469-bdae-a8889e34a00c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:48 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-9238f8f0-a9bc-4d10-b207-94698bd251ec tempest-CreateVolumesFromSnapshotTest-1830645918 None] Volume e7691df8-36ca-431a-bfc9-dbd2f7a572f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7691df8-36ca-431a-bfc9-dbd2f7a572f9', 'volume_size': 1} Sep 28 15:15:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9238f8f0-a9bc-4d10-b207-94698bd251ec tempest-CreateVolumesFromSnapshotTest-1830645918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9238f8f0-a9bc-4d10-b207-94698bd251ec tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:48 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9238f8f0-a9bc-4d10-b207-94698bd251ec tempest-CreateVolumesFromSnapshotTest-1830645918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2036430319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7691df8-36ca-431a-bfc9-dbd2f7a572f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e725adeaa964354a1deed499e319b0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:48Z,use_quota=True,user_id='09dc7200bb394ef7bffaf8ff0caa55a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:15:48 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-9238f8f0-a9bc-4d10-b207-94698bd251ec tempest-CreateVolumesFromSnapshotTest-1830645918 None] Creating volume e7691df8-36ca-431a-bfc9-dbd2f7a572f9 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:15:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9238f8f0-a9bc-4d10-b207-94698bd251ec tempest-CreateVolumesFromSnapshotTest-1830645918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9238f8f0-a9bc-4d10-b207-94698bd251ec tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:48 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9238f8f0-a9bc-4d10-b207-94698bd251ec tempest-CreateVolumesFromSnapshotTest-1830645918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:15:48 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9238f8f0-a9bc-4d10-b207-94698bd251ec tempest-CreateVolumesFromSnapshotTest-1830645918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:15:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9238f8f0-a9bc-4d10-b207-94698bd251ec tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:48 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9238f8f0-a9bc-4d10-b207-94698bd251ec tempest-CreateVolumesFromSnapshotTest-1830645918 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:15:48 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-9238f8f0-a9bc-4d10-b207-94698bd251ec tempest-CreateVolumesFromSnapshotTest-1830645918 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:15:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9238f8f0-a9bc-4d10-b207-94698bd251ec tempest-CreateVolumesFromSnapshotTest-1830645918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e7691df8-36ca-431a-bfc9-dbd2f7a572f9 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:48 devstack sudo[107819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e7691df8-36ca-431a-bfc9-dbd2f7a572f9 1073741824 Sep 28 15:15:48 devstack sudo[107819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:48 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5e2bbdf-4a99-489c-b926-006529b4e272 tempest-CreateVolumesFromImageTest-1041185936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:15:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e5e2bbdf-4a99-489c-b926-006529b4e272 tempest-CreateVolumesFromImageTest-1041185936 None] Flow 'volume_create_manager' (208b3aea-b5f9-4b99-a4fa-11e0b53703f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:15:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e5e2bbdf-4a99-489c-b926-006529b4e272 tempest-CreateVolumesFromImageTest-1041185936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f14ca54c-8fd8-4393-b642-47af253575ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e5e2bbdf-4a99-489c-b926-006529b4e272 tempest-CreateVolumesFromImageTest-1041185936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f14ca54c-8fd8-4393-b642-47af253575ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1456222857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=307a6b87-807e-47b1-84a4-f7db4bd79919,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fa3fcbbddf84fc8a8d30141eb64d6b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:48Z,use_quota=True,user_id='15e74ff5fdba449cbfa949996e0b340c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e5e2bbdf-4a99-489c-b926-006529b4e272 tempest-CreateVolumesFromImageTest-1041185936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efe3f179-a6c5-4410-9623-eb7893cabf36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e5e2bbdf-4a99-489c-b926-006529b4e272 tempest-CreateVolumesFromImageTest-1041185936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efe3f179-a6c5-4410-9623-eb7893cabf36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e5e2bbdf-4a99-489c-b926-006529b4e272 tempest-CreateVolumesFromImageTest-1041185936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (841069ff-f021-4d63-b8cd-37a468afb8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e5e2bbdf-4a99-489c-b926-006529b4e272 tempest-CreateVolumesFromImageTest-1041185936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (841069ff-f021-4d63-b8cd-37a468afb8dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '307a6b87-807e-47b1-84a4-f7db4bd79919', 'volume_name': 'volume-307a6b87-807e-47b1-84a4-f7db4bd79919', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e5e2bbdf-4a99-489c-b926-006529b4e272 tempest-CreateVolumesFromImageTest-1041185936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd9cfc01-9129-4725-af31-c895eb429cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e5e2bbdf-4a99-489c-b926-006529b4e272 tempest-CreateVolumesFromImageTest-1041185936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd9cfc01-9129-4725-af31-c895eb429cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e5e2bbdf-4a99-489c-b926-006529b4e272 tempest-CreateVolumesFromImageTest-1041185936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92197e18-efbf-4805-977b-cdc9ec35f07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:48 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-e5e2bbdf-4a99-489c-b926-006529b4e272 tempest-CreateVolumesFromImageTest-1041185936 None] Volume 307a6b87-807e-47b1-84a4-f7db4bd79919: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-307a6b87-807e-47b1-84a4-f7db4bd79919', 'volume_size': 1} Sep 28 15:15:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e5e2bbdf-4a99-489c-b926-006529b4e272 tempest-CreateVolumesFromImageTest-1041185936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:48 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-c208214e-49c9-4c7d-a160-56c9c69fbe9a tempest-CreateVolumesFromImageTest-1041185936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:15:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c208214e-49c9-4c7d-a160-56c9c69fbe9a tempest-CreateVolumesFromImageTest-1041185936 None] Flow 'volume_create_manager' (36b398f0-9e94-4d8a-ba4b-4f11f99ab9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:15:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c208214e-49c9-4c7d-a160-56c9c69fbe9a tempest-CreateVolumesFromImageTest-1041185936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a97756a2-b276-460a-91d4-7568f3593f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c208214e-49c9-4c7d-a160-56c9c69fbe9a tempest-CreateVolumesFromImageTest-1041185936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a97756a2-b276-460a-91d4-7568f3593f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1863506251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de3d3854-d0c6-4429-8b25-9ce8a9b06ca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fa3fcbbddf84fc8a8d30141eb64d6b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:48Z,use_quota=True,user_id='15e74ff5fdba449cbfa949996e0b340c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c208214e-49c9-4c7d-a160-56c9c69fbe9a tempest-CreateVolumesFromImageTest-1041185936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4d0569c-dafe-4152-ab2e-3407b3f08eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c208214e-49c9-4c7d-a160-56c9c69fbe9a tempest-CreateVolumesFromImageTest-1041185936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4d0569c-dafe-4152-ab2e-3407b3f08eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c208214e-49c9-4c7d-a160-56c9c69fbe9a tempest-CreateVolumesFromImageTest-1041185936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb484145-4e2b-4d17-9b6b-89b994b4708b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c208214e-49c9-4c7d-a160-56c9c69fbe9a tempest-CreateVolumesFromImageTest-1041185936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb484145-4e2b-4d17-9b6b-89b994b4708b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de3d3854-d0c6-4429-8b25-9ce8a9b06ca5', 'volume_name': 'volume-de3d3854-d0c6-4429-8b25-9ce8a9b06ca5', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c208214e-49c9-4c7d-a160-56c9c69fbe9a tempest-CreateVolumesFromImageTest-1041185936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbbf544e-9a14-44b6-b455-5826c3511ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c208214e-49c9-4c7d-a160-56c9c69fbe9a tempest-CreateVolumesFromImageTest-1041185936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbbf544e-9a14-44b6-b455-5826c3511ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c208214e-49c9-4c7d-a160-56c9c69fbe9a tempest-CreateVolumesFromImageTest-1041185936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4df458f1-f41d-47a1-8a8c-7f8eba49e90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:48 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-c208214e-49c9-4c7d-a160-56c9c69fbe9a tempest-CreateVolumesFromImageTest-1041185936 None] Volume de3d3854-d0c6-4429-8b25-9ce8a9b06ca5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de3d3854-d0c6-4429-8b25-9ce8a9b06ca5', 'volume_size': 1} Sep 28 15:15:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c208214e-49c9-4c7d-a160-56c9c69fbe9a tempest-CreateVolumesFromImageTest-1041185936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:48 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-d34b9d74-ab81-4ebe-b512-d91941259849 tempest-CreateVolumesFromImageTest-1041185936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:15:48 devstack sudo[107819]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d34b9d74-ab81-4ebe-b512-d91941259849 tempest-CreateVolumesFromImageTest-1041185936 None] Flow 'volume_create_manager' (900a78bf-0fbd-4d20-a29a-ddd9a4720d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:15:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d34b9d74-ab81-4ebe-b512-d91941259849 tempest-CreateVolumesFromImageTest-1041185936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4af27d77-28c4-4ed1-9916-0394c345c9f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9238f8f0-a9bc-4d10-b207-94698bd251ec tempest-CreateVolumesFromSnapshotTest-1830645918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e7691df8-36ca-431a-bfc9-dbd2f7a572f9 1073741824" returned: 0 in 0.686s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d34b9d74-ab81-4ebe-b512-d91941259849 tempest-CreateVolumesFromImageTest-1041185936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4af27d77-28c4-4ed1-9916-0394c345c9f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-844265820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88e95e93-f64f-4c70-a715-2dbb2b3966df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fa3fcbbddf84fc8a8d30141eb64d6b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:49Z,use_quota=True,user_id='15e74ff5fdba449cbfa949996e0b340c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d34b9d74-ab81-4ebe-b512-d91941259849 tempest-CreateVolumesFromImageTest-1041185936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eec0af5d-8b7a-4c22-8708-80af3957964c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d34b9d74-ab81-4ebe-b512-d91941259849 tempest-CreateVolumesFromImageTest-1041185936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eec0af5d-8b7a-4c22-8708-80af3957964c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d34b9d74-ab81-4ebe-b512-d91941259849 tempest-CreateVolumesFromImageTest-1041185936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c45bbdda-0e9a-47ba-bfb8-0ad4490ad7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d34b9d74-ab81-4ebe-b512-d91941259849 tempest-CreateVolumesFromImageTest-1041185936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c45bbdda-0e9a-47ba-bfb8-0ad4490ad7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88e95e93-f64f-4c70-a715-2dbb2b3966df', 'volume_name': 'volume-88e95e93-f64f-4c70-a715-2dbb2b3966df', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d34b9d74-ab81-4ebe-b512-d91941259849 tempest-CreateVolumesFromImageTest-1041185936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52fb696f-214b-4c72-90d9-4c736f749745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d34b9d74-ab81-4ebe-b512-d91941259849 tempest-CreateVolumesFromImageTest-1041185936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52fb696f-214b-4c72-90d9-4c736f749745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d34b9d74-ab81-4ebe-b512-d91941259849 tempest-CreateVolumesFromImageTest-1041185936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f56ced83-8477-4998-902a-2718f28cc463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:48 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-d34b9d74-ab81-4ebe-b512-d91941259849 tempest-CreateVolumesFromImageTest-1041185936 None] Volume 88e95e93-f64f-4c70-a715-2dbb2b3966df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88e95e93-f64f-4c70-a715-2dbb2b3966df', 'volume_size': 1} Sep 28 15:15:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d34b9d74-ab81-4ebe-b512-d91941259849 tempest-CreateVolumesFromImageTest-1041185936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9238f8f0-a9bc-4d10-b207-94698bd251ec tempest-CreateVolumesFromSnapshotTest-1830645918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e7691df8-36ca-431a-bfc9-dbd2f7a572f9 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:48 devstack sudo[107825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e7691df8-36ca-431a-bfc9-dbd2f7a572f9 Sep 28 15:15:48 devstack sudo[107825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:49 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-abaa86f3-41d2-40f5-85af-7d3b4d37e88b tempest-CreateVolumesFromImageTest-1041185936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:15:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-abaa86f3-41d2-40f5-85af-7d3b4d37e88b tempest-CreateVolumesFromImageTest-1041185936 None] Flow 'volume_create_manager' (c44e5673-63fe-4e40-99ef-f07f14ab2608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:15:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-abaa86f3-41d2-40f5-85af-7d3b4d37e88b tempest-CreateVolumesFromImageTest-1041185936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d839bb4d-b368-4a82-a59d-a3e7a9d9340e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-abaa86f3-41d2-40f5-85af-7d3b4d37e88b tempest-CreateVolumesFromImageTest-1041185936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d839bb4d-b368-4a82-a59d-a3e7a9d9340e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-141998635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68b9c652-4bbd-47d5-ac9c-6bd7078aa8e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fa3fcbbddf84fc8a8d30141eb64d6b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:49Z,use_quota=True,user_id='15e74ff5fdba449cbfa949996e0b340c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:49 devstack sudo[107825]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-abaa86f3-41d2-40f5-85af-7d3b4d37e88b tempest-CreateVolumesFromImageTest-1041185936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9def5777-4ced-45d1-9947-e65ad501c13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-abaa86f3-41d2-40f5-85af-7d3b4d37e88b tempest-CreateVolumesFromImageTest-1041185936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9def5777-4ced-45d1-9947-e65ad501c13b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-abaa86f3-41d2-40f5-85af-7d3b4d37e88b tempest-CreateVolumesFromImageTest-1041185936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (477e1837-0558-4667-8e56-bd7b54776cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-abaa86f3-41d2-40f5-85af-7d3b4d37e88b tempest-CreateVolumesFromImageTest-1041185936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (477e1837-0558-4667-8e56-bd7b54776cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68b9c652-4bbd-47d5-ac9c-6bd7078aa8e5', 'volume_name': 'volume-68b9c652-4bbd-47d5-ac9c-6bd7078aa8e5', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-abaa86f3-41d2-40f5-85af-7d3b4d37e88b tempest-CreateVolumesFromImageTest-1041185936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73ae965d-5698-4bde-9261-25b80baf1a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-abaa86f3-41d2-40f5-85af-7d3b4d37e88b tempest-CreateVolumesFromImageTest-1041185936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73ae965d-5698-4bde-9261-25b80baf1a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-abaa86f3-41d2-40f5-85af-7d3b4d37e88b tempest-CreateVolumesFromImageTest-1041185936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6e46e81-47bf-4724-b996-e464a028f6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:49 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-abaa86f3-41d2-40f5-85af-7d3b4d37e88b tempest-CreateVolumesFromImageTest-1041185936 None] Volume 68b9c652-4bbd-47d5-ac9c-6bd7078aa8e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68b9c652-4bbd-47d5-ac9c-6bd7078aa8e5', 'volume_size': 1} Sep 28 15:15:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-abaa86f3-41d2-40f5-85af-7d3b4d37e88b tempest-CreateVolumesFromImageTest-1041185936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9238f8f0-a9bc-4d10-b207-94698bd251ec tempest-CreateVolumesFromSnapshotTest-1830645918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e7691df8-36ca-431a-bfc9-dbd2f7a572f9" returned: 0 in 0.463s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9238f8f0-a9bc-4d10-b207-94698bd251ec tempest-CreateVolumesFromSnapshotTest-1830645918 None] <== create_volume: return (1249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:15:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9238f8f0-a9bc-4d10-b207-94698bd251ec tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.252s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e5e2bbdf-4a99-489c-b926-006529b4e272 tempest-CreateVolumesFromImageTest-1041185936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.902s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e5e2bbdf-4a99-489c-b926-006529b4e272 tempest-CreateVolumesFromImageTest-1041185936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1456222857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=307a6b87-807e-47b1-84a4-f7db4bd79919,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fa3fcbbddf84fc8a8d30141eb64d6b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:48Z,use_quota=True,user_id='15e74ff5fdba449cbfa949996e0b340c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:15:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-e5e2bbdf-4a99-489c-b926-006529b4e272 tempest-CreateVolumesFromImageTest-1041185936 None] Creating volume 307a6b87-807e-47b1-84a4-f7db4bd79919 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:15:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e5e2bbdf-4a99-489c-b926-006529b4e272 tempest-CreateVolumesFromImageTest-1041185936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e5e2bbdf-4a99-489c-b926-006529b4e272 tempest-CreateVolumesFromImageTest-1041185936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e5e2bbdf-4a99-489c-b926-006529b4e272 tempest-CreateVolumesFromImageTest-1041185936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:15:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e5e2bbdf-4a99-489c-b926-006529b4e272 tempest-CreateVolumesFromImageTest-1041185936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:15:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e5e2bbdf-4a99-489c-b926-006529b4e272 tempest-CreateVolumesFromImageTest-1041185936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e5e2bbdf-4a99-489c-b926-006529b4e272 tempest-CreateVolumesFromImageTest-1041185936 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:15:49 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-e5e2bbdf-4a99-489c-b926-006529b4e272 tempest-CreateVolumesFromImageTest-1041185936 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:15:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e5e2bbdf-4a99-489c-b926-006529b4e272 tempest-CreateVolumesFromImageTest-1041185936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-307a6b87-807e-47b1-84a4-f7db4bd79919 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9238f8f0-a9bc-4d10-b207-94698bd251ec tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05fde603-2d2b-4469-bdae-a8889e34a00c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7691df8-36ca-431a-bfc9-dbd2f7a572f9', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9238f8f0-a9bc-4d10-b207-94698bd251ec tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c4642cb-a474-421a-aac7-3cbd213e8f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:49 devstack sudo[107828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-307a6b87-807e-47b1-84a4-f7db4bd79919 1073741824 Sep 28 15:15:49 devstack sudo[107828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:49 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-9238f8f0-a9bc-4d10-b207-94698bd251ec tempest-CreateVolumesFromSnapshotTest-1830645918 None] Volume volume-e7691df8-36ca-431a-bfc9-dbd2f7a572f9 (e7691df8-36ca-431a-bfc9-dbd2f7a572f9): created successfully Sep 28 15:15:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9238f8f0-a9bc-4d10-b207-94698bd251ec tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c4642cb-a474-421a-aac7-3cbd213e8f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9238f8f0-a9bc-4d10-b207-94698bd251ec tempest-CreateVolumesFromSnapshotTest-1830645918 None] Flow 'volume_create_manager' (9cf2fbbf-dfdb-4fe5-9c70-e7c394b28f25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:15:49 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-9238f8f0-a9bc-4d10-b207-94698bd251ec tempest-CreateVolumesFromSnapshotTest-1830645918 None] Created volume successfully. Sep 28 15:15:49 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-69e38686-3065-4a51-8f31-52d84ab636ec tempest-CreateVolumesFromImageTest-1041185936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:15:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-69e38686-3065-4a51-8f31-52d84ab636ec tempest-CreateVolumesFromImageTest-1041185936 None] Flow 'volume_create_manager' (65f4a1f4-ca0e-4177-926d-f4d8f1d38c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:15:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-69e38686-3065-4a51-8f31-52d84ab636ec tempest-CreateVolumesFromImageTest-1041185936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1f79cbd-666c-41ab-8e9d-4286d96fb01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-69e38686-3065-4a51-8f31-52d84ab636ec tempest-CreateVolumesFromImageTest-1041185936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1f79cbd-666c-41ab-8e9d-4286d96fb01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1117306558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e9a12a0-a934-4c48-a66a-7cbfdd7e865a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fa3fcbbddf84fc8a8d30141eb64d6b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:50Z,use_quota=True,user_id='15e74ff5fdba449cbfa949996e0b340c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-69e38686-3065-4a51-8f31-52d84ab636ec tempest-CreateVolumesFromImageTest-1041185936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (143fac4e-f89f-4a8a-9e8e-09ec09f173b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-69e38686-3065-4a51-8f31-52d84ab636ec tempest-CreateVolumesFromImageTest-1041185936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (143fac4e-f89f-4a8a-9e8e-09ec09f173b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-69e38686-3065-4a51-8f31-52d84ab636ec tempest-CreateVolumesFromImageTest-1041185936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22c5fa90-8d50-4415-9cdc-378bd835b26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-69e38686-3065-4a51-8f31-52d84ab636ec tempest-CreateVolumesFromImageTest-1041185936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22c5fa90-8d50-4415-9cdc-378bd835b26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e9a12a0-a934-4c48-a66a-7cbfdd7e865a', 'volume_name': 'volume-5e9a12a0-a934-4c48-a66a-7cbfdd7e865a', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-69e38686-3065-4a51-8f31-52d84ab636ec tempest-CreateVolumesFromImageTest-1041185936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cae1ae21-5d69-47eb-848e-eb2615cf7be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-69e38686-3065-4a51-8f31-52d84ab636ec tempest-CreateVolumesFromImageTest-1041185936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cae1ae21-5d69-47eb-848e-eb2615cf7be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-69e38686-3065-4a51-8f31-52d84ab636ec tempest-CreateVolumesFromImageTest-1041185936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8d626ed-7a52-4e29-af67-17ad61a8cb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:50 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-69e38686-3065-4a51-8f31-52d84ab636ec tempest-CreateVolumesFromImageTest-1041185936 None] Volume 5e9a12a0-a934-4c48-a66a-7cbfdd7e865a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e9a12a0-a934-4c48-a66a-7cbfdd7e865a', 'volume_size': 1} Sep 28 15:15:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-69e38686-3065-4a51-8f31-52d84ab636ec tempest-CreateVolumesFromImageTest-1041185936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:50 devstack sudo[107828]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e5e2bbdf-4a99-489c-b926-006529b4e272 tempest-CreateVolumesFromImageTest-1041185936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-307a6b87-807e-47b1-84a4-f7db4bd79919 1073741824" returned: 0 in 0.767s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d3fe7320-4753-4f96-991f-13af996faad4 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e5e2bbdf-4a99-489c-b926-006529b4e272 tempest-CreateVolumesFromImageTest-1041185936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-307a6b87-807e-47b1-84a4-f7db4bd79919 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:50 devstack sudo[107834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-307a6b87-807e-47b1-84a4-f7db4bd79919 Sep 28 15:15:50 devstack sudo[107834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:50 devstack sudo[107834]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e5e2bbdf-4a99-489c-b926-006529b4e272 tempest-CreateVolumesFromImageTest-1041185936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-307a6b87-807e-47b1-84a4-f7db4bd79919" returned: 0 in 0.291s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:50 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e5e2bbdf-4a99-489c-b926-006529b4e272 tempest-CreateVolumesFromImageTest-1041185936 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:15:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e5e2bbdf-4a99-489c-b926-006529b4e272 tempest-CreateVolumesFromImageTest-1041185936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c208214e-49c9-4c7d-a160-56c9c69fbe9a tempest-CreateVolumesFromImageTest-1041185936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.735s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:50 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c208214e-49c9-4c7d-a160-56c9c69fbe9a tempest-CreateVolumesFromImageTest-1041185936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1863506251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de3d3854-d0c6-4429-8b25-9ce8a9b06ca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fa3fcbbddf84fc8a8d30141eb64d6b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:48Z,use_quota=True,user_id='15e74ff5fdba449cbfa949996e0b340c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:15:50 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-c208214e-49c9-4c7d-a160-56c9c69fbe9a tempest-CreateVolumesFromImageTest-1041185936 None] Creating volume de3d3854-d0c6-4429-8b25-9ce8a9b06ca5 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:15:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c208214e-49c9-4c7d-a160-56c9c69fbe9a tempest-CreateVolumesFromImageTest-1041185936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c208214e-49c9-4c7d-a160-56c9c69fbe9a tempest-CreateVolumesFromImageTest-1041185936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:50 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c208214e-49c9-4c7d-a160-56c9c69fbe9a tempest-CreateVolumesFromImageTest-1041185936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:15:50 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c208214e-49c9-4c7d-a160-56c9c69fbe9a tempest-CreateVolumesFromImageTest-1041185936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:15:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c208214e-49c9-4c7d-a160-56c9c69fbe9a tempest-CreateVolumesFromImageTest-1041185936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:50 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c208214e-49c9-4c7d-a160-56c9c69fbe9a tempest-CreateVolumesFromImageTest-1041185936 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:15:50 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-c208214e-49c9-4c7d-a160-56c9c69fbe9a tempest-CreateVolumesFromImageTest-1041185936 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:15:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c208214e-49c9-4c7d-a160-56c9c69fbe9a tempest-CreateVolumesFromImageTest-1041185936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-de3d3854-d0c6-4429-8b25-9ce8a9b06ca5 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:50 devstack sudo[107837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-de3d3854-d0c6-4429-8b25-9ce8a9b06ca5 1073741824 Sep 28 15:15:50 devstack sudo[107837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e5e2bbdf-4a99-489c-b926-006529b4e272 tempest-CreateVolumesFromImageTest-1041185936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92197e18-efbf-4805-977b-cdc9ec35f07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-307a6b87-807e-47b1-84a4-f7db4bd79919', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e5e2bbdf-4a99-489c-b926-006529b4e272 tempest-CreateVolumesFromImageTest-1041185936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19ded844-f283-4ff0-a069-59d5b98d3e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:50 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-e5e2bbdf-4a99-489c-b926-006529b4e272 tempest-CreateVolumesFromImageTest-1041185936 None] Volume volume-307a6b87-807e-47b1-84a4-f7db4bd79919 (307a6b87-807e-47b1-84a4-f7db4bd79919): created successfully Sep 28 15:15:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e5e2bbdf-4a99-489c-b926-006529b4e272 tempest-CreateVolumesFromImageTest-1041185936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19ded844-f283-4ff0-a069-59d5b98d3e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e5e2bbdf-4a99-489c-b926-006529b4e272 tempest-CreateVolumesFromImageTest-1041185936 None] Flow 'volume_create_manager' (208b3aea-b5f9-4b99-a4fa-11e0b53703f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:15:50 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-e5e2bbdf-4a99-489c-b926-006529b4e272 tempest-CreateVolumesFromImageTest-1041185936 None] Created volume successfully. Sep 28 15:15:51 devstack sudo[107837]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c208214e-49c9-4c7d-a160-56c9c69fbe9a tempest-CreateVolumesFromImageTest-1041185936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-de3d3854-d0c6-4429-8b25-9ce8a9b06ca5 1073741824" returned: 0 in 0.616s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c208214e-49c9-4c7d-a160-56c9c69fbe9a tempest-CreateVolumesFromImageTest-1041185936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-de3d3854-d0c6-4429-8b25-9ce8a9b06ca5 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:51 devstack sudo[107843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-de3d3854-d0c6-4429-8b25-9ce8a9b06ca5 Sep 28 15:15:51 devstack sudo[107843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:51 devstack sudo[107843]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c208214e-49c9-4c7d-a160-56c9c69fbe9a tempest-CreateVolumesFromImageTest-1041185936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-de3d3854-d0c6-4429-8b25-9ce8a9b06ca5" returned: 0 in 0.355s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:51 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c208214e-49c9-4c7d-a160-56c9c69fbe9a tempest-CreateVolumesFromImageTest-1041185936 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:15:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c208214e-49c9-4c7d-a160-56c9c69fbe9a tempest-CreateVolumesFromImageTest-1041185936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d34b9d74-ab81-4ebe-b512-d91941259849 tempest-CreateVolumesFromImageTest-1041185936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.642s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:51 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d34b9d74-ab81-4ebe-b512-d91941259849 tempest-CreateVolumesFromImageTest-1041185936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-844265820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88e95e93-f64f-4c70-a715-2dbb2b3966df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fa3fcbbddf84fc8a8d30141eb64d6b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:49Z,use_quota=True,user_id='15e74ff5fdba449cbfa949996e0b340c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:15:51 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-d34b9d74-ab81-4ebe-b512-d91941259849 tempest-CreateVolumesFromImageTest-1041185936 None] Creating volume 88e95e93-f64f-4c70-a715-2dbb2b3966df {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:15:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d34b9d74-ab81-4ebe-b512-d91941259849 tempest-CreateVolumesFromImageTest-1041185936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d34b9d74-ab81-4ebe-b512-d91941259849 tempest-CreateVolumesFromImageTest-1041185936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:51 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d34b9d74-ab81-4ebe-b512-d91941259849 tempest-CreateVolumesFromImageTest-1041185936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:15:51 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d34b9d74-ab81-4ebe-b512-d91941259849 tempest-CreateVolumesFromImageTest-1041185936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:15:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d34b9d74-ab81-4ebe-b512-d91941259849 tempest-CreateVolumesFromImageTest-1041185936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:51 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d34b9d74-ab81-4ebe-b512-d91941259849 tempest-CreateVolumesFromImageTest-1041185936 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:15:51 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-d34b9d74-ab81-4ebe-b512-d91941259849 tempest-CreateVolumesFromImageTest-1041185936 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:15:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d34b9d74-ab81-4ebe-b512-d91941259849 tempest-CreateVolumesFromImageTest-1041185936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-88e95e93-f64f-4c70-a715-2dbb2b3966df 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:51 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:15:51 devstack sudo[107847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-88e95e93-f64f-4c70-a715-2dbb2b3966df 1073741824 Sep 28 15:15:51 devstack sudo[107847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] Flow 'volume_create_manager' (d8ee2634-2bd9-4d41-ad76-7aeb63e4edf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:15:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55ccecb6-7576-4d7a-9e03-a0f5bf40f2cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c208214e-49c9-4c7d-a160-56c9c69fbe9a tempest-CreateVolumesFromImageTest-1041185936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4df458f1-f41d-47a1-8a8c-7f8eba49e90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de3d3854-d0c6-4429-8b25-9ce8a9b06ca5', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c208214e-49c9-4c7d-a160-56c9c69fbe9a tempest-CreateVolumesFromImageTest-1041185936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ed34c22-0bad-4849-92b4-a3652bda8e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55ccecb6-7576-4d7a-9e03-a0f5bf40f2cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=740b3c54-caab-427a-b0ac-996ccdf54104,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5eee614e11a546ea9dfdf524506c0c16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:51Z,use_quota=True,user_id='5764d27370474264a6d25a6bcc63c4e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (174b7106-d49a-47d2-bcaf-ac02218b5790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (174b7106-d49a-47d2-bcaf-ac02218b5790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2188324f-46c7-48de-8a42-40d1d2957798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:51 devstack cinder-volume[87116]: DEBUG cinder.image.glance [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] Creating Keystone auth plugin from conf {{(pid=87116) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 15:15:51 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-c208214e-49c9-4c7d-a160-56c9c69fbe9a tempest-CreateVolumesFromImageTest-1041185936 None] Volume volume-de3d3854-d0c6-4429-8b25-9ce8a9b06ca5 (de3d3854-d0c6-4429-8b25-9ce8a9b06ca5): created successfully Sep 28 15:15:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c208214e-49c9-4c7d-a160-56c9c69fbe9a tempest-CreateVolumesFromImageTest-1041185936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ed34c22-0bad-4849-92b4-a3652bda8e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c208214e-49c9-4c7d-a160-56c9c69fbe9a tempest-CreateVolumesFromImageTest-1041185936 None] Flow 'volume_create_manager' (36b398f0-9e94-4d8a-ba4b-4f11f99ab9fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:15:51 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-c208214e-49c9-4c7d-a160-56c9c69fbe9a tempest-CreateVolumesFromImageTest-1041185936 None] Created volume successfully. Sep 28 15:15:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2188324f-46c7-48de-8a42-40d1d2957798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '740b3c54-caab-427a-b0ac-996ccdf54104', 'volume_name': 'volume-740b3c54-caab-427a-b0ac-996ccdf54104', 'volume_size': 1, 'image_id': '3c4a1657-dd47-4deb-b222-3903acc39431', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3c4a1657-dd47-4deb-b222-3903acc39431', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cde7a772b90c1263ebfd5e58e7d9cb76', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5eee614e11a546ea9dfdf524506c0c16', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8a06d3f778540d245a19d2a8cf254f20d87649d41c20d6f539ba36fb36f3a8c88488012d09fdf9655b7857abc2d064401ba607ca077886d3948ee8a1ea6919b3', 'id': '3c4a1657-dd47-4deb-b222-3903acc39431', 'created_at': datetime.datetime(2026, 9, 28, 13, 15, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 15, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c4a1657-dd47-4deb-b222-3903acc39431/file', 'properties': {}}, 'image_service': }' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1a6b7d3-06dc-47e9-9a28-9c1080605ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1a6b7d3-06dc-47e9-9a28-9c1080605ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1412f0b1-c653-48cf-849b-81cd1eb1945e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:52 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] Volume 740b3c54-caab-427a-b0ac-996ccdf54104: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-740b3c54-caab-427a-b0ac-996ccdf54104', 'volume_size': 1, 'image_id': '3c4a1657-dd47-4deb-b222-3903acc39431', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3c4a1657-dd47-4deb-b222-3903acc39431', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cde7a772b90c1263ebfd5e58e7d9cb76', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5eee614e11a546ea9dfdf524506c0c16', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8a06d3f778540d245a19d2a8cf254f20d87649d41c20d6f539ba36fb36f3a8c88488012d09fdf9655b7857abc2d064401ba607ca077886d3948ee8a1ea6919b3', 'id': '3c4a1657-dd47-4deb-b222-3903acc39431', 'created_at': datetime.datetime(2026, 9, 28, 13, 15, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 15, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c4a1657-dd47-4deb-b222-3903acc39431/file', 'properties': {}}, 'image_service': } Sep 28 15:15:52 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] Trying to clone 740b3c54-caab-427a-b0ac-996ccdf54104 from image 3c4a1657-dd47-4deb-b222-3903acc39431 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3c4a1657-dd47-4deb-b222-3903acc39431', 'metadata': {}}]). {{(pid=87116) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 15:15:52 devstack sudo[107847]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d34b9d74-ab81-4ebe-b512-d91941259849 tempest-CreateVolumesFromImageTest-1041185936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-88e95e93-f64f-4c70-a715-2dbb2b3966df 1073741824" returned: 0 in 0.576s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:52 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3c4a1657-dd47-4deb-b222-3903acc39431__y91wnlxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87116) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 15:15:52 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] Image download 0.00 MB at 0.00 MB/s Sep 28 15:15:52 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:UPDATE=95,cinder:SELECT=72,cinder:INSERT=30,cinder:DELETE=9 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:15:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d34b9d74-ab81-4ebe-b512-d91941259849 tempest-CreateVolumesFromImageTest-1041185936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-88e95e93-f64f-4c70-a715-2dbb2b3966df {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:52 devstack sudo[107852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-88e95e93-f64f-4c70-a715-2dbb2b3966df Sep 28 15:15:52 devstack sudo[107852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:52 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd04e0a-5c12-4b8d-871f-487b8955f3d5]: (4, 'raw') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3c4a1657-dd47-4deb-b222-3903acc39431__y91wnlxdevstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:52 devstack sudo[107854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3c4a1657-dd47-4deb-b222-3903acc39431__y91wnlxdevstack@QuobyteHD Sep 28 15:15:52 devstack sudo[107854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:52 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:15:52 devstack sudo[107852]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Flow 'volume_create_manager' (9cbba9fe-b5d9-4bfa-9a10-6ccf5d1a01ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:15:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5506f160-6b9e-4826-8c4d-6d065a779716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d34b9d74-ab81-4ebe-b512-d91941259849 tempest-CreateVolumesFromImageTest-1041185936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-88e95e93-f64f-4c70-a715-2dbb2b3966df" returned: 0 in 0.403s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d34b9d74-ab81-4ebe-b512-d91941259849 tempest-CreateVolumesFromImageTest-1041185936 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:15:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d34b9d74-ab81-4ebe-b512-d91941259849 tempest-CreateVolumesFromImageTest-1041185936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-abaa86f3-41d2-40f5-85af-7d3b4d37e88b tempest-CreateVolumesFromImageTest-1041185936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.210s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-abaa86f3-41d2-40f5-85af-7d3b4d37e88b tempest-CreateVolumesFromImageTest-1041185936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-141998635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68b9c652-4bbd-47d5-ac9c-6bd7078aa8e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fa3fcbbddf84fc8a8d30141eb64d6b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:49Z,use_quota=True,user_id='15e74ff5fdba449cbfa949996e0b340c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:15:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-abaa86f3-41d2-40f5-85af-7d3b4d37e88b tempest-CreateVolumesFromImageTest-1041185936 None] Creating volume 68b9c652-4bbd-47d5-ac9c-6bd7078aa8e5 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:15:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-abaa86f3-41d2-40f5-85af-7d3b4d37e88b tempest-CreateVolumesFromImageTest-1041185936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-abaa86f3-41d2-40f5-85af-7d3b4d37e88b tempest-CreateVolumesFromImageTest-1041185936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-abaa86f3-41d2-40f5-85af-7d3b4d37e88b tempest-CreateVolumesFromImageTest-1041185936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:15:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-abaa86f3-41d2-40f5-85af-7d3b4d37e88b tempest-CreateVolumesFromImageTest-1041185936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:15:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-abaa86f3-41d2-40f5-85af-7d3b4d37e88b tempest-CreateVolumesFromImageTest-1041185936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-abaa86f3-41d2-40f5-85af-7d3b4d37e88b tempest-CreateVolumesFromImageTest-1041185936 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:15:52 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-abaa86f3-41d2-40f5-85af-7d3b4d37e88b tempest-CreateVolumesFromImageTest-1041185936 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:15:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-abaa86f3-41d2-40f5-85af-7d3b4d37e88b tempest-CreateVolumesFromImageTest-1041185936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-68b9c652-4bbd-47d5-ac9c-6bd7078aa8e5 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5506f160-6b9e-4826-8c4d-6d065a779716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a05957ae-b897-41ad-b4a2-774080a65da9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c80189d12134c1290837a861854ba7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:52Z,use_quota=True,user_id='89c96debb5264c9ea3d985df3f3762ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe1733c6-c421-443f-842f-c340c3077f4c),volume_type_id=fe1733c6-c421-443f-842f-c340c3077f4c)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:52 devstack sudo[107857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-68b9c652-4bbd-47d5-ac9c-6bd7078aa8e5 1073741824 Sep 28 15:15:52 devstack sudo[107857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3caae61f-4b9c-454d-9a5c-043d41188e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3caae61f-4b9c-454d-9a5c-043d41188e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21515f3b-e110-4312-b307-14003dd5559d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:52 devstack cinder-volume[87116]: DEBUG cinder.image.glance [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Creating Keystone auth plugin from conf {{(pid=87116) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 15:15:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d34b9d74-ab81-4ebe-b512-d91941259849 tempest-CreateVolumesFromImageTest-1041185936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f56ced83-8477-4998-902a-2718f28cc463) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88e95e93-f64f-4c70-a715-2dbb2b3966df', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d34b9d74-ab81-4ebe-b512-d91941259849 tempest-CreateVolumesFromImageTest-1041185936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb325893-4417-4c44-895f-13188d9d0b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:52 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-d34b9d74-ab81-4ebe-b512-d91941259849 tempest-CreateVolumesFromImageTest-1041185936 None] Volume volume-88e95e93-f64f-4c70-a715-2dbb2b3966df (88e95e93-f64f-4c70-a715-2dbb2b3966df): created successfully Sep 28 15:15:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d34b9d74-ab81-4ebe-b512-d91941259849 tempest-CreateVolumesFromImageTest-1041185936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb325893-4417-4c44-895f-13188d9d0b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d34b9d74-ab81-4ebe-b512-d91941259849 tempest-CreateVolumesFromImageTest-1041185936 None] Flow 'volume_create_manager' (900a78bf-0fbd-4d20-a29a-ddd9a4720d5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:15:52 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-d34b9d74-ab81-4ebe-b512-d91941259849 tempest-CreateVolumesFromImageTest-1041185936 None] Created volume successfully. Sep 28 15:15:52 devstack sudo[107854]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3c4a1657-dd47-4deb-b222-3903acc39431__y91wnlxdevstack@QuobyteHD" returned: 0 in 0.509s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3c4a1657-dd47-4deb-b222-3903acc39431__y91wnlxdevstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:52 devstack sudo[107861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3c4a1657-dd47-4deb-b222-3903acc39431__y91wnlxdevstack@QuobyteHD Sep 28 15:15:52 devstack sudo[107861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21515f3b-e110-4312-b307-14003dd5559d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a05957ae-b897-41ad-b4a2-774080a65da9', 'volume_name': 'volume-a05957ae-b897-41ad-b4a2-774080a65da9', 'volume_size': 1, 'image_id': 'fb400120-b947-4918-9844-7643ebfcba4e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fb400120-b947-4918-9844-7643ebfcba4e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f9359b535997525b955f26c614914dad', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5c80189d12134c1290837a861854ba7d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '191019b21a9d74f863908e230607290145555abb613c29b61248b80bc187d4512472106ab54db891594cfd7da4503f50b11040e0c7ca723f72baf575f51e0db7', 'id': 'fb400120-b947-4918-9844-7643ebfcba4e', 'created_at': datetime.datetime(2026, 9, 28, 13, 15, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 15, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fb400120-b947-4918-9844-7643ebfcba4e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b266aeef-f0cb-4f93-b061-3c7d04a043af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b266aeef-f0cb-4f93-b061-3c7d04a043af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a43e981c-15c6-4e6a-9453-dba918542031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:52 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Volume a05957ae-b897-41ad-b4a2-774080a65da9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a05957ae-b897-41ad-b4a2-774080a65da9', 'volume_size': 1, 'image_id': 'fb400120-b947-4918-9844-7643ebfcba4e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fb400120-b947-4918-9844-7643ebfcba4e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f9359b535997525b955f26c614914dad', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5c80189d12134c1290837a861854ba7d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '191019b21a9d74f863908e230607290145555abb613c29b61248b80bc187d4512472106ab54db891594cfd7da4503f50b11040e0c7ca723f72baf575f51e0db7', 'id': 'fb400120-b947-4918-9844-7643ebfcba4e', 'created_at': datetime.datetime(2026, 9, 28, 13, 15, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 15, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fb400120-b947-4918-9844-7643ebfcba4e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 28 15:15:52 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Trying to clone a05957ae-b897-41ad-b4a2-774080a65da9 from image fb400120-b947-4918-9844-7643ebfcba4e at location (None, [{'url': 'file:///opt/stack/data/glance/images/fb400120-b947-4918-9844-7643ebfcba4e', 'metadata': {}}]). {{(pid=87116) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 15:15:53 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fb400120-b947-4918-9844-7643ebfcba4e_bq92wlm0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87116) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 15:15:53 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Image download 0.00 MB at 0.00 MB/s Sep 28 15:15:53 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[7239ff69-c3ca-4d39-97dc-7ca2c4c34bc8]: (4, 'raw') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fb400120-b947-4918-9844-7643ebfcba4e_bq92wlm0devstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:53 devstack sudo[107861]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3c4a1657-dd47-4deb-b222-3903acc39431__y91wnlxdevstack@QuobyteHD" returned: 1 in 0.434s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3c4a1657-dd47-4deb-b222-3903acc39431__y91wnlxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:15:53 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] Temporary image 3c4a1657-dd47-4deb-b222-3903acc39431 is fetched for user 5764d27370474264a6d25a6bcc63c4e0. {{(pid=87116) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 15:15:53 devstack sudo[107857]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-abaa86f3-41d2-40f5-85af-7d3b4d37e88b tempest-CreateVolumesFromImageTest-1041185936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-68b9c652-4bbd-47d5-ac9c-6bd7078aa8e5 1073741824" returned: 0 in 0.614s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-abaa86f3-41d2-40f5-85af-7d3b4d37e88b tempest-CreateVolumesFromImageTest-1041185936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-68b9c652-4bbd-47d5-ac9c-6bd7078aa8e5 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:53 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9339ad9-2560-44a9-843a-e4585bb0c947]: (4, 'raw') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3c4a1657-dd47-4deb-b222-3903acc39431__y91wnlxdevstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:53 devstack sudo[107870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fb400120-b947-4918-9844-7643ebfcba4e_bq92wlm0devstack@QuobyteHD Sep 28 15:15:53 devstack sudo[107870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:53 devstack sudo[107871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-68b9c652-4bbd-47d5-ac9c-6bd7078aa8e5 Sep 28 15:15:53 devstack sudo[107871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:53 devstack sudo[107872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3c4a1657-dd47-4deb-b222-3903acc39431__y91wnlxdevstack@QuobyteHD Sep 28 15:15:53 devstack sudo[107872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:53 devstack sudo[107870]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fb400120-b947-4918-9844-7643ebfcba4e_bq92wlm0devstack@QuobyteHD" returned: 0 in 0.456s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb400120-b947-4918-9844-7643ebfcba4e_bq92wlm0devstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:53 devstack sudo[107871]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-abaa86f3-41d2-40f5-85af-7d3b4d37e88b tempest-CreateVolumesFromImageTest-1041185936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-68b9c652-4bbd-47d5-ac9c-6bd7078aa8e5" returned: 0 in 0.357s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:53 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-abaa86f3-41d2-40f5-85af-7d3b4d37e88b tempest-CreateVolumesFromImageTest-1041185936 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:15:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-abaa86f3-41d2-40f5-85af-7d3b4d37e88b tempest-CreateVolumesFromImageTest-1041185936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-69e38686-3065-4a51-8f31-52d84ab636ec tempest-CreateVolumesFromImageTest-1041185936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.513s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:53 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-69e38686-3065-4a51-8f31-52d84ab636ec tempest-CreateVolumesFromImageTest-1041185936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1117306558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e9a12a0-a934-4c48-a66a-7cbfdd7e865a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fa3fcbbddf84fc8a8d30141eb64d6b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:50Z,use_quota=True,user_id='15e74ff5fdba449cbfa949996e0b340c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:15:53 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-69e38686-3065-4a51-8f31-52d84ab636ec tempest-CreateVolumesFromImageTest-1041185936 None] Creating volume 5e9a12a0-a934-4c48-a66a-7cbfdd7e865a {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:15:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-69e38686-3065-4a51-8f31-52d84ab636ec tempest-CreateVolumesFromImageTest-1041185936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-69e38686-3065-4a51-8f31-52d84ab636ec tempest-CreateVolumesFromImageTest-1041185936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:53 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-69e38686-3065-4a51-8f31-52d84ab636ec tempest-CreateVolumesFromImageTest-1041185936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:15:53 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-69e38686-3065-4a51-8f31-52d84ab636ec tempest-CreateVolumesFromImageTest-1041185936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:15:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-69e38686-3065-4a51-8f31-52d84ab636ec tempest-CreateVolumesFromImageTest-1041185936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:53 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-69e38686-3065-4a51-8f31-52d84ab636ec tempest-CreateVolumesFromImageTest-1041185936 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:15:53 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-69e38686-3065-4a51-8f31-52d84ab636ec tempest-CreateVolumesFromImageTest-1041185936 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:15:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-69e38686-3065-4a51-8f31-52d84ab636ec tempest-CreateVolumesFromImageTest-1041185936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5e9a12a0-a934-4c48-a66a-7cbfdd7e865a 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:53 devstack sudo[107880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5e9a12a0-a934-4c48-a66a-7cbfdd7e865a 1073741824 Sep 28 15:15:53 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-abaa86f3-41d2-40f5-85af-7d3b4d37e88b tempest-CreateVolumesFromImageTest-1041185936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6e46e81-47bf-4724-b996-e464a028f6f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68b9c652-4bbd-47d5-ac9c-6bd7078aa8e5', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:53 devstack sudo[107880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:53 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-abaa86f3-41d2-40f5-85af-7d3b4d37e88b tempest-CreateVolumesFromImageTest-1041185936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ae88b12-22c2-4079-a4e7-08e58494f0c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:53 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-abaa86f3-41d2-40f5-85af-7d3b4d37e88b tempest-CreateVolumesFromImageTest-1041185936 None] Volume volume-68b9c652-4bbd-47d5-ac9c-6bd7078aa8e5 (68b9c652-4bbd-47d5-ac9c-6bd7078aa8e5): created successfully Sep 28 15:15:53 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-abaa86f3-41d2-40f5-85af-7d3b4d37e88b tempest-CreateVolumesFromImageTest-1041185936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ae88b12-22c2-4079-a4e7-08e58494f0c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:53 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-abaa86f3-41d2-40f5-85af-7d3b4d37e88b tempest-CreateVolumesFromImageTest-1041185936 None] Flow 'volume_create_manager' (c44e5673-63fe-4e40-99ef-f07f14ab2608) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:15:53 devstack sudo[107872]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3c4a1657-dd47-4deb-b222-3903acc39431__y91wnlxdevstack@QuobyteHD" returned: 0 in 0.444s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3c4a1657-dd47-4deb-b222-3903acc39431__y91wnlxdevstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:53 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-abaa86f3-41d2-40f5-85af-7d3b4d37e88b tempest-CreateVolumesFromImageTest-1041185936 None] Created volume successfully. Sep 28 15:15:53 devstack sudo[107879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb400120-b947-4918-9844-7643ebfcba4e_bq92wlm0devstack@QuobyteHD Sep 28 15:15:53 devstack sudo[107879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:53 devstack sudo[107884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3c4a1657-dd47-4deb-b222-3903acc39431__y91wnlxdevstack@QuobyteHD Sep 28 15:15:53 devstack sudo[107884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:54 devstack sudo[107879]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb400120-b947-4918-9844-7643ebfcba4e_bq92wlm0devstack@QuobyteHD" returned: 1 in 0.453s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb400120-b947-4918-9844-7643ebfcba4e_bq92wlm0devstack@QuobyteHD' failed. Not Retrying. {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:15:54 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Temporary image fb400120-b947-4918-9844-7643ebfcba4e is fetched for user 89c96debb5264c9ea3d985df3f3762ce. {{(pid=87116) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 15:15:54 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d51fa6-b621-473b-bd68-4122d1b92957]: (4, 'raw') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fb400120-b947-4918-9844-7643ebfcba4e_bq92wlm0devstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:54 devstack sudo[107884]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3c4a1657-dd47-4deb-b222-3903acc39431__y91wnlxdevstack@QuobyteHD" returned: 1 in 0.442s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3c4a1657-dd47-4deb-b222-3903acc39431__y91wnlxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:15:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:54 devstack sudo[107896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fb400120-b947-4918-9844-7643ebfcba4e_bq92wlm0devstack@QuobyteHD Sep 28 15:15:54 devstack sudo[107896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:54 devstack sudo[107880]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-69e38686-3065-4a51-8f31-52d84ab636ec tempest-CreateVolumesFromImageTest-1041185936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5e9a12a0-a934-4c48-a66a-7cbfdd7e865a 1073741824" returned: 0 in 0.658s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-69e38686-3065-4a51-8f31-52d84ab636ec tempest-CreateVolumesFromImageTest-1041185936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5e9a12a0-a934-4c48-a66a-7cbfdd7e865a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:54 devstack sudo[107898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5e9a12a0-a934-4c48-a66a-7cbfdd7e865a Sep 28 15:15:54 devstack sudo[107898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:54 devstack sudo[107896]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fb400120-b947-4918-9844-7643ebfcba4e_bq92wlm0devstack@QuobyteHD" returned: 0 in 0.450s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb400120-b947-4918-9844-7643ebfcba4e_bq92wlm0devstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:54 devstack sudo[107898]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-69e38686-3065-4a51-8f31-52d84ab636ec tempest-CreateVolumesFromImageTest-1041185936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5e9a12a0-a934-4c48-a66a-7cbfdd7e865a" returned: 0 in 0.338s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:54 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-69e38686-3065-4a51-8f31-52d84ab636ec tempest-CreateVolumesFromImageTest-1041185936 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:15:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-69e38686-3065-4a51-8f31-52d84ab636ec tempest-CreateVolumesFromImageTest-1041185936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d3fe7320-4753-4f96-991f-13af996faad4 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.554s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:54 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-d3fe7320-4753-4f96-991f-13af996faad4 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Creating offline snapshot a41182d8-6098-4330-8c51-016dca113e90 of volume e7691df8-36ca-431a-bfc9-dbd2f7a572f9 {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:15:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-69e38686-3065-4a51-8f31-52d84ab636ec tempest-CreateVolumesFromImageTest-1041185936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8d626ed-7a52-4e29-af67-17ad61a8cb4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e9a12a0-a934-4c48-a66a-7cbfdd7e865a', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:54 devstack sudo[107902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb400120-b947-4918-9844-7643ebfcba4e_bq92wlm0devstack@QuobyteHD Sep 28 15:15:54 devstack sudo[107902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-69e38686-3065-4a51-8f31-52d84ab636ec tempest-CreateVolumesFromImageTest-1041185936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83802f5d-0cbf-454c-8cf9-bcd2637ba3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:54 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[e716eeab-3154-40b8-87b0-cf15f6cde97f]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d3fe7320-4753-4f96-991f-13af996faad4 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e7691df8-36ca-431a-bfc9-dbd2f7a572f9 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:54 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-69e38686-3065-4a51-8f31-52d84ab636ec tempest-CreateVolumesFromImageTest-1041185936 None] Volume volume-5e9a12a0-a934-4c48-a66a-7cbfdd7e865a (5e9a12a0-a934-4c48-a66a-7cbfdd7e865a): created successfully Sep 28 15:15:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-69e38686-3065-4a51-8f31-52d84ab636ec tempest-CreateVolumesFromImageTest-1041185936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83802f5d-0cbf-454c-8cf9-bcd2637ba3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-69e38686-3065-4a51-8f31-52d84ab636ec tempest-CreateVolumesFromImageTest-1041185936 None] Flow 'volume_create_manager' (65f4a1f4-ca0e-4177-926d-f4d8f1d38c74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:15:54 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-69e38686-3065-4a51-8f31-52d84ab636ec tempest-CreateVolumesFromImageTest-1041185936 None] Created volume successfully. Sep 28 15:15:54 devstack sudo[107905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e7691df8-36ca-431a-bfc9-dbd2f7a572f9 Sep 28 15:15:54 devstack sudo[107905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:55 devstack sudo[107902]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb400120-b947-4918-9844-7643ebfcba4e_bq92wlm0devstack@QuobyteHD" returned: 1 in 0.407s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb400120-b947-4918-9844-7643ebfcba4e_bq92wlm0devstack@QuobyteHD' failed. Not Retrying. {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:15:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:55 devstack sudo[107905]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d3fe7320-4753-4f96-991f-13af996faad4 tempest-CreateVolumesFromSnapshotTest-1830645918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e7691df8-36ca-431a-bfc9-dbd2f7a572f9" returned: 0 in 0.447s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d3fe7320-4753-4f96-991f-13af996faad4 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e7691df8-36ca-431a-bfc9-dbd2f7a572f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e7691df8-36ca-431a-bfc9-dbd2f7a572f9.a41182d8-6098-4330-8c51-016dca113e90 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:55 devstack sudo[107914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e7691df8-36ca-431a-bfc9-dbd2f7a572f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e7691df8-36ca-431a-bfc9-dbd2f7a572f9.a41182d8-6098-4330-8c51-016dca113e90 1G Sep 28 15:15:55 devstack sudo[107914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:55 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ace3a618-5130-4b3c-bcb7-f674a0f5af06 tempest-CreateVolumesFromImageTest-1041185936 None] Acquiring lock "cinder-5e9a12a0-a934-4c48-a66a-7cbfdd7e865a-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:55 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ace3a618-5130-4b3c-bcb7-f674a0f5af06 tempest-CreateVolumesFromImageTest-1041185936 None] Lock "cinder-5e9a12a0-a934-4c48-a66a-7cbfdd7e865a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:55 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ace3a618-5130-4b3c-bcb7-f674a0f5af06 tempest-CreateVolumesFromImageTest-1041185936 None] Acquiring lock "cinder-quobyte-5e9a12a0-a934-4c48-a66a-7cbfdd7e865a" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:55 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ace3a618-5130-4b3c-bcb7-f674a0f5af06 tempest-CreateVolumesFromImageTest-1041185936 None] Lock "cinder-quobyte-5e9a12a0-a934-4c48-a66a-7cbfdd7e865a" acquired by "delete_volume" :: waited 0.018s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:55 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[85de16fc-9266-478c-a0de-59e4677640c4]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ace3a618-5130-4b3c-bcb7-f674a0f5af06 tempest-CreateVolumesFromImageTest-1041185936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5e9a12a0-a934-4c48-a66a-7cbfdd7e865a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:55 devstack sudo[107914]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d3fe7320-4753-4f96-991f-13af996faad4 tempest-CreateVolumesFromSnapshotTest-1830645918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e7691df8-36ca-431a-bfc9-dbd2f7a572f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e7691df8-36ca-431a-bfc9-dbd2f7a572f9.a41182d8-6098-4330-8c51-016dca113e90 1G" returned: 0 in 0.508s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d3fe7320-4753-4f96-991f-13af996faad4 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7691df8-36ca-431a-bfc9-dbd2f7a572f9 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e7691df8-36ca-431a-bfc9-dbd2f7a572f9.a41182d8-6098-4330-8c51-016dca113e90 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:55 devstack sudo[107920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7691df8-36ca-431a-bfc9-dbd2f7a572f9 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e7691df8-36ca-431a-bfc9-dbd2f7a572f9.a41182d8-6098-4330-8c51-016dca113e90 Sep 28 15:15:55 devstack sudo[107920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:55 devstack sudo[107919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5e9a12a0-a934-4c48-a66a-7cbfdd7e865a Sep 28 15:15:55 devstack sudo[107919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:56 devstack sudo[107920]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d3fe7320-4753-4f96-991f-13af996faad4 tempest-CreateVolumesFromSnapshotTest-1830645918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7691df8-36ca-431a-bfc9-dbd2f7a572f9 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e7691df8-36ca-431a-bfc9-dbd2f7a572f9.a41182d8-6098-4330-8c51-016dca113e90" returned: 0 in 0.304s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:56 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-d3fe7320-4753-4f96-991f-13af996faad4 tempest-CreateVolumesFromSnapshotTest-1830645918 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e7691df8-36ca-431a-bfc9-dbd2f7a572f9.a41182d8-6098-4330-8c51-016dca113e90 is being set with open permissions: ugo+rw Sep 28 15:15:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d3fe7320-4753-4f96-991f-13af996faad4 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e7691df8-36ca-431a-bfc9-dbd2f7a572f9.a41182d8-6098-4330-8c51-016dca113e90 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:56 devstack sudo[107919]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ace3a618-5130-4b3c-bcb7-f674a0f5af06 tempest-CreateVolumesFromImageTest-1041185936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5e9a12a0-a934-4c48-a66a-7cbfdd7e865a" returned: 0 in 0.427s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ace3a618-5130-4b3c-bcb7-f674a0f5af06 tempest-CreateVolumesFromImageTest-1041185936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5e9a12a0-a934-4c48-a66a-7cbfdd7e865a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:56 devstack sudo[107929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e7691df8-36ca-431a-bfc9-dbd2f7a572f9.a41182d8-6098-4330-8c51-016dca113e90 Sep 28 15:15:56 devstack sudo[107929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:56 devstack sudo[107930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5e9a12a0-a934-4c48-a66a-7cbfdd7e865a Sep 28 15:15:56 devstack sudo[107930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:56 devstack sudo[107930]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:56 devstack sudo[107929]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d3fe7320-4753-4f96-991f-13af996faad4 tempest-CreateVolumesFromSnapshotTest-1830645918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e7691df8-36ca-431a-bfc9-dbd2f7a572f9.a41182d8-6098-4330-8c51-016dca113e90" returned: 0 in 0.280s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ace3a618-5130-4b3c-bcb7-f674a0f5af06 tempest-CreateVolumesFromImageTest-1041185936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5e9a12a0-a934-4c48-a66a-7cbfdd7e865a" returned: 0 in 0.264s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:56 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ace3a618-5130-4b3c-bcb7-f674a0f5af06 tempest-CreateVolumesFromImageTest-1041185936 None] Lock "cinder-quobyte-5e9a12a0-a934-4c48-a66a-7cbfdd7e865a" released by "delete_volume" :: held 0.749s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:15:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d3fe7320-4753-4f96-991f-13af996faad4 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e7691df8-36ca-431a-bfc9-dbd2f7a572f9.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:56 devstack sudo[107935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e7691df8-36ca-431a-bfc9-dbd2f7a572f9.info Sep 28 15:15:56 devstack sudo[107935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:56 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-ace3a618-5130-4b3c-bcb7-f674a0f5af06 tempest-CreateVolumesFromImageTest-1041185936 None] Created reservations ['e620b55e-49ef-41e7-8884-b1b511ccae17', 'f6eb57e9-51f8-4b77-ada8-50c008abac1e', '53729024-18fd-4f05-b5d9-0519f6061b0b', 'a52c36dc-b9c7-4e0f-a715-486694919f15'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:15:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ace3a618-5130-4b3c-bcb7-f674a0f5af06 tempest-CreateVolumesFromImageTest-1041185936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ace3a618-5130-4b3c-bcb7-f674a0f5af06 tempest-CreateVolumesFromImageTest-1041185936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:56 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ace3a618-5130-4b3c-bcb7-f674a0f5af06 tempest-CreateVolumesFromImageTest-1041185936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:15:56 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ace3a618-5130-4b3c-bcb7-f674a0f5af06 tempest-CreateVolumesFromImageTest-1041185936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:15:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ace3a618-5130-4b3c-bcb7-f674a0f5af06 tempest-CreateVolumesFromImageTest-1041185936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ace3a618-5130-4b3c-bcb7-f674a0f5af06 tempest-CreateVolumesFromImageTest-1041185936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:56 devstack sudo[107937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:15:56 devstack sudo[107937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:56 devstack sudo[107935]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d3fe7320-4753-4f96-991f-13af996faad4 tempest-CreateVolumesFromSnapshotTest-1830645918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e7691df8-36ca-431a-bfc9-dbd2f7a572f9.info" returned: 0 in 0.306s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:56 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-d3fe7320-4753-4f96-991f-13af996faad4 tempest-CreateVolumesFromSnapshotTest-1830645918 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e7691df8-36ca-431a-bfc9-dbd2f7a572f9.info is being set with open permissions: ugo+rw Sep 28 15:15:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d3fe7320-4753-4f96-991f-13af996faad4 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e7691df8-36ca-431a-bfc9-dbd2f7a572f9.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:56 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c2d76883-35a9-4bca-a2cc-ceadaaa51078 tempest-CreateVolumesFromImageTest-1041185936 None] Acquiring lock "cinder-68b9c652-4bbd-47d5-ac9c-6bd7078aa8e5-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:56 devstack sudo[107940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e7691df8-36ca-431a-bfc9-dbd2f7a572f9.info Sep 28 15:15:56 devstack sudo[107940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:56 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c2d76883-35a9-4bca-a2cc-ceadaaa51078 tempest-CreateVolumesFromImageTest-1041185936 None] Lock "cinder-68b9c652-4bbd-47d5-ac9c-6bd7078aa8e5-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:56 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c2d76883-35a9-4bca-a2cc-ceadaaa51078 tempest-CreateVolumesFromImageTest-1041185936 None] Acquiring lock "cinder-quobyte-68b9c652-4bbd-47d5-ac9c-6bd7078aa8e5" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:56 devstack sudo[107937]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ace3a618-5130-4b3c-bcb7-f674a0f5af06 tempest-CreateVolumesFromImageTest-1041185936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.348s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:56 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-ace3a618-5130-4b3c-bcb7-f674a0f5af06 tempest-CreateVolumesFromImageTest-1041185936 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:15:56 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-ace3a618-5130-4b3c-bcb7-f674a0f5af06 tempest-CreateVolumesFromImageTest-1041185936 None] Deleted volume successfully. Sep 28 15:15:56 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c2d76883-35a9-4bca-a2cc-ceadaaa51078 tempest-CreateVolumesFromImageTest-1041185936 None] Lock "cinder-quobyte-68b9c652-4bbd-47d5-ac9c-6bd7078aa8e5" acquired by "delete_volume" :: waited 0.025s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:56 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ace3a618-5130-4b3c-bcb7-f674a0f5af06 tempest-CreateVolumesFromImageTest-1041185936 None] Lock "cinder-5e9a12a0-a934-4c48-a66a-7cbfdd7e865a-delete_volume" released by "delete_volume" :: held 1.383s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:15:56 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4725ef-34e3-4a89-a409-85fdafb6d510]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c2d76883-35a9-4bca-a2cc-ceadaaa51078 tempest-CreateVolumesFromImageTest-1041185936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-68b9c652-4bbd-47d5-ac9c-6bd7078aa8e5 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:57 devstack sudo[107943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-68b9c652-4bbd-47d5-ac9c-6bd7078aa8e5 Sep 28 15:15:57 devstack sudo[107943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:57 devstack sudo[107940]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d3fe7320-4753-4f96-991f-13af996faad4 tempest-CreateVolumesFromSnapshotTest-1830645918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e7691df8-36ca-431a-bfc9-dbd2f7a572f9.info" returned: 0 in 0.387s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d3fe7320-4753-4f96-991f-13af996faad4 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.388s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.920s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=740b3c54-caab-427a-b0ac-996ccdf54104,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5eee614e11a546ea9dfdf524506c0c16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:51Z,use_quota=True,user_id='5764d27370474264a6d25a6bcc63c4e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:15:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] Creating volume 740b3c54-caab-427a-b0ac-996ccdf54104 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:15:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:15:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:15:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:15:57 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:15:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-740b3c54-caab-427a-b0ac-996ccdf54104 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:57 devstack sudo[107947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-740b3c54-caab-427a-b0ac-996ccdf54104 1073741824 Sep 28 15:15:57 devstack sudo[107947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:57 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-d3fe7320-4753-4f96-991f-13af996faad4 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Create snapshot completed successfully Sep 28 15:15:57 devstack sudo[107943]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c2d76883-35a9-4bca-a2cc-ceadaaa51078 tempest-CreateVolumesFromImageTest-1041185936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-68b9c652-4bbd-47d5-ac9c-6bd7078aa8e5" returned: 0 in 0.478s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c2d76883-35a9-4bca-a2cc-ceadaaa51078 tempest-CreateVolumesFromImageTest-1041185936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-68b9c652-4bbd-47d5-ac9c-6bd7078aa8e5 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:57 devstack sudo[107953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-68b9c652-4bbd-47d5-ac9c-6bd7078aa8e5 Sep 28 15:15:57 devstack sudo[107953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:57 devstack sudo[107947]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-740b3c54-caab-427a-b0ac-996ccdf54104 1073741824" returned: 0 in 0.615s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:57 devstack sudo[107953]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c2d76883-35a9-4bca-a2cc-ceadaaa51078 tempest-CreateVolumesFromImageTest-1041185936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-68b9c652-4bbd-47d5-ac9c-6bd7078aa8e5" returned: 0 in 0.388s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-740b3c54-caab-427a-b0ac-996ccdf54104 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:57 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c2d76883-35a9-4bca-a2cc-ceadaaa51078 tempest-CreateVolumesFromImageTest-1041185936 None] Lock "cinder-quobyte-68b9c652-4bbd-47d5-ac9c-6bd7078aa8e5" released by "delete_volume" :: held 0.955s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:15:57 devstack sudo[107959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-740b3c54-caab-427a-b0ac-996ccdf54104 Sep 28 15:15:57 devstack sudo[107959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:57 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-c2d76883-35a9-4bca-a2cc-ceadaaa51078 tempest-CreateVolumesFromImageTest-1041185936 None] Created reservations ['393ed0e1-f3cc-44bf-a2c5-ecba060795a7', 'c139bf64-4a3e-4037-ac0b-7ce63f3fea0b', 'a80d2b9a-fa60-4923-b78f-5822f46cedf5', 'ff981cef-1a41-491c-8de6-490ace85032b'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:15:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c2d76883-35a9-4bca-a2cc-ceadaaa51078 tempest-CreateVolumesFromImageTest-1041185936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c2d76883-35a9-4bca-a2cc-ceadaaa51078 tempest-CreateVolumesFromImageTest-1041185936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c2d76883-35a9-4bca-a2cc-ceadaaa51078 tempest-CreateVolumesFromImageTest-1041185936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:15:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c2d76883-35a9-4bca-a2cc-ceadaaa51078 tempest-CreateVolumesFromImageTest-1041185936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:15:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c2d76883-35a9-4bca-a2cc-ceadaaa51078 tempest-CreateVolumesFromImageTest-1041185936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c2d76883-35a9-4bca-a2cc-ceadaaa51078 tempest-CreateVolumesFromImageTest-1041185936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:58 devstack sudo[107961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:15:58 devstack sudo[107961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:58 devstack sudo[107959]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-740b3c54-caab-427a-b0ac-996ccdf54104" returned: 0 in 0.394s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:15:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.200s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a05957ae-b897-41ad-b4a2-774080a65da9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c80189d12134c1290837a861854ba7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:52Z,use_quota=True,user_id='89c96debb5264c9ea3d985df3f3762ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe1733c6-c421-443f-842f-c340c3077f4c),volume_type_id=fe1733c6-c421-443f-842f-c340c3077f4c)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:15:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Creating volume a05957ae-b897-41ad-b4a2-774080a65da9 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:15:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:15:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:15:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:15:58 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:15:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a05957ae-b897-41ad-b4a2-774080a65da9 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:58 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-b58333ba-e3d0-482b-b02d-4f6aea625017 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:15:58 devstack sudo[107964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a05957ae-b897-41ad-b4a2-774080a65da9 1073741824 Sep 28 15:15:58 devstack sudo[107964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b58333ba-e3d0-482b-b02d-4f6aea625017 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Flow 'volume_create_manager' (a11d9bd4-a3a4-49b4-99cf-5da8697b1916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:15:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b58333ba-e3d0-482b-b02d-4f6aea625017 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec0cada3-36a5-4e05-9a65-2607f82d09b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b58333ba-e3d0-482b-b02d-4f6aea625017 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec0cada3-36a5-4e05-9a65-2607f82d09b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-835410217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc2bf233-ae6f-4b60-931b-4b4c176ee327,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e725adeaa964354a1deed499e319b0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:58Z,use_quota=True,user_id='09dc7200bb394ef7bffaf8ff0caa55a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b58333ba-e3d0-482b-b02d-4f6aea625017 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efa22d30-aaa3-4f57-a641-428fcbad4c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b58333ba-e3d0-482b-b02d-4f6aea625017 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efa22d30-aaa3-4f57-a641-428fcbad4c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b58333ba-e3d0-482b-b02d-4f6aea625017 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a3ffeb6-e8a1-437c-b145-3d1e9b0e4d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b58333ba-e3d0-482b-b02d-4f6aea625017 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a3ffeb6-e8a1-437c-b145-3d1e9b0e4d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc2bf233-ae6f-4b60-931b-4b4c176ee327', 'volume_name': 'volume-cc2bf233-ae6f-4b60-931b-4b4c176ee327', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b58333ba-e3d0-482b-b02d-4f6aea625017 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d8d5f09-3765-48e2-93ef-f9f8da26679a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b58333ba-e3d0-482b-b02d-4f6aea625017 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d8d5f09-3765-48e2-93ef-f9f8da26679a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b58333ba-e3d0-482b-b02d-4f6aea625017 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c06f523-fb61-4833-bcbf-6b59264355e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:58 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-b58333ba-e3d0-482b-b02d-4f6aea625017 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Volume cc2bf233-ae6f-4b60-931b-4b4c176ee327: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc2bf233-ae6f-4b60-931b-4b4c176ee327', 'volume_size': 1} Sep 28 15:15:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b58333ba-e3d0-482b-b02d-4f6aea625017 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:58 devstack cinder-volume[87116]: DEBUG cinder.volume.volume_utils [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] Attempting download of 3c4a1657-dd47-4deb-b222-3903acc39431 ((None, [{'url': 'file:///opt/stack/data/glance/images/3c4a1657-dd47-4deb-b222-3903acc39431', 'metadata': {}}])) to volume 740b3c54-caab-427a-b0ac-996ccdf54104. {{(pid=87116) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1208}} Sep 28 15:15:58 devstack sudo[107961]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:58 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa71fe89-3345-4f91-9738-6803e7e0a79b]: (4, 'raw') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3c4a1657-dd47-4deb-b222-3903acc39431_3s1uc11j {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c2d76883-35a9-4bca-a2cc-ceadaaa51078 tempest-CreateVolumesFromImageTest-1041185936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.444s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:58 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-c2d76883-35a9-4bca-a2cc-ceadaaa51078 tempest-CreateVolumesFromImageTest-1041185936 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:15:58 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-c2d76883-35a9-4bca-a2cc-ceadaaa51078 tempest-CreateVolumesFromImageTest-1041185936 None] Deleted volume successfully. Sep 28 15:15:58 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c2d76883-35a9-4bca-a2cc-ceadaaa51078 tempest-CreateVolumesFromImageTest-1041185936 None] Lock "cinder-68b9c652-4bbd-47d5-ac9c-6bd7078aa8e5-delete_volume" released by "delete_volume" :: held 1.834s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:15:58 devstack sudo[107967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3c4a1657-dd47-4deb-b222-3903acc39431_3s1uc11j Sep 28 15:15:58 devstack sudo[107967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:58 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0c4fda7-de51-4586-a84b-56af6ef39b6b tempest-CreateVolumesFromSnapshotTest-1830645918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:15:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e0c4fda7-de51-4586-a84b-56af6ef39b6b tempest-CreateVolumesFromSnapshotTest-1830645918 None] Flow 'volume_create_manager' (9e987b4d-a237-4756-b313-9c02c928e6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:15:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e0c4fda7-de51-4586-a84b-56af6ef39b6b tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5932fcc8-4632-407d-9a3f-cf95a0dbeace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e0c4fda7-de51-4586-a84b-56af6ef39b6b tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5932fcc8-4632-407d-9a3f-cf95a0dbeace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2134610669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=469e45cb-3512-47f9-91bb-d47b0bd3088b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e725adeaa964354a1deed499e319b0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:59Z,use_quota=True,user_id='09dc7200bb394ef7bffaf8ff0caa55a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e0c4fda7-de51-4586-a84b-56af6ef39b6b tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee115f01-da2c-4e7f-a106-68ba92cd61ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e0c4fda7-de51-4586-a84b-56af6ef39b6b tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee115f01-da2c-4e7f-a106-68ba92cd61ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e0c4fda7-de51-4586-a84b-56af6ef39b6b tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (061113ec-6767-4e20-85fb-6043e2b57da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e0c4fda7-de51-4586-a84b-56af6ef39b6b tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (061113ec-6767-4e20-85fb-6043e2b57da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '469e45cb-3512-47f9-91bb-d47b0bd3088b', 'volume_name': 'volume-469e45cb-3512-47f9-91bb-d47b0bd3088b', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e0c4fda7-de51-4586-a84b-56af6ef39b6b tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22783ff1-93e5-4dd1-bae1-2426dc4aad4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e0c4fda7-de51-4586-a84b-56af6ef39b6b tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22783ff1-93e5-4dd1-bae1-2426dc4aad4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e0c4fda7-de51-4586-a84b-56af6ef39b6b tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a274b5ff-6517-4c67-9064-ec37aa69faa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:58 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-e0c4fda7-de51-4586-a84b-56af6ef39b6b tempest-CreateVolumesFromSnapshotTest-1830645918 None] Volume 469e45cb-3512-47f9-91bb-d47b0bd3088b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-469e45cb-3512-47f9-91bb-d47b0bd3088b', 'volume_size': 1} Sep 28 15:15:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e0c4fda7-de51-4586-a84b-56af6ef39b6b tempest-CreateVolumesFromSnapshotTest-1830645918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:59 devstack sudo[107964]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a05957ae-b897-41ad-b4a2-774080a65da9 1073741824" returned: 0 in 0.744s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a05957ae-b897-41ad-b4a2-774080a65da9 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:59 devstack sudo[107967]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3c4a1657-dd47-4deb-b222-3903acc39431_3s1uc11j" returned: 0 in 0.572s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c4a1657-dd47-4deb-b222-3903acc39431_3s1uc11j {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:59 devstack sudo[107975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a05957ae-b897-41ad-b4a2-774080a65da9 Sep 28 15:15:59 devstack sudo[107975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:59 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e34609e7-20b0-4c58-a87d-c6742d47561b tempest-CreateVolumesFromImageTest-1041185936 None] Acquiring lock "cinder-88e95e93-f64f-4c70-a715-2dbb2b3966df-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:59 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e34609e7-20b0-4c58-a87d-c6742d47561b tempest-CreateVolumesFromImageTest-1041185936 None] Lock "cinder-88e95e93-f64f-4c70-a715-2dbb2b3966df-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:59 devstack sudo[107976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c4a1657-dd47-4deb-b222-3903acc39431_3s1uc11j Sep 28 15:15:59 devstack sudo[107976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:59 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e34609e7-20b0-4c58-a87d-c6742d47561b tempest-CreateVolumesFromImageTest-1041185936 None] Acquiring lock "cinder-quobyte-88e95e93-f64f-4c70-a715-2dbb2b3966df" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:59 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e34609e7-20b0-4c58-a87d-c6742d47561b tempest-CreateVolumesFromImageTest-1041185936 None] Lock "cinder-quobyte-88e95e93-f64f-4c70-a715-2dbb2b3966df" acquired by "delete_volume" :: waited 0.032s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:59 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdaf73e9-ee2a-459b-8da1-7f5c6aeb6ea3 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:15:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bdaf73e9-ee2a-459b-8da1-7f5c6aeb6ea3 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Flow 'volume_create_manager' (d4ead36c-4e5f-49ea-a2e8-902eb0e0690a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:15:59 devstack sudo[107975]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bdaf73e9-ee2a-459b-8da1-7f5c6aeb6ea3 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fc8e365-715f-48e1-8347-de548d1a301f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:59 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[0575bf6e-fd51-49e6-a677-1785ebf771d2]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e34609e7-20b0-4c58-a87d-c6742d47561b tempest-CreateVolumesFromImageTest-1041185936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-88e95e93-f64f-4c70-a715-2dbb2b3966df {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a05957ae-b897-41ad-b4a2-774080a65da9" returned: 0 in 0.382s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] <== create_volume: return (1216ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:15:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.220s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b58333ba-e3d0-482b-b02d-4f6aea625017 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.056s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b58333ba-e3d0-482b-b02d-4f6aea625017 tempest-CreateVolumesFromSnapshotTest-1830645918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-835410217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc2bf233-ae6f-4b60-931b-4b4c176ee327,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e725adeaa964354a1deed499e319b0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:58Z,use_quota=True,user_id='09dc7200bb394ef7bffaf8ff0caa55a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:15:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-b58333ba-e3d0-482b-b02d-4f6aea625017 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Creating volume cc2bf233-ae6f-4b60-931b-4b4c176ee327 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:15:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b58333ba-e3d0-482b-b02d-4f6aea625017 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b58333ba-e3d0-482b-b02d-4f6aea625017 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b58333ba-e3d0-482b-b02d-4f6aea625017 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:15:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b58333ba-e3d0-482b-b02d-4f6aea625017 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:15:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b58333ba-e3d0-482b-b02d-4f6aea625017 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b58333ba-e3d0-482b-b02d-4f6aea625017 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:15:59 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-b58333ba-e3d0-482b-b02d-4f6aea625017 tempest-CreateVolumesFromSnapshotTest-1830645918 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:15:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b58333ba-e3d0-482b-b02d-4f6aea625017 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cc2bf233-ae6f-4b60-931b-4b4c176ee327 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:59 devstack sudo[107981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cc2bf233-ae6f-4b60-931b-4b4c176ee327 1073741824 Sep 28 15:15:59 devstack sudo[107981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bdaf73e9-ee2a-459b-8da1-7f5c6aeb6ea3 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fc8e365-715f-48e1-8347-de548d1a301f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1450359411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72b17e31-a906-47d2-bf18-afefc9d0d325,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e725adeaa964354a1deed499e319b0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:59Z,use_quota=True,user_id='09dc7200bb394ef7bffaf8ff0caa55a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bdaf73e9-ee2a-459b-8da1-7f5c6aeb6ea3 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65b348ad-f870-4c22-91eb-79eb8c33164c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bdaf73e9-ee2a-459b-8da1-7f5c6aeb6ea3 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65b348ad-f870-4c22-91eb-79eb8c33164c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bdaf73e9-ee2a-459b-8da1-7f5c6aeb6ea3 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d1e61b5-08f6-488e-9def-d92e89c63df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:59 devstack sudo[107976]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bdaf73e9-ee2a-459b-8da1-7f5c6aeb6ea3 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d1e61b5-08f6-488e-9def-d92e89c63df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72b17e31-a906-47d2-bf18-afefc9d0d325', 'volume_name': 'volume-72b17e31-a906-47d2-bf18-afefc9d0d325', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bdaf73e9-ee2a-459b-8da1-7f5c6aeb6ea3 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0104234e-e812-4c60-8c73-b0c927c9352a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bdaf73e9-ee2a-459b-8da1-7f5c6aeb6ea3 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0104234e-e812-4c60-8c73-b0c927c9352a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bdaf73e9-ee2a-459b-8da1-7f5c6aeb6ea3 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ec430f9-5761-488a-b4cb-110db02c66a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:59 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-bdaf73e9-ee2a-459b-8da1-7f5c6aeb6ea3 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Volume 72b17e31-a906-47d2-bf18-afefc9d0d325: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72b17e31-a906-47d2-bf18-afefc9d0d325', 'volume_size': 1} Sep 28 15:15:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bdaf73e9-ee2a-459b-8da1-7f5c6aeb6ea3 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c4a1657-dd47-4deb-b222-3903acc39431_3s1uc11j" returned: 1 in 0.539s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c4a1657-dd47-4deb-b222-3903acc39431_3s1uc11j' failed. Not Retrying. {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:15:59 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48e201b-e954-4fc2-8a26-6c9341f8d927]: (4, 'raw') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3c4a1657-dd47-4deb-b222-3903acc39431__y91wnlxdevstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:59 devstack sudo[107980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-88e95e93-f64f-4c70-a715-2dbb2b3966df Sep 28 15:15:59 devstack sudo[107980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:59 devstack cinder-volume[87116]: DEBUG cinder.volume.volume_utils [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Attempting download of fb400120-b947-4918-9844-7643ebfcba4e ((None, [{'url': 'file:///opt/stack/data/glance/images/fb400120-b947-4918-9844-7643ebfcba4e', 'metadata': {}}])) to volume a05957ae-b897-41ad-b4a2-774080a65da9. {{(pid=87116) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1208}} Sep 28 15:15:59 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[632f120d-0c18-4f2f-8cb5-b0e7a5b6776e]: (4, 'raw') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fb400120-b947-4918-9844-7643ebfcba4e_93awx53_ {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:59 devstack sudo[107985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3c4a1657-dd47-4deb-b222-3903acc39431__y91wnlxdevstack@QuobyteHD Sep 28 15:15:59 devstack sudo[107985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:59 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-1603e645-3c19-41ca-b2d0-adb6d67a9246 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:16:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1603e645-3c19-41ca-b2d0-adb6d67a9246 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Flow 'volume_create_manager' (8074ed9e-d7b2-478c-a1bb-7c9e541a74d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:00 devstack sudo[107987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fb400120-b947-4918-9844-7643ebfcba4e_93awx53_ Sep 28 15:16:00 devstack sudo[107987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1603e645-3c19-41ca-b2d0-adb6d67a9246 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14b467e8-8a36-4cd0-989b-791a91126b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1603e645-3c19-41ca-b2d0-adb6d67a9246 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14b467e8-8a36-4cd0-989b-791a91126b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1812883984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eefb56ae-5658-4a97-98c2-831ecae6d47e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e725adeaa964354a1deed499e319b0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:00Z,use_quota=True,user_id='09dc7200bb394ef7bffaf8ff0caa55a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1603e645-3c19-41ca-b2d0-adb6d67a9246 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec6df550-3412-4d77-a1c3-9b8ed16181b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1603e645-3c19-41ca-b2d0-adb6d67a9246 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec6df550-3412-4d77-a1c3-9b8ed16181b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1603e645-3c19-41ca-b2d0-adb6d67a9246 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a8c9da1-b8e4-4001-bdd5-034f5b1a0368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1603e645-3c19-41ca-b2d0-adb6d67a9246 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a8c9da1-b8e4-4001-bdd5-034f5b1a0368) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eefb56ae-5658-4a97-98c2-831ecae6d47e', 'volume_name': 'volume-eefb56ae-5658-4a97-98c2-831ecae6d47e', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1603e645-3c19-41ca-b2d0-adb6d67a9246 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77cb9207-28fd-45cf-b13a-7ca74850613f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1603e645-3c19-41ca-b2d0-adb6d67a9246 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77cb9207-28fd-45cf-b13a-7ca74850613f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1603e645-3c19-41ca-b2d0-adb6d67a9246 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (987274db-0a2c-44b6-a364-162830700475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:00 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-1603e645-3c19-41ca-b2d0-adb6d67a9246 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Volume eefb56ae-5658-4a97-98c2-831ecae6d47e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eefb56ae-5658-4a97-98c2-831ecae6d47e', 'volume_size': 1} Sep 28 15:16:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1603e645-3c19-41ca-b2d0-adb6d67a9246 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:00 devstack sudo[107985]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3c4a1657-dd47-4deb-b222-3903acc39431__y91wnlxdevstack@QuobyteHD" returned: 0 in 0.597s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3c4a1657-dd47-4deb-b222-3903acc39431__y91wnlxdevstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:00 devstack sudo[107980]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e34609e7-20b0-4c58-a87d-c6742d47561b tempest-CreateVolumesFromImageTest-1041185936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-88e95e93-f64f-4c70-a715-2dbb2b3966df" returned: 0 in 0.829s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e34609e7-20b0-4c58-a87d-c6742d47561b tempest-CreateVolumesFromImageTest-1041185936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-88e95e93-f64f-4c70-a715-2dbb2b3966df {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:00 devstack sudo[107999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-88e95e93-f64f-4c70-a715-2dbb2b3966df Sep 28 15:16:00 devstack sudo[107999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:00 devstack sudo[107998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3c4a1657-dd47-4deb-b222-3903acc39431__y91wnlxdevstack@QuobyteHD Sep 28 15:16:00 devstack sudo[107998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:00 devstack sudo[107981]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b58333ba-e3d0-482b-b02d-4f6aea625017 tempest-CreateVolumesFromSnapshotTest-1830645918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cc2bf233-ae6f-4b60-931b-4b4c176ee327 1073741824" returned: 0 in 0.984s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:00 devstack sudo[107987]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fb400120-b947-4918-9844-7643ebfcba4e_93awx53_" returned: 0 in 0.694s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fb400120-b947-4918-9844-7643ebfcba4e_93awx53_ {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b58333ba-e3d0-482b-b02d-4f6aea625017 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cc2bf233-ae6f-4b60-931b-4b4c176ee327 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:00 devstack sudo[108006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cc2bf233-ae6f-4b60-931b-4b4c176ee327 Sep 28 15:16:00 devstack sudo[108006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:00 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f51d3c8-31a6-4407-b203-bebbc4ba84d2 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:16:00 devstack sudo[107999]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:00 devstack sudo[108005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fb400120-b947-4918-9844-7643ebfcba4e_93awx53_ Sep 28 15:16:00 devstack sudo[108005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6f51d3c8-31a6-4407-b203-bebbc4ba84d2 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Flow 'volume_create_manager' (b31ff891-10ed-4a08-8b69-b8341dc41b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6f51d3c8-31a6-4407-b203-bebbc4ba84d2 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a472b7f-c116-4ff6-8306-512b572ee974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e34609e7-20b0-4c58-a87d-c6742d47561b tempest-CreateVolumesFromImageTest-1041185936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-88e95e93-f64f-4c70-a715-2dbb2b3966df" returned: 0 in 0.490s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6f51d3c8-31a6-4407-b203-bebbc4ba84d2 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a472b7f-c116-4ff6-8306-512b572ee974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1909287624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0035fc3e-2f64-4056-881b-d2e3c13c68da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e725adeaa964354a1deed499e319b0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:01Z,use_quota=True,user_id='09dc7200bb394ef7bffaf8ff0caa55a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6f51d3c8-31a6-4407-b203-bebbc4ba84d2 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8286cba-541d-498a-b85b-484e1d8e42f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6f51d3c8-31a6-4407-b203-bebbc4ba84d2 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8286cba-541d-498a-b85b-484e1d8e42f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6f51d3c8-31a6-4407-b203-bebbc4ba84d2 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (797547a3-bf9d-497a-b3a5-be73d5303677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6f51d3c8-31a6-4407-b203-bebbc4ba84d2 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (797547a3-bf9d-497a-b3a5-be73d5303677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0035fc3e-2f64-4056-881b-d2e3c13c68da', 'volume_name': 'volume-0035fc3e-2f64-4056-881b-d2e3c13c68da', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6f51d3c8-31a6-4407-b203-bebbc4ba84d2 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (669e2d83-c3db-42a8-9263-e7f0a536dadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6f51d3c8-31a6-4407-b203-bebbc4ba84d2 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (669e2d83-c3db-42a8-9263-e7f0a536dadb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6f51d3c8-31a6-4407-b203-bebbc4ba84d2 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01724ad5-663d-433f-b675-edbd8452a6ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:00 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-6f51d3c8-31a6-4407-b203-bebbc4ba84d2 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Volume 0035fc3e-2f64-4056-881b-d2e3c13c68da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0035fc3e-2f64-4056-881b-d2e3c13c68da', 'volume_size': 1} Sep 28 15:16:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6f51d3c8-31a6-4407-b203-bebbc4ba84d2 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:00 devstack sudo[107998]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:00 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e34609e7-20b0-4c58-a87d-c6742d47561b tempest-CreateVolumesFromImageTest-1041185936 None] Lock "cinder-quobyte-88e95e93-f64f-4c70-a715-2dbb2b3966df" released by "delete_volume" :: held 1.505s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3c4a1657-dd47-4deb-b222-3903acc39431__y91wnlxdevstack@QuobyteHD" returned: 1 in 0.603s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3c4a1657-dd47-4deb-b222-3903acc39431__y91wnlxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:16:00 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] 3c4a1657-dd47-4deb-b222-3903acc39431 was raw, converting to qcow2 {{(pid=87116) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 15:16:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3c4a1657-dd47-4deb-b222-3903acc39431__y91wnlxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-740b3c54-caab-427a-b0ac-996ccdf54104 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:00 devstack sudo[108013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3c4a1657-dd47-4deb-b222-3903acc39431__y91wnlxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-740b3c54-caab-427a-b0ac-996ccdf54104 Sep 28 15:16:00 devstack sudo[108013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:00 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-e34609e7-20b0-4c58-a87d-c6742d47561b tempest-CreateVolumesFromImageTest-1041185936 None] Created reservations ['5e2a0f72-f5ec-4643-a766-a7ce2801f054', 'd6f5860d-3e6d-4e91-8442-73b127325dbb', '63eeeb2e-4039-4cda-9417-a745e44bce92', 'bde5dd48-8abf-4ace-b5dd-f45d71c85ecd'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:16:00 devstack sudo[108006]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b58333ba-e3d0-482b-b02d-4f6aea625017 tempest-CreateVolumesFromSnapshotTest-1830645918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cc2bf233-ae6f-4b60-931b-4b4c176ee327" returned: 0 in 0.380s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:00 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b58333ba-e3d0-482b-b02d-4f6aea625017 tempest-CreateVolumesFromSnapshotTest-1830645918 None] <== create_volume: return (1474ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:16:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b58333ba-e3d0-482b-b02d-4f6aea625017 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.478s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e0c4fda7-de51-4586-a84b-56af6ef39b6b tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.068s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:00 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e0c4fda7-de51-4586-a84b-56af6ef39b6b tempest-CreateVolumesFromSnapshotTest-1830645918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2134610669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=469e45cb-3512-47f9-91bb-d47b0bd3088b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e725adeaa964354a1deed499e319b0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:59Z,use_quota=True,user_id='09dc7200bb394ef7bffaf8ff0caa55a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:16:00 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-e0c4fda7-de51-4586-a84b-56af6ef39b6b tempest-CreateVolumesFromSnapshotTest-1830645918 None] Creating volume 469e45cb-3512-47f9-91bb-d47b0bd3088b {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:16:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e0c4fda7-de51-4586-a84b-56af6ef39b6b tempest-CreateVolumesFromSnapshotTest-1830645918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e0c4fda7-de51-4586-a84b-56af6ef39b6b tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:00 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e0c4fda7-de51-4586-a84b-56af6ef39b6b tempest-CreateVolumesFromSnapshotTest-1830645918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:00 devstack sudo[108005]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:00 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e0c4fda7-de51-4586-a84b-56af6ef39b6b tempest-CreateVolumesFromSnapshotTest-1830645918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e0c4fda7-de51-4586-a84b-56af6ef39b6b tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:00 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e0c4fda7-de51-4586-a84b-56af6ef39b6b tempest-CreateVolumesFromSnapshotTest-1830645918 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:16:00 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-e0c4fda7-de51-4586-a84b-56af6ef39b6b tempest-CreateVolumesFromSnapshotTest-1830645918 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:16:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e0c4fda7-de51-4586-a84b-56af6ef39b6b tempest-CreateVolumesFromSnapshotTest-1830645918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-469e45cb-3512-47f9-91bb-d47b0bd3088b 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fb400120-b947-4918-9844-7643ebfcba4e_93awx53_" returned: 1 in 0.478s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fb400120-b947-4918-9844-7643ebfcba4e_93awx53_' failed. Not Retrying. {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:16:01 devstack sudo[108018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-469e45cb-3512-47f9-91bb-d47b0bd3088b 1073741824 Sep 28 15:16:01 devstack sudo[108018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b58333ba-e3d0-482b-b02d-4f6aea625017 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c06f523-fb61-4833-bcbf-6b59264355e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc2bf233-ae6f-4b60-931b-4b4c176ee327', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b58333ba-e3d0-482b-b02d-4f6aea625017 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5bc0c64-3be8-445f-87e7-6a6fc11d9cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:01 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[304842fd-b2e8-4b48-8887-6b9c1c7863b8]: (4, 'raw') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fb400120-b947-4918-9844-7643ebfcba4e_bq92wlm0devstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:01 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-b58333ba-e3d0-482b-b02d-4f6aea625017 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Volume volume-cc2bf233-ae6f-4b60-931b-4b4c176ee327 (cc2bf233-ae6f-4b60-931b-4b4c176ee327): created successfully Sep 28 15:16:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b58333ba-e3d0-482b-b02d-4f6aea625017 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5bc0c64-3be8-445f-87e7-6a6fc11d9cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b58333ba-e3d0-482b-b02d-4f6aea625017 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Flow 'volume_create_manager' (a11d9bd4-a3a4-49b4-99cf-5da8697b1916) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:01 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-b58333ba-e3d0-482b-b02d-4f6aea625017 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Created volume successfully. Sep 28 15:16:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e34609e7-20b0-4c58-a87d-c6742d47561b tempest-CreateVolumesFromImageTest-1041185936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e34609e7-20b0-4c58-a87d-c6742d47561b tempest-CreateVolumesFromImageTest-1041185936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e34609e7-20b0-4c58-a87d-c6742d47561b tempest-CreateVolumesFromImageTest-1041185936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e34609e7-20b0-4c58-a87d-c6742d47561b tempest-CreateVolumesFromImageTest-1041185936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e34609e7-20b0-4c58-a87d-c6742d47561b tempest-CreateVolumesFromImageTest-1041185936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e34609e7-20b0-4c58-a87d-c6742d47561b tempest-CreateVolumesFromImageTest-1041185936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:01 devstack sudo[108023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:16:01 devstack sudo[108023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:01 devstack sudo[108020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fb400120-b947-4918-9844-7643ebfcba4e_bq92wlm0devstack@QuobyteHD Sep 28 15:16:01 devstack sudo[108020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:01 devstack sudo[108013]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3c4a1657-dd47-4deb-b222-3903acc39431__y91wnlxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-740b3c54-caab-427a-b0ac-996ccdf54104" returned: 0 in 0.647s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:01 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3c4a1657-dd47-4deb-b222-3903acc39431__y91wnlxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-740b3c54-caab-427a-b0ac-996ccdf54104 {{(pid=87116) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:16:01 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 15:16:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-740b3c54-caab-427a-b0ac-996ccdf54104 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:01 devstack sudo[108023]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:01 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-de91cea7-3db1-42fd-82dd-488950f94db6 tempest-CreateVolumesFromImageTest-1041185936 None] Acquiring lock "cinder-de3d3854-d0c6-4429-8b25-9ce8a9b06ca5-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:01 devstack sudo[108018]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e34609e7-20b0-4c58-a87d-c6742d47561b tempest-CreateVolumesFromImageTest-1041185936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.410s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:01 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-e34609e7-20b0-4c58-a87d-c6742d47561b tempest-CreateVolumesFromImageTest-1041185936 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:16:01 devstack sudo[108035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-740b3c54-caab-427a-b0ac-996ccdf54104 1G Sep 28 15:16:01 devstack sudo[108035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:01 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-e34609e7-20b0-4c58-a87d-c6742d47561b tempest-CreateVolumesFromImageTest-1041185936 None] Deleted volume successfully. Sep 28 15:16:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e0c4fda7-de51-4586-a84b-56af6ef39b6b tempest-CreateVolumesFromSnapshotTest-1830645918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-469e45cb-3512-47f9-91bb-d47b0bd3088b 1073741824" returned: 0 in 0.635s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:01 devstack sudo[108020]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:01 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-de91cea7-3db1-42fd-82dd-488950f94db6 tempest-CreateVolumesFromImageTest-1041185936 None] Lock "cinder-de3d3854-d0c6-4429-8b25-9ce8a9b06ca5-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fb400120-b947-4918-9844-7643ebfcba4e_bq92wlm0devstack@QuobyteHD" returned: 0 in 0.684s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb400120-b947-4918-9844-7643ebfcba4e_bq92wlm0devstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:01 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e34609e7-20b0-4c58-a87d-c6742d47561b tempest-CreateVolumesFromImageTest-1041185936 None] Lock "cinder-88e95e93-f64f-4c70-a715-2dbb2b3966df-delete_volume" released by "delete_volume" :: held 2.526s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e0c4fda7-de51-4586-a84b-56af6ef39b6b tempest-CreateVolumesFromSnapshotTest-1830645918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-469e45cb-3512-47f9-91bb-d47b0bd3088b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:01 devstack sudo[108038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-469e45cb-3512-47f9-91bb-d47b0bd3088b Sep 28 15:16:01 devstack sudo[108038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:01 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-de91cea7-3db1-42fd-82dd-488950f94db6 tempest-CreateVolumesFromImageTest-1041185936 None] Acquiring lock "cinder-quobyte-de3d3854-d0c6-4429-8b25-9ce8a9b06ca5" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:01 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-de91cea7-3db1-42fd-82dd-488950f94db6 tempest-CreateVolumesFromImageTest-1041185936 None] Lock "cinder-quobyte-de3d3854-d0c6-4429-8b25-9ce8a9b06ca5" acquired by "delete_volume" :: waited 0.044s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:01 devstack sudo[108037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb400120-b947-4918-9844-7643ebfcba4e_bq92wlm0devstack@QuobyteHD Sep 28 15:16:01 devstack sudo[108037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:01 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d935f3-6d67-42bd-94d5-d562bd046925]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-de91cea7-3db1-42fd-82dd-488950f94db6 tempest-CreateVolumesFromImageTest-1041185936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-de3d3854-d0c6-4429-8b25-9ce8a9b06ca5 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:02 devstack sudo[108042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-de3d3854-d0c6-4429-8b25-9ce8a9b06ca5 Sep 28 15:16:02 devstack sudo[108042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:02 devstack sudo[108035]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-740b3c54-caab-427a-b0ac-996ccdf54104 1G" returned: 0 in 0.549s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:02 devstack cinder-volume[87116]: DEBUG cinder.volume.volume_utils [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] Downloaded image 3c4a1657-dd47-4deb-b222-3903acc39431 ((None, [{'url': 'file:///opt/stack/data/glance/images/3c4a1657-dd47-4deb-b222-3903acc39431', 'metadata': {}}])) to volume 740b3c54-caab-427a-b0ac-996ccdf54104 successfully. {{(pid=87116) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1253}} Sep 28 15:16:02 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] Temporary image 3c4a1657-dd47-4deb-b222-3903acc39431 for user 5764d27370474264a6d25a6bcc63c4e0 is deleted. {{(pid=87116) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 15:16:02 devstack cinder-volume[87116]: DEBUG cinder.volume.volume_utils [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] Marking volume 740b3c54-caab-427a-b0ac-996ccdf54104 as bootable. {{(pid=87116) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1157}} Sep 28 15:16:02 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] Copying metadata from image 3c4a1657-dd47-4deb-b222-3903acc39431 to 740b3c54-caab-427a-b0ac-996ccdf54104. {{(pid=87116) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 15:16:02 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] Creating volume glance metadata for volume 740b3c54-caab-427a-b0ac-996ccdf54104 backed by image 3c4a1657-dd47-4deb-b222-3903acc39431 with: {'image_id': '3c4a1657-dd47-4deb-b222-3903acc39431', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'cde7a772b90c1263ebfd5e58e7d9cb76', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87116) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 15:16:02 devstack sudo[108038]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e0c4fda7-de51-4586-a84b-56af6ef39b6b tempest-CreateVolumesFromSnapshotTest-1830645918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-469e45cb-3512-47f9-91bb-d47b0bd3088b" returned: 0 in 0.408s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e0c4fda7-de51-4586-a84b-56af6ef39b6b tempest-CreateVolumesFromSnapshotTest-1830645918 None] <== create_volume: return (1217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:16:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e0c4fda7-de51-4586-a84b-56af6ef39b6b tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.220s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bdaf73e9-ee2a-459b-8da1-7f5c6aeb6ea3 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.548s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-bdaf73e9-ee2a-459b-8da1-7f5c6aeb6ea3 tempest-CreateVolumesFromSnapshotTest-1830645918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1450359411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72b17e31-a906-47d2-bf18-afefc9d0d325,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e725adeaa964354a1deed499e319b0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:59Z,use_quota=True,user_id='09dc7200bb394ef7bffaf8ff0caa55a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:16:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-bdaf73e9-ee2a-459b-8da1-7f5c6aeb6ea3 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Creating volume 72b17e31-a906-47d2-bf18-afefc9d0d325 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:16:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bdaf73e9-ee2a-459b-8da1-7f5c6aeb6ea3 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bdaf73e9-ee2a-459b-8da1-7f5c6aeb6ea3 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-bdaf73e9-ee2a-459b-8da1-7f5c6aeb6ea3 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-bdaf73e9-ee2a-459b-8da1-7f5c6aeb6ea3 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bdaf73e9-ee2a-459b-8da1-7f5c6aeb6ea3 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-bdaf73e9-ee2a-459b-8da1-7f5c6aeb6ea3 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:16:02 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-bdaf73e9-ee2a-459b-8da1-7f5c6aeb6ea3 tempest-CreateVolumesFromSnapshotTest-1830645918 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:16:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bdaf73e9-ee2a-459b-8da1-7f5c6aeb6ea3 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-72b17e31-a906-47d2-bf18-afefc9d0d325 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1412f0b1-c653-48cf-849b-81cd1eb1945e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-740b3c54-caab-427a-b0ac-996ccdf54104', 'volume_size': 1, 'image_id': '3c4a1657-dd47-4deb-b222-3903acc39431', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3c4a1657-dd47-4deb-b222-3903acc39431', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cde7a772b90c1263ebfd5e58e7d9cb76', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5eee614e11a546ea9dfdf524506c0c16', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8a06d3f778540d245a19d2a8cf254f20d87649d41c20d6f539ba36fb36f3a8c88488012d09fdf9655b7857abc2d064401ba607ca077886d3948ee8a1ea6919b3', 'id': '3c4a1657-dd47-4deb-b222-3903acc39431', 'created_at': datetime.datetime(2026, 9, 28, 13, 15, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 15, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c4a1657-dd47-4deb-b222-3903acc39431/file', 'properties': {}}, 'image_service': }' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:02 devstack sudo[108037]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7534b66-c518-480b-8efc-450ea0d56af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:02 devstack sudo[108051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-72b17e31-a906-47d2-bf18-afefc9d0d325 1073741824 Sep 28 15:16:02 devstack sudo[108051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb400120-b947-4918-9844-7643ebfcba4e_bq92wlm0devstack@QuobyteHD" returned: 1 in 0.532s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb400120-b947-4918-9844-7643ebfcba4e_bq92wlm0devstack@QuobyteHD' failed. Not Retrying. {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:16:02 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] fb400120-b947-4918-9844-7643ebfcba4e was raw, converting to qcow2 {{(pid=87116) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 15:16:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fb400120-b947-4918-9844-7643ebfcba4e_bq92wlm0devstack@QuobyteHD /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a05957ae-b897-41ad-b4a2-774080a65da9 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e0c4fda7-de51-4586-a84b-56af6ef39b6b tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a274b5ff-6517-4c67-9064-ec37aa69faa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-469e45cb-3512-47f9-91bb-d47b0bd3088b', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e0c4fda7-de51-4586-a84b-56af6ef39b6b tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f7695cb-d4a7-4a67-b482-02860f486f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:02 devstack sudo[108053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fb400120-b947-4918-9844-7643ebfcba4e_bq92wlm0devstack@QuobyteHD /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a05957ae-b897-41ad-b4a2-774080a65da9 Sep 28 15:16:02 devstack sudo[108053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:02 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] Volume volume-740b3c54-caab-427a-b0ac-996ccdf54104 (740b3c54-caab-427a-b0ac-996ccdf54104): created successfully Sep 28 15:16:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7534b66-c518-480b-8efc-450ea0d56af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] Flow 'volume_create_manager' (d8ee2634-2bd9-4d41-ad76-7aeb63e4edf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:02 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-e0c4fda7-de51-4586-a84b-56af6ef39b6b tempest-CreateVolumesFromSnapshotTest-1830645918 None] Volume volume-469e45cb-3512-47f9-91bb-d47b0bd3088b (469e45cb-3512-47f9-91bb-d47b0bd3088b): created successfully Sep 28 15:16:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e0c4fda7-de51-4586-a84b-56af6ef39b6b tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f7695cb-d4a7-4a67-b482-02860f486f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e0c4fda7-de51-4586-a84b-56af6ef39b6b tempest-CreateVolumesFromSnapshotTest-1830645918 None] Flow 'volume_create_manager' (9e987b4d-a237-4756-b313-9c02c928e6c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:02 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-4541975f-c968-44b8-a922-004c44b1db3d tempest-VolumeImageDependencyTests-2040664869 None] Created volume successfully. Sep 28 15:16:02 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-e0c4fda7-de51-4586-a84b-56af6ef39b6b tempest-CreateVolumesFromSnapshotTest-1830645918 None] Created volume successfully. Sep 28 15:16:02 devstack sudo[108042]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-de91cea7-3db1-42fd-82dd-488950f94db6 tempest-CreateVolumesFromImageTest-1041185936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-de3d3854-d0c6-4429-8b25-9ce8a9b06ca5" returned: 0 in 0.604s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-de91cea7-3db1-42fd-82dd-488950f94db6 tempest-CreateVolumesFromImageTest-1041185936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-de3d3854-d0c6-4429-8b25-9ce8a9b06ca5 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:02 devstack sudo[108060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-de3d3854-d0c6-4429-8b25-9ce8a9b06ca5 Sep 28 15:16:02 devstack sudo[108060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-32a30e6e-3805-43e6-baea-f8d63af8202a tempest-VolumeImageDependencyTests-2040664869 None] Acquiring lock "cinder-740b3c54-caab-427a-b0ac-996ccdf54104-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-32a30e6e-3805-43e6-baea-f8d63af8202a tempest-VolumeImageDependencyTests-2040664869 None] Lock "cinder-740b3c54-caab-427a-b0ac-996ccdf54104-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-32a30e6e-3805-43e6-baea-f8d63af8202a tempest-VolumeImageDependencyTests-2040664869 None] Acquiring lock "cinder-quobyte-740b3c54-caab-427a-b0ac-996ccdf54104" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-32a30e6e-3805-43e6-baea-f8d63af8202a tempest-VolumeImageDependencyTests-2040664869 None] Lock "cinder-quobyte-740b3c54-caab-427a-b0ac-996ccdf54104" acquired by "delete_volume" :: waited 0.047s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:02 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[49bafa66-31c5-41f0-b081-cefa28f28072]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-32a30e6e-3805-43e6-baea-f8d63af8202a tempest-VolumeImageDependencyTests-2040664869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-740b3c54-caab-427a-b0ac-996ccdf54104 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:03 devstack sudo[108060]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-de91cea7-3db1-42fd-82dd-488950f94db6 tempest-CreateVolumesFromImageTest-1041185936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-de3d3854-d0c6-4429-8b25-9ce8a9b06ca5" returned: 0 in 0.495s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:03 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-de91cea7-3db1-42fd-82dd-488950f94db6 tempest-CreateVolumesFromImageTest-1041185936 None] Lock "cinder-quobyte-de3d3854-d0c6-4429-8b25-9ce8a9b06ca5" released by "delete_volume" :: held 1.168s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:03 devstack sudo[108053]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fb400120-b947-4918-9844-7643ebfcba4e_bq92wlm0devstack@QuobyteHD /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a05957ae-b897-41ad-b4a2-774080a65da9" returned: 0 in 0.823s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:03 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fb400120-b947-4918-9844-7643ebfcba4e_bq92wlm0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a05957ae-b897-41ad-b4a2-774080a65da9 {{(pid=87116) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:16:03 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 15:16:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a05957ae-b897-41ad-b4a2-774080a65da9 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:03 devstack sudo[108051]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bdaf73e9-ee2a-459b-8da1-7f5c6aeb6ea3 tempest-CreateVolumesFromSnapshotTest-1830645918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-72b17e31-a906-47d2-bf18-afefc9d0d325 1073741824" returned: 0 in 0.891s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:03 devstack sudo[108071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a05957ae-b897-41ad-b4a2-774080a65da9 1G Sep 28 15:16:03 devstack sudo[108071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:03 devstack sudo[108070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-740b3c54-caab-427a-b0ac-996ccdf54104 Sep 28 15:16:03 devstack sudo[108070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:03 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-de91cea7-3db1-42fd-82dd-488950f94db6 tempest-CreateVolumesFromImageTest-1041185936 None] Created reservations ['74084eee-363d-4dfe-819e-3e5bd18baf97', '447cc351-d94c-4161-8dc3-56e60844ee54', '55e19e9a-a0d8-4108-b8f4-1b5c730b81e2', '8763a33c-ed91-4b23-9960-534720b59731'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:16:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bdaf73e9-ee2a-459b-8da1-7f5c6aeb6ea3 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-72b17e31-a906-47d2-bf18-afefc9d0d325 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:03 devstack sudo[108074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-72b17e31-a906-47d2-bf18-afefc9d0d325 Sep 28 15:16:03 devstack sudo[108074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-de91cea7-3db1-42fd-82dd-488950f94db6 tempest-CreateVolumesFromImageTest-1041185936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-de91cea7-3db1-42fd-82dd-488950f94db6 tempest-CreateVolumesFromImageTest-1041185936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-de91cea7-3db1-42fd-82dd-488950f94db6 tempest-CreateVolumesFromImageTest-1041185936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-de91cea7-3db1-42fd-82dd-488950f94db6 tempest-CreateVolumesFromImageTest-1041185936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-de91cea7-3db1-42fd-82dd-488950f94db6 tempest-CreateVolumesFromImageTest-1041185936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-de91cea7-3db1-42fd-82dd-488950f94db6 tempest-CreateVolumesFromImageTest-1041185936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:03 devstack sudo[108076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:16:03 devstack sudo[108076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:03 devstack sudo[108070]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-32a30e6e-3805-43e6-baea-f8d63af8202a tempest-VolumeImageDependencyTests-2040664869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-740b3c54-caab-427a-b0ac-996ccdf54104" returned: 0 in 0.525s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-32a30e6e-3805-43e6-baea-f8d63af8202a tempest-VolumeImageDependencyTests-2040664869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-740b3c54-caab-427a-b0ac-996ccdf54104 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:03 devstack sudo[108085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-740b3c54-caab-427a-b0ac-996ccdf54104 Sep 28 15:16:03 devstack sudo[108085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:03 devstack sudo[108071]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a05957ae-b897-41ad-b4a2-774080a65da9 1G" returned: 0 in 0.474s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:03 devstack cinder-volume[87116]: DEBUG cinder.volume.volume_utils [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Downloaded image fb400120-b947-4918-9844-7643ebfcba4e ((None, [{'url': 'file:///opt/stack/data/glance/images/fb400120-b947-4918-9844-7643ebfcba4e', 'metadata': {}}])) to volume a05957ae-b897-41ad-b4a2-774080a65da9 successfully. {{(pid=87116) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1253}} Sep 28 15:16:03 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Temporary image fb400120-b947-4918-9844-7643ebfcba4e for user 89c96debb5264c9ea3d985df3f3762ce is deleted. {{(pid=87116) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 15:16:03 devstack cinder-volume[87116]: DEBUG cinder.volume.volume_utils [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Marking volume a05957ae-b897-41ad-b4a2-774080a65da9 as bootable. {{(pid=87116) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1157}} Sep 28 15:16:03 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Copying metadata from image fb400120-b947-4918-9844-7643ebfcba4e to a05957ae-b897-41ad-b4a2-774080a65da9. {{(pid=87116) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 15:16:03 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Creating volume glance metadata for volume a05957ae-b897-41ad-b4a2-774080a65da9 backed by image fb400120-b947-4918-9844-7643ebfcba4e with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'fb400120-b947-4918-9844-7643ebfcba4e', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'f9359b535997525b955f26c614914dad', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87116) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 15:16:03 devstack sudo[108074]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bdaf73e9-ee2a-459b-8da1-7f5c6aeb6ea3 tempest-CreateVolumesFromSnapshotTest-1830645918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-72b17e31-a906-47d2-bf18-afefc9d0d325" returned: 0 in 0.408s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-bdaf73e9-ee2a-459b-8da1-7f5c6aeb6ea3 tempest-CreateVolumesFromSnapshotTest-1830645918 None] <== create_volume: return (1419ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:16:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bdaf73e9-ee2a-459b-8da1-7f5c6aeb6ea3 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.424s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1603e645-3c19-41ca-b2d0-adb6d67a9246 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.508s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1603e645-3c19-41ca-b2d0-adb6d67a9246 tempest-CreateVolumesFromSnapshotTest-1830645918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1812883984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eefb56ae-5658-4a97-98c2-831ecae6d47e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e725adeaa964354a1deed499e319b0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:00Z,use_quota=True,user_id='09dc7200bb394ef7bffaf8ff0caa55a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:16:03 devstack sudo[108089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eefb56ae-5658-4a97-98c2-831ecae6d47e 1073741824 Sep 28 15:16:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-1603e645-3c19-41ca-b2d0-adb6d67a9246 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Creating volume eefb56ae-5658-4a97-98c2-831ecae6d47e {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:16:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1603e645-3c19-41ca-b2d0-adb6d67a9246 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1603e645-3c19-41ca-b2d0-adb6d67a9246 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1603e645-3c19-41ca-b2d0-adb6d67a9246 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1603e645-3c19-41ca-b2d0-adb6d67a9246 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:03 devstack sudo[108089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1603e645-3c19-41ca-b2d0-adb6d67a9246 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1603e645-3c19-41ca-b2d0-adb6d67a9246 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:16:03 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-1603e645-3c19-41ca-b2d0-adb6d67a9246 tempest-CreateVolumesFromSnapshotTest-1830645918 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:16:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1603e645-3c19-41ca-b2d0-adb6d67a9246 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eefb56ae-5658-4a97-98c2-831ecae6d47e 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bdaf73e9-ee2a-459b-8da1-7f5c6aeb6ea3 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ec430f9-5761-488a-b4cb-110db02c66a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72b17e31-a906-47d2-bf18-afefc9d0d325', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bdaf73e9-ee2a-459b-8da1-7f5c6aeb6ea3 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c85d0d6-7829-4881-ab85-d22cb858b2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:03 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-bdaf73e9-ee2a-459b-8da1-7f5c6aeb6ea3 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Volume volume-72b17e31-a906-47d2-bf18-afefc9d0d325 (72b17e31-a906-47d2-bf18-afefc9d0d325): created successfully Sep 28 15:16:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bdaf73e9-ee2a-459b-8da1-7f5c6aeb6ea3 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c85d0d6-7829-4881-ab85-d22cb858b2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bdaf73e9-ee2a-459b-8da1-7f5c6aeb6ea3 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Flow 'volume_create_manager' (d4ead36c-4e5f-49ea-a2e8-902eb0e0690a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:03 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-bdaf73e9-ee2a-459b-8da1-7f5c6aeb6ea3 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Created volume successfully. Sep 28 15:16:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a43e981c-15c6-4e6a-9453-dba918542031) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a05957ae-b897-41ad-b4a2-774080a65da9', 'volume_size': 1, 'image_id': 'fb400120-b947-4918-9844-7643ebfcba4e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fb400120-b947-4918-9844-7643ebfcba4e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f9359b535997525b955f26c614914dad', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5c80189d12134c1290837a861854ba7d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '191019b21a9d74f863908e230607290145555abb613c29b61248b80bc187d4512472106ab54db891594cfd7da4503f50b11040e0c7ca723f72baf575f51e0db7', 'id': 'fb400120-b947-4918-9844-7643ebfcba4e', 'created_at': datetime.datetime(2026, 9, 28, 13, 15, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 15, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fb400120-b947-4918-9844-7643ebfcba4e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a3834f2-f7f9-4139-85b6-8cb8e3f2c2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:03 devstack sudo[108076]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-de91cea7-3db1-42fd-82dd-488950f94db6 tempest-CreateVolumesFromImageTest-1041185936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.506s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:03 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-de91cea7-3db1-42fd-82dd-488950f94db6 tempest-CreateVolumesFromImageTest-1041185936 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:16:03 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-de91cea7-3db1-42fd-82dd-488950f94db6 tempest-CreateVolumesFromImageTest-1041185936 None] Deleted volume successfully. Sep 28 15:16:03 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Volume volume-a05957ae-b897-41ad-b4a2-774080a65da9 (a05957ae-b897-41ad-b4a2-774080a65da9): created successfully Sep 28 15:16:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a3834f2-f7f9-4139-85b6-8cb8e3f2c2d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Flow 'volume_create_manager' (9cbba9fe-b5d9-4bfa-9a10-6ccf5d1a01ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:03 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-de91cea7-3db1-42fd-82dd-488950f94db6 tempest-CreateVolumesFromImageTest-1041185936 None] Lock "cinder-de3d3854-d0c6-4429-8b25-9ce8a9b06ca5-delete_volume" released by "delete_volume" :: held 2.283s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:03 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-de000706-2365-4064-b676-ccc43a5f109b tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Created volume successfully. Sep 28 15:16:04 devstack sudo[108085]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-32a30e6e-3805-43e6-baea-f8d63af8202a tempest-VolumeImageDependencyTests-2040664869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-740b3c54-caab-427a-b0ac-996ccdf54104" returned: 0 in 0.532s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:04 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-32a30e6e-3805-43e6-baea-f8d63af8202a tempest-VolumeImageDependencyTests-2040664869 None] Lock "cinder-quobyte-740b3c54-caab-427a-b0ac-996ccdf54104" released by "delete_volume" :: held 1.161s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:04 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-32a30e6e-3805-43e6-baea-f8d63af8202a tempest-VolumeImageDependencyTests-2040664869 None] Created reservations ['c4c7d099-7167-4268-983a-7264bd6a56da', 'f0f026fe-8bcf-43db-bdde-f6f671719629', '2fb207bf-08c8-4ade-83a0-dd8c1f36c8bb', '39db4126-5fd4-4432-b4db-4c75b11192ef'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:16:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-32a30e6e-3805-43e6-baea-f8d63af8202a tempest-VolumeImageDependencyTests-2040664869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-32a30e6e-3805-43e6-baea-f8d63af8202a tempest-VolumeImageDependencyTests-2040664869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:04 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-32a30e6e-3805-43e6-baea-f8d63af8202a tempest-VolumeImageDependencyTests-2040664869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:04 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-32a30e6e-3805-43e6-baea-f8d63af8202a tempest-VolumeImageDependencyTests-2040664869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-32a30e6e-3805-43e6-baea-f8d63af8202a tempest-VolumeImageDependencyTests-2040664869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-32a30e6e-3805-43e6-baea-f8d63af8202a tempest-VolumeImageDependencyTests-2040664869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:04 devstack sudo[108098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:16:04 devstack sudo[108098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:04 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-51cc18e5-18fc-4f77-99da-10600f8bb586 tempest-CreateVolumesFromImageTest-1041185936 None] Acquiring lock "cinder-307a6b87-807e-47b1-84a4-f7db4bd79919-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:04 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-51cc18e5-18fc-4f77-99da-10600f8bb586 tempest-CreateVolumesFromImageTest-1041185936 None] Lock "cinder-307a6b87-807e-47b1-84a4-f7db4bd79919-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:04 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-51cc18e5-18fc-4f77-99da-10600f8bb586 tempest-CreateVolumesFromImageTest-1041185936 None] Acquiring lock "cinder-quobyte-307a6b87-807e-47b1-84a4-f7db4bd79919" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:04 devstack sudo[108089]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1603e645-3c19-41ca-b2d0-adb6d67a9246 tempest-CreateVolumesFromSnapshotTest-1830645918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eefb56ae-5658-4a97-98c2-831ecae6d47e 1073741824" returned: 0 in 0.920s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:04 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-51cc18e5-18fc-4f77-99da-10600f8bb586 tempest-CreateVolumesFromImageTest-1041185936 None] Lock "cinder-quobyte-307a6b87-807e-47b1-84a4-f7db4bd79919" acquired by "delete_volume" :: waited 0.029s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:04 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[2620b86f-1271-4e58-a807-08347e6baf1d]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-51cc18e5-18fc-4f77-99da-10600f8bb586 tempest-CreateVolumesFromImageTest-1041185936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-307a6b87-807e-47b1-84a4-f7db4bd79919 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1603e645-3c19-41ca-b2d0-adb6d67a9246 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eefb56ae-5658-4a97-98c2-831ecae6d47e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:04 devstack sudo[108102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eefb56ae-5658-4a97-98c2-831ecae6d47e Sep 28 15:16:04 devstack sudo[108102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:04 devstack sudo[108098]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-32a30e6e-3805-43e6-baea-f8d63af8202a tempest-VolumeImageDependencyTests-2040664869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.369s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:04 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-32a30e6e-3805-43e6-baea-f8d63af8202a tempest-VolumeImageDependencyTests-2040664869 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:16:04 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2378a2c6-90df-4fb1-baeb-bac2ede25b86 tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Acquiring lock "cinder-a05957ae-b897-41ad-b4a2-774080a65da9-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:04 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-32a30e6e-3805-43e6-baea-f8d63af8202a tempest-VolumeImageDependencyTests-2040664869 None] Deleted volume successfully. Sep 28 15:16:04 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2378a2c6-90df-4fb1-baeb-bac2ede25b86 tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Lock "cinder-a05957ae-b897-41ad-b4a2-774080a65da9-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:04 devstack sudo[108100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-307a6b87-807e-47b1-84a4-f7db4bd79919 Sep 28 15:16:04 devstack sudo[108100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:04 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-32a30e6e-3805-43e6-baea-f8d63af8202a tempest-VolumeImageDependencyTests-2040664869 None] Lock "cinder-740b3c54-caab-427a-b0ac-996ccdf54104-delete_volume" released by "delete_volume" :: held 2.035s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:04 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2378a2c6-90df-4fb1-baeb-bac2ede25b86 tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Acquiring lock "cinder-quobyte-a05957ae-b897-41ad-b4a2-774080a65da9" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:04 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2378a2c6-90df-4fb1-baeb-bac2ede25b86 tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Lock "cinder-quobyte-a05957ae-b897-41ad-b4a2-774080a65da9" acquired by "delete_volume" :: waited 0.023s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:04 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac247dc3-7229-46fd-9900-1a5f30c409fe]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2378a2c6-90df-4fb1-baeb-bac2ede25b86 tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a05957ae-b897-41ad-b4a2-774080a65da9 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:05 devstack sudo[108102]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1603e645-3c19-41ca-b2d0-adb6d67a9246 tempest-CreateVolumesFromSnapshotTest-1830645918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eefb56ae-5658-4a97-98c2-831ecae6d47e" returned: 0 in 0.336s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:05 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1603e645-3c19-41ca-b2d0-adb6d67a9246 tempest-CreateVolumesFromSnapshotTest-1830645918 None] <== create_volume: return (1379ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:16:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1603e645-3c19-41ca-b2d0-adb6d67a9246 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.383s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6f51d3c8-31a6-4407-b203-bebbc4ba84d2 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.178s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:05 devstack sudo[108105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a05957ae-b897-41ad-b4a2-774080a65da9 Sep 28 15:16:05 devstack sudo[108105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:05 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-6f51d3c8-31a6-4407-b203-bebbc4ba84d2 tempest-CreateVolumesFromSnapshotTest-1830645918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1909287624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0035fc3e-2f64-4056-881b-d2e3c13c68da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e725adeaa964354a1deed499e319b0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:01Z,use_quota=True,user_id='09dc7200bb394ef7bffaf8ff0caa55a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:16:05 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-6f51d3c8-31a6-4407-b203-bebbc4ba84d2 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Creating volume 0035fc3e-2f64-4056-881b-d2e3c13c68da {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:16:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6f51d3c8-31a6-4407-b203-bebbc4ba84d2 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6f51d3c8-31a6-4407-b203-bebbc4ba84d2 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:05 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-6f51d3c8-31a6-4407-b203-bebbc4ba84d2 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:05 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-6f51d3c8-31a6-4407-b203-bebbc4ba84d2 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6f51d3c8-31a6-4407-b203-bebbc4ba84d2 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:05 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-6f51d3c8-31a6-4407-b203-bebbc4ba84d2 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:16:05 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-6f51d3c8-31a6-4407-b203-bebbc4ba84d2 tempest-CreateVolumesFromSnapshotTest-1830645918 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:16:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6f51d3c8-31a6-4407-b203-bebbc4ba84d2 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0035fc3e-2f64-4056-881b-d2e3c13c68da 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1603e645-3c19-41ca-b2d0-adb6d67a9246 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (987274db-0a2c-44b6-a364-162830700475) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eefb56ae-5658-4a97-98c2-831ecae6d47e', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1603e645-3c19-41ca-b2d0-adb6d67a9246 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (739fadfa-7296-491a-a5b0-cae28cdfaed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:05 devstack sudo[108108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0035fc3e-2f64-4056-881b-d2e3c13c68da 1073741824 Sep 28 15:16:05 devstack sudo[108108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:05 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-1603e645-3c19-41ca-b2d0-adb6d67a9246 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Volume volume-eefb56ae-5658-4a97-98c2-831ecae6d47e (eefb56ae-5658-4a97-98c2-831ecae6d47e): created successfully Sep 28 15:16:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1603e645-3c19-41ca-b2d0-adb6d67a9246 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (739fadfa-7296-491a-a5b0-cae28cdfaed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1603e645-3c19-41ca-b2d0-adb6d67a9246 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Flow 'volume_create_manager' (8074ed9e-d7b2-478c-a1bb-7c9e541a74d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:05 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-1603e645-3c19-41ca-b2d0-adb6d67a9246 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Created volume successfully. Sep 28 15:16:05 devstack sudo[108100]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-51cc18e5-18fc-4f77-99da-10600f8bb586 tempest-CreateVolumesFromImageTest-1041185936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-307a6b87-807e-47b1-84a4-f7db4bd79919" returned: 0 in 0.559s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-51cc18e5-18fc-4f77-99da-10600f8bb586 tempest-CreateVolumesFromImageTest-1041185936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-307a6b87-807e-47b1-84a4-f7db4bd79919 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:05 devstack sudo[108113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-307a6b87-807e-47b1-84a4-f7db4bd79919 Sep 28 15:16:05 devstack sudo[108113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:05 devstack sudo[108105]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2378a2c6-90df-4fb1-baeb-bac2ede25b86 tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a05957ae-b897-41ad-b4a2-774080a65da9" returned: 0 in 0.527s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2378a2c6-90df-4fb1-baeb-bac2ede25b86 tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a05957ae-b897-41ad-b4a2-774080a65da9 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:05 devstack sudo[108122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a05957ae-b897-41ad-b4a2-774080a65da9 Sep 28 15:16:05 devstack sudo[108122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:05 devstack sudo[108113]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-51cc18e5-18fc-4f77-99da-10600f8bb586 tempest-CreateVolumesFromImageTest-1041185936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-307a6b87-807e-47b1-84a4-f7db4bd79919" returned: 0 in 0.510s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:05 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-51cc18e5-18fc-4f77-99da-10600f8bb586 tempest-CreateVolumesFromImageTest-1041185936 None] Lock "cinder-quobyte-307a6b87-807e-47b1-84a4-f7db4bd79919" released by "delete_volume" :: held 1.154s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:05 devstack sudo[108108]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6f51d3c8-31a6-4407-b203-bebbc4ba84d2 tempest-CreateVolumesFromSnapshotTest-1830645918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0035fc3e-2f64-4056-881b-d2e3c13c68da 1073741824" returned: 0 in 0.778s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:05 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-51cc18e5-18fc-4f77-99da-10600f8bb586 tempest-CreateVolumesFromImageTest-1041185936 None] Created reservations ['416ab32f-b8d9-4257-8f1f-2ae55c80eb28', '88a1a968-dd1b-43f9-b9c7-f2d879e6a1b2', '39cc05b5-4d7c-49ce-bb73-b3e4d20c1902', 'd48b17ee-bb7e-4a61-bf72-528f7486ae98'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:16:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6f51d3c8-31a6-4407-b203-bebbc4ba84d2 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0035fc3e-2f64-4056-881b-d2e3c13c68da {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:05 devstack sudo[108122]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2378a2c6-90df-4fb1-baeb-bac2ede25b86 tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a05957ae-b897-41ad-b4a2-774080a65da9" returned: 0 in 0.457s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:05 devstack sudo[108127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0035fc3e-2f64-4056-881b-d2e3c13c68da Sep 28 15:16:05 devstack sudo[108127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:05 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2378a2c6-90df-4fb1-baeb-bac2ede25b86 tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Lock "cinder-quobyte-a05957ae-b897-41ad-b4a2-774080a65da9" released by "delete_volume" :: held 1.051s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-51cc18e5-18fc-4f77-99da-10600f8bb586 tempest-CreateVolumesFromImageTest-1041185936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-51cc18e5-18fc-4f77-99da-10600f8bb586 tempest-CreateVolumesFromImageTest-1041185936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-51cc18e5-18fc-4f77-99da-10600f8bb586 tempest-CreateVolumesFromImageTest-1041185936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-51cc18e5-18fc-4f77-99da-10600f8bb586 tempest-CreateVolumesFromImageTest-1041185936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-51cc18e5-18fc-4f77-99da-10600f8bb586 tempest-CreateVolumesFromImageTest-1041185936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-51cc18e5-18fc-4f77-99da-10600f8bb586 tempest-CreateVolumesFromImageTest-1041185936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:06 devstack sudo[108129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:16:06 devstack sudo[108129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:06 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-2378a2c6-90df-4fb1-baeb-bac2ede25b86 tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Created reservations ['2b82dec2-f052-476d-bc6e-848729526eee', '099c6743-acbe-40db-96d4-3e19e2d06cba', 'e252448e-0df3-432a-ba77-fe750bd4c220', '8b0308fd-f7b2-4074-b0c1-5113294bba2d'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:16:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2378a2c6-90df-4fb1-baeb-bac2ede25b86 tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2378a2c6-90df-4fb1-baeb-bac2ede25b86 tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2378a2c6-90df-4fb1-baeb-bac2ede25b86 tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2378a2c6-90df-4fb1-baeb-bac2ede25b86 tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2378a2c6-90df-4fb1-baeb-bac2ede25b86 tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2378a2c6-90df-4fb1-baeb-bac2ede25b86 tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:06 devstack sudo[108127]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6f51d3c8-31a6-4407-b203-bebbc4ba84d2 tempest-CreateVolumesFromSnapshotTest-1830645918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0035fc3e-2f64-4056-881b-d2e3c13c68da" returned: 0 in 0.363s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-6f51d3c8-31a6-4407-b203-bebbc4ba84d2 tempest-CreateVolumesFromSnapshotTest-1830645918 None] <== create_volume: return (1224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:16:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6f51d3c8-31a6-4407-b203-bebbc4ba84d2 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.229s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:06 devstack sudo[108132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:16:06 devstack sudo[108132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:06 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6f51d3c8-31a6-4407-b203-bebbc4ba84d2 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01724ad5-663d-433f-b675-edbd8452a6ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0035fc3e-2f64-4056-881b-d2e3c13c68da', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:06 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6f51d3c8-31a6-4407-b203-bebbc4ba84d2 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77d38c0e-8b61-4aea-8c9e-ff255f01b33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:06 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-6f51d3c8-31a6-4407-b203-bebbc4ba84d2 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Volume volume-0035fc3e-2f64-4056-881b-d2e3c13c68da (0035fc3e-2f64-4056-881b-d2e3c13c68da): created successfully Sep 28 15:16:06 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6f51d3c8-31a6-4407-b203-bebbc4ba84d2 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77d38c0e-8b61-4aea-8c9e-ff255f01b33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:06 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6f51d3c8-31a6-4407-b203-bebbc4ba84d2 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Flow 'volume_create_manager' (b31ff891-10ed-4a08-8b69-b8341dc41b7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:06 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-6f51d3c8-31a6-4407-b203-bebbc4ba84d2 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Created volume successfully. Sep 28 15:16:06 devstack sudo[108129]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-51cc18e5-18fc-4f77-99da-10600f8bb586 tempest-CreateVolumesFromImageTest-1041185936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.401s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:06 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-51cc18e5-18fc-4f77-99da-10600f8bb586 tempest-CreateVolumesFromImageTest-1041185936 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:16:06 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-51cc18e5-18fc-4f77-99da-10600f8bb586 tempest-CreateVolumesFromImageTest-1041185936 None] Deleted volume successfully. Sep 28 15:16:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-51cc18e5-18fc-4f77-99da-10600f8bb586 tempest-CreateVolumesFromImageTest-1041185936 None] Lock "cinder-307a6b87-807e-47b1-84a4-f7db4bd79919-delete_volume" released by "delete_volume" :: held 1.967s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:06 devstack sudo[108132]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2378a2c6-90df-4fb1-baeb-bac2ede25b86 tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.367s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:06 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-2378a2c6-90df-4fb1-baeb-bac2ede25b86 tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:16:06 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-2378a2c6-90df-4fb1-baeb-bac2ede25b86 tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Deleted volume successfully. Sep 28 15:16:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2378a2c6-90df-4fb1-baeb-bac2ede25b86 tempest-VolumeAndVolumeTypeFromImageTest-770674026 None] Lock "cinder-a05957ae-b897-41ad-b4a2-774080a65da9-delete_volume" released by "delete_volume" :: held 1.861s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-165b96f6-8ed3-49de-8db6-9fb926685e38 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Acquiring lock "cinder-0035fc3e-2f64-4056-881b-d2e3c13c68da-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-165b96f6-8ed3-49de-8db6-9fb926685e38 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "cinder-0035fc3e-2f64-4056-881b-d2e3c13c68da-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-165b96f6-8ed3-49de-8db6-9fb926685e38 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Acquiring lock "cinder-quobyte-0035fc3e-2f64-4056-881b-d2e3c13c68da" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-165b96f6-8ed3-49de-8db6-9fb926685e38 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "cinder-quobyte-0035fc3e-2f64-4056-881b-d2e3c13c68da" acquired by "delete_volume" :: waited 0.021s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:06 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef6abab-6686-4f0c-ba48-b30a62b42221]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-165b96f6-8ed3-49de-8db6-9fb926685e38 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0035fc3e-2f64-4056-881b-d2e3c13c68da {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:07 devstack sudo[108136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0035fc3e-2f64-4056-881b-d2e3c13c68da Sep 28 15:16:07 devstack sudo[108136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:07 devstack sudo[108136]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-165b96f6-8ed3-49de-8db6-9fb926685e38 tempest-CreateVolumesFromSnapshotTest-1830645918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0035fc3e-2f64-4056-881b-d2e3c13c68da" returned: 0 in 0.689s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-165b96f6-8ed3-49de-8db6-9fb926685e38 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0035fc3e-2f64-4056-881b-d2e3c13c68da {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:07 devstack sudo[108142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0035fc3e-2f64-4056-881b-d2e3c13c68da Sep 28 15:16:07 devstack sudo[108142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:08 devstack sudo[108142]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-165b96f6-8ed3-49de-8db6-9fb926685e38 tempest-CreateVolumesFromSnapshotTest-1830645918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-0035fc3e-2f64-4056-881b-d2e3c13c68da" returned: 0 in 0.393s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:08 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-165b96f6-8ed3-49de-8db6-9fb926685e38 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "cinder-quobyte-0035fc3e-2f64-4056-881b-d2e3c13c68da" released by "delete_volume" :: held 1.153s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:08 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-165b96f6-8ed3-49de-8db6-9fb926685e38 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Created reservations ['26cd74ae-97aa-4cf4-8ef5-75d3aaf79646', '3bfc7fd4-8df2-4d74-8fb9-bcc3e5d248c5', 'aafed6a4-23a2-45a3-bbfe-806a9e5ae692', '2f1df37a-aa1f-46df-bdf2-e2cae3e5c6e8'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:16:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-165b96f6-8ed3-49de-8db6-9fb926685e38 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-165b96f6-8ed3-49de-8db6-9fb926685e38 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:08 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-165b96f6-8ed3-49de-8db6-9fb926685e38 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:08 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-165b96f6-8ed3-49de-8db6-9fb926685e38 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-165b96f6-8ed3-49de-8db6-9fb926685e38 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-165b96f6-8ed3-49de-8db6-9fb926685e38 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:08 devstack sudo[108145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:16:08 devstack sudo[108145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:08 devstack sudo[108145]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-165b96f6-8ed3-49de-8db6-9fb926685e38 tempest-CreateVolumesFromSnapshotTest-1830645918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.439s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:08 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-165b96f6-8ed3-49de-8db6-9fb926685e38 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:16:08 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-165b96f6-8ed3-49de-8db6-9fb926685e38 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Deleted volume successfully. Sep 28 15:16:08 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-165b96f6-8ed3-49de-8db6-9fb926685e38 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "cinder-0035fc3e-2f64-4056-881b-d2e3c13c68da-delete_volume" released by "delete_volume" :: held 1.988s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:09 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-90f12516-a101-49a0-9c30-25f3c8686d79 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Acquiring lock "cinder-eefb56ae-5658-4a97-98c2-831ecae6d47e-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:09 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-90f12516-a101-49a0-9c30-25f3c8686d79 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "cinder-eefb56ae-5658-4a97-98c2-831ecae6d47e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:09 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-90f12516-a101-49a0-9c30-25f3c8686d79 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Acquiring lock "cinder-quobyte-eefb56ae-5658-4a97-98c2-831ecae6d47e" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:09 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-90f12516-a101-49a0-9c30-25f3c8686d79 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "cinder-quobyte-eefb56ae-5658-4a97-98c2-831ecae6d47e" acquired by "delete_volume" :: waited 0.024s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:09 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[0233eaa6-fcc8-430c-99c0-6c14d3d5bd37]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-90f12516-a101-49a0-9c30-25f3c8686d79 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eefb56ae-5658-4a97-98c2-831ecae6d47e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:09 devstack sudo[108148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eefb56ae-5658-4a97-98c2-831ecae6d47e Sep 28 15:16:09 devstack sudo[108148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:10 devstack sudo[108148]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-90f12516-a101-49a0-9c30-25f3c8686d79 tempest-CreateVolumesFromSnapshotTest-1830645918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eefb56ae-5658-4a97-98c2-831ecae6d47e" returned: 0 in 0.542s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-90f12516-a101-49a0-9c30-25f3c8686d79 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eefb56ae-5658-4a97-98c2-831ecae6d47e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:10 devstack sudo[108153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eefb56ae-5658-4a97-98c2-831ecae6d47e Sep 28 15:16:10 devstack sudo[108153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:10 devstack sudo[108153]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-90f12516-a101-49a0-9c30-25f3c8686d79 tempest-CreateVolumesFromSnapshotTest-1830645918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-eefb56ae-5658-4a97-98c2-831ecae6d47e" returned: 0 in 0.420s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:10 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-90f12516-a101-49a0-9c30-25f3c8686d79 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "cinder-quobyte-eefb56ae-5658-4a97-98c2-831ecae6d47e" released by "delete_volume" :: held 1.047s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:10 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-90f12516-a101-49a0-9c30-25f3c8686d79 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Created reservations ['bb09997e-7cb0-409d-bfca-eb79d7339f43', 'f06ee0a8-997a-4690-9274-bb7fce5cea86', 'd52a6c4a-024d-45c4-b6a0-73afdd42ffb2', 'c45a9756-5de1-4679-b786-ab819be225ba'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:16:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-90f12516-a101-49a0-9c30-25f3c8686d79 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-90f12516-a101-49a0-9c30-25f3c8686d79 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:10 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-90f12516-a101-49a0-9c30-25f3c8686d79 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:10 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-90f12516-a101-49a0-9c30-25f3c8686d79 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-90f12516-a101-49a0-9c30-25f3c8686d79 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-90f12516-a101-49a0-9c30-25f3c8686d79 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:10 devstack sudo[108156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:16:10 devstack sudo[108156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:11 devstack sudo[108156]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-90f12516-a101-49a0-9c30-25f3c8686d79 tempest-CreateVolumesFromSnapshotTest-1830645918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.346s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:11 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-90f12516-a101-49a0-9c30-25f3c8686d79 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:16:11 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-90f12516-a101-49a0-9c30-25f3c8686d79 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Deleted volume successfully. Sep 28 15:16:11 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-90f12516-a101-49a0-9c30-25f3c8686d79 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "cinder-eefb56ae-5658-4a97-98c2-831ecae6d47e-delete_volume" released by "delete_volume" :: held 1.793s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:11 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-39b7be3e-82a6-4d15-92ac-d3053324b570 tempest-ProjectAdminTests-1298111022 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.2063941955566, 'free_capacity_gb': 1775.2063941955566, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87116) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 15:16:11 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-63e69711-e97e-4d9f-81cb-a2eba6f82818 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Acquiring lock "cinder-72b17e31-a906-47d2-bf18-afefc9d0d325-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:11 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-63e69711-e97e-4d9f-81cb-a2eba6f82818 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "cinder-72b17e31-a906-47d2-bf18-afefc9d0d325-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:11 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-63e69711-e97e-4d9f-81cb-a2eba6f82818 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Acquiring lock "cinder-quobyte-72b17e31-a906-47d2-bf18-afefc9d0d325" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:11 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-63e69711-e97e-4d9f-81cb-a2eba6f82818 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "cinder-quobyte-72b17e31-a906-47d2-bf18-afefc9d0d325" acquired by "delete_volume" :: waited 0.020s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:12 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd2faff-ec0e-4d47-9556-7ba094f00aa4]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-63e69711-e97e-4d9f-81cb-a2eba6f82818 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-72b17e31-a906-47d2-bf18-afefc9d0d325 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:12 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-81158c35-3e12-4681-8d4a-71086055330b tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:16:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-81158c35-3e12-4681-8d4a-71086055330b tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Flow 'volume_create_manager' (c813da6f-f732-4366-9d73-87cc0bc01e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-81158c35-3e12-4681-8d4a-71086055330b tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f9a3a3a-7e3e-4d17-84f0-51a3d81de642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-81158c35-3e12-4681-8d4a-71086055330b tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f9a3a3a-7e3e-4d17-84f0-51a3d81de642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1114038231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=890f16d4-4391-4924-8c1d-82a3041b8700,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8c12fa0df284ba8a31ce3fa43751daa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:12Z,use_quota=True,user_id='baa9eac4a22f46afa81898d7da366a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-81158c35-3e12-4681-8d4a-71086055330b tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa10f366-3346-4f7a-b436-49da03915c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:12 devstack sudo[108160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-72b17e31-a906-47d2-bf18-afefc9d0d325 Sep 28 15:16:12 devstack sudo[108160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-81158c35-3e12-4681-8d4a-71086055330b tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa10f366-3346-4f7a-b436-49da03915c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-81158c35-3e12-4681-8d4a-71086055330b tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7201f659-eeec-4f7b-817c-9a74a7d8af4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-81158c35-3e12-4681-8d4a-71086055330b tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7201f659-eeec-4f7b-817c-9a74a7d8af4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '890f16d4-4391-4924-8c1d-82a3041b8700', 'volume_name': 'volume-890f16d4-4391-4924-8c1d-82a3041b8700', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-81158c35-3e12-4681-8d4a-71086055330b tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3db50bd-9aa2-48a7-bdd8-1848ca76ab32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-81158c35-3e12-4681-8d4a-71086055330b tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3db50bd-9aa2-48a7-bdd8-1848ca76ab32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-81158c35-3e12-4681-8d4a-71086055330b tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04b74def-9dc0-4a74-a0f1-d0e895e53132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:12 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-81158c35-3e12-4681-8d4a-71086055330b tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Volume 890f16d4-4391-4924-8c1d-82a3041b8700: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-890f16d4-4391-4924-8c1d-82a3041b8700', 'volume_size': 1} Sep 28 15:16:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-81158c35-3e12-4681-8d4a-71086055330b tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-81158c35-3e12-4681-8d4a-71086055330b tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:12 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-81158c35-3e12-4681-8d4a-71086055330b tempest-CreateVolumesFromSourceVolumeTest-927595281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1114038231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=890f16d4-4391-4924-8c1d-82a3041b8700,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8c12fa0df284ba8a31ce3fa43751daa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:12Z,use_quota=True,user_id='baa9eac4a22f46afa81898d7da366a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:16:12 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-81158c35-3e12-4681-8d4a-71086055330b tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Creating volume 890f16d4-4391-4924-8c1d-82a3041b8700 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:16:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-81158c35-3e12-4681-8d4a-71086055330b tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-81158c35-3e12-4681-8d4a-71086055330b tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:12 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-81158c35-3e12-4681-8d4a-71086055330b tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:12 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-81158c35-3e12-4681-8d4a-71086055330b tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-81158c35-3e12-4681-8d4a-71086055330b tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:12 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-81158c35-3e12-4681-8d4a-71086055330b tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:16:12 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-81158c35-3e12-4681-8d4a-71086055330b tempest-CreateVolumesFromSourceVolumeTest-927595281 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:16:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-81158c35-3e12-4681-8d4a-71086055330b tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-890f16d4-4391-4924-8c1d-82a3041b8700 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:12 devstack sudo[108162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-890f16d4-4391-4924-8c1d-82a3041b8700 1073741824 Sep 28 15:16:12 devstack sudo[108162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:12 devstack sudo[108160]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-63e69711-e97e-4d9f-81cb-a2eba6f82818 tempest-CreateVolumesFromSnapshotTest-1830645918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-72b17e31-a906-47d2-bf18-afefc9d0d325" returned: 0 in 0.514s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-63e69711-e97e-4d9f-81cb-a2eba6f82818 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-72b17e31-a906-47d2-bf18-afefc9d0d325 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:12 devstack sudo[108170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-72b17e31-a906-47d2-bf18-afefc9d0d325 Sep 28 15:16:12 devstack sudo[108170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:12 devstack sudo[108170]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-63e69711-e97e-4d9f-81cb-a2eba6f82818 tempest-CreateVolumesFromSnapshotTest-1830645918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-72b17e31-a906-47d2-bf18-afefc9d0d325" returned: 0 in 0.332s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:12 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-63e69711-e97e-4d9f-81cb-a2eba6f82818 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "cinder-quobyte-72b17e31-a906-47d2-bf18-afefc9d0d325" released by "delete_volume" :: held 0.938s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:12 devstack sudo[108162]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-81158c35-3e12-4681-8d4a-71086055330b tempest-CreateVolumesFromSourceVolumeTest-927595281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-890f16d4-4391-4924-8c1d-82a3041b8700 1073741824" returned: 0 in 0.681s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-81158c35-3e12-4681-8d4a-71086055330b tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-890f16d4-4391-4924-8c1d-82a3041b8700 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:13 devstack sudo[108175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-890f16d4-4391-4924-8c1d-82a3041b8700 Sep 28 15:16:13 devstack sudo[108175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:13 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-63e69711-e97e-4d9f-81cb-a2eba6f82818 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Created reservations ['5ce8f640-7265-45af-ab5d-bcdf4408c86a', '82fee6af-ac23-4704-9ed2-dcdfb209f8f4', 'ac04795a-cd8f-4b2c-aadf-1ea7a73a625f', '0b63f002-5302-4f90-9d72-742296e23388'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:16:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-63e69711-e97e-4d9f-81cb-a2eba6f82818 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-63e69711-e97e-4d9f-81cb-a2eba6f82818 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:13 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-63e69711-e97e-4d9f-81cb-a2eba6f82818 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:13 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-63e69711-e97e-4d9f-81cb-a2eba6f82818 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-63e69711-e97e-4d9f-81cb-a2eba6f82818 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-63e69711-e97e-4d9f-81cb-a2eba6f82818 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:13 devstack sudo[108177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:16:13 devstack sudo[108177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:13 devstack sudo[108175]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-81158c35-3e12-4681-8d4a-71086055330b tempest-CreateVolumesFromSourceVolumeTest-927595281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-890f16d4-4391-4924-8c1d-82a3041b8700" returned: 0 in 0.379s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:13 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-81158c35-3e12-4681-8d4a-71086055330b tempest-CreateVolumesFromSourceVolumeTest-927595281 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:16:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-81158c35-3e12-4681-8d4a-71086055330b tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:13 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-81158c35-3e12-4681-8d4a-71086055330b tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04b74def-9dc0-4a74-a0f1-d0e895e53132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-890f16d4-4391-4924-8c1d-82a3041b8700', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:13 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-81158c35-3e12-4681-8d4a-71086055330b tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (126140c0-8376-4779-8d6d-f709f8f26747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:13 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-81158c35-3e12-4681-8d4a-71086055330b tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Volume volume-890f16d4-4391-4924-8c1d-82a3041b8700 (890f16d4-4391-4924-8c1d-82a3041b8700): created successfully Sep 28 15:16:13 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-81158c35-3e12-4681-8d4a-71086055330b tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (126140c0-8376-4779-8d6d-f709f8f26747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:13 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-81158c35-3e12-4681-8d4a-71086055330b tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Flow 'volume_create_manager' (c813da6f-f732-4366-9d73-87cc0bc01e97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:13 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-81158c35-3e12-4681-8d4a-71086055330b tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Created volume successfully. Sep 28 15:16:13 devstack sudo[108177]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-63e69711-e97e-4d9f-81cb-a2eba6f82818 tempest-CreateVolumesFromSnapshotTest-1830645918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.327s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:13 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-63e69711-e97e-4d9f-81cb-a2eba6f82818 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:16:13 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-63e69711-e97e-4d9f-81cb-a2eba6f82818 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Deleted volume successfully. Sep 28 15:16:13 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-63e69711-e97e-4d9f-81cb-a2eba6f82818 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "cinder-72b17e31-a906-47d2-bf18-afefc9d0d325-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:14 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-13cfd5b8-5bb1-4bed-96c8-f9a703137761 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Acquiring lock "cinder-469e45cb-3512-47f9-91bb-d47b0bd3088b-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:14 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-13cfd5b8-5bb1-4bed-96c8-f9a703137761 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "cinder-469e45cb-3512-47f9-91bb-d47b0bd3088b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:14 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-13cfd5b8-5bb1-4bed-96c8-f9a703137761 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Acquiring lock "cinder-quobyte-469e45cb-3512-47f9-91bb-d47b0bd3088b" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:14 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-13cfd5b8-5bb1-4bed-96c8-f9a703137761 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "cinder-quobyte-469e45cb-3512-47f9-91bb-d47b0bd3088b" acquired by "delete_volume" :: waited 0.045s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:14 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a966db3-9c35-4d1f-85e7-0cb9edc7c314 tempest-CinderUnicodeTest-538198717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:16:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1a966db3-9c35-4d1f-85e7-0cb9edc7c314 tempest-CinderUnicodeTest-538198717 None] Flow 'volume_create_manager' (473f8739-6e1b-4295-b184-ce265f785255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1a966db3-9c35-4d1f-85e7-0cb9edc7c314 tempest-CinderUnicodeTest-538198717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f07b10ec-3340-4534-a5e1-71da56e0a159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:14 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[2046a52d-05a3-40ce-a9ed-62481ecff886]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-13cfd5b8-5bb1-4bed-96c8-f9a703137761 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-469e45cb-3512-47f9-91bb-d47b0bd3088b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1a966db3-9c35-4d1f-85e7-0cb9edc7c314 tempest-CinderUnicodeTest-538198717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f07b10ec-3340-4534-a5e1-71da56e0a159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4573fff3-9f2a-409a-8a93-9ca20983f8a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='208de92cfead4f27a2fd76aa214d7019',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:14Z,use_quota=True,user_id='9367ab8187134d1ab5faac14667f173e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1a966db3-9c35-4d1f-85e7-0cb9edc7c314 tempest-CinderUnicodeTest-538198717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d7d68e8-958e-4adb-80d3-d9a00acfadcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1a966db3-9c35-4d1f-85e7-0cb9edc7c314 tempest-CinderUnicodeTest-538198717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d7d68e8-958e-4adb-80d3-d9a00acfadcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1a966db3-9c35-4d1f-85e7-0cb9edc7c314 tempest-CinderUnicodeTest-538198717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (003afe03-8f0e-4466-8c21-df3935b5499d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1a966db3-9c35-4d1f-85e7-0cb9edc7c314 tempest-CinderUnicodeTest-538198717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (003afe03-8f0e-4466-8c21-df3935b5499d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4573fff3-9f2a-409a-8a93-9ca20983f8a1', 'volume_name': 'volume-4573fff3-9f2a-409a-8a93-9ca20983f8a1', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1a966db3-9c35-4d1f-85e7-0cb9edc7c314 tempest-CinderUnicodeTest-538198717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dc0c193-8c59-4642-b909-9ed663128ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1a966db3-9c35-4d1f-85e7-0cb9edc7c314 tempest-CinderUnicodeTest-538198717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dc0c193-8c59-4642-b909-9ed663128ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1a966db3-9c35-4d1f-85e7-0cb9edc7c314 tempest-CinderUnicodeTest-538198717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f53a46ca-3a89-4752-9f2f-30f8e9e76b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:14 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-1a966db3-9c35-4d1f-85e7-0cb9edc7c314 tempest-CinderUnicodeTest-538198717 None] Volume 4573fff3-9f2a-409a-8a93-9ca20983f8a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4573fff3-9f2a-409a-8a93-9ca20983f8a1', 'volume_size': 1} Sep 28 15:16:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1a966db3-9c35-4d1f-85e7-0cb9edc7c314 tempest-CinderUnicodeTest-538198717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1a966db3-9c35-4d1f-85e7-0cb9edc7c314 tempest-CinderUnicodeTest-538198717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:14 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1a966db3-9c35-4d1f-85e7-0cb9edc7c314 tempest-CinderUnicodeTest-538198717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4573fff3-9f2a-409a-8a93-9ca20983f8a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='208de92cfead4f27a2fd76aa214d7019',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:14Z,use_quota=True,user_id='9367ab8187134d1ab5faac14667f173e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:16:14 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-1a966db3-9c35-4d1f-85e7-0cb9edc7c314 tempest-CinderUnicodeTest-538198717 None] Creating volume 4573fff3-9f2a-409a-8a93-9ca20983f8a1 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:16:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1a966db3-9c35-4d1f-85e7-0cb9edc7c314 tempest-CinderUnicodeTest-538198717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1a966db3-9c35-4d1f-85e7-0cb9edc7c314 tempest-CinderUnicodeTest-538198717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:14 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1a966db3-9c35-4d1f-85e7-0cb9edc7c314 tempest-CinderUnicodeTest-538198717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:14 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1a966db3-9c35-4d1f-85e7-0cb9edc7c314 tempest-CinderUnicodeTest-538198717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1a966db3-9c35-4d1f-85e7-0cb9edc7c314 tempest-CinderUnicodeTest-538198717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:14 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1a966db3-9c35-4d1f-85e7-0cb9edc7c314 tempest-CinderUnicodeTest-538198717 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:16:14 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-1a966db3-9c35-4d1f-85e7-0cb9edc7c314 tempest-CinderUnicodeTest-538198717 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:16:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1a966db3-9c35-4d1f-85e7-0cb9edc7c314 tempest-CinderUnicodeTest-538198717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4573fff3-9f2a-409a-8a93-9ca20983f8a1 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:14 devstack sudo[108182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4573fff3-9f2a-409a-8a93-9ca20983f8a1 1073741824 Sep 28 15:16:14 devstack sudo[108182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:14 devstack sudo[108181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-469e45cb-3512-47f9-91bb-d47b0bd3088b Sep 28 15:16:14 devstack sudo[108181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:14 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-00892b6e-0925-4055-8b69-6e7b1ffe3349 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:16:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-00892b6e-0925-4055-8b69-6e7b1ffe3349 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Flow 'volume_create_manager' (4adb00a8-fa23-43eb-a6b1-ed6f4ab173e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-00892b6e-0925-4055-8b69-6e7b1ffe3349 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c32b5fae-c44e-4ed2-9cbf-b94a5aaada07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:15 devstack sudo[108181]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-13cfd5b8-5bb1-4bed-96c8-f9a703137761 tempest-CreateVolumesFromSnapshotTest-1830645918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-469e45cb-3512-47f9-91bb-d47b0bd3088b" returned: 0 in 0.654s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-13cfd5b8-5bb1-4bed-96c8-f9a703137761 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-469e45cb-3512-47f9-91bb-d47b0bd3088b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-00892b6e-0925-4055-8b69-6e7b1ffe3349 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c32b5fae-c44e-4ed2-9cbf-b94a5aaada07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-313708902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55b0b44a-d12f-43da-b9cf-62e334ad7381,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8c12fa0df284ba8a31ce3fa43751daa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:15Z,use_quota=True,user_id='baa9eac4a22f46afa81898d7da366a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-00892b6e-0925-4055-8b69-6e7b1ffe3349 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd2fc136-75e3-4ba5-9177-313bdd5c2a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:15 devstack sudo[108191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-469e45cb-3512-47f9-91bb-d47b0bd3088b Sep 28 15:16:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-00892b6e-0925-4055-8b69-6e7b1ffe3349 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd2fc136-75e3-4ba5-9177-313bdd5c2a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:15 devstack sudo[108191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-00892b6e-0925-4055-8b69-6e7b1ffe3349 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5c450ba-2a6e-4e4c-a951-39cfe35d72c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-00892b6e-0925-4055-8b69-6e7b1ffe3349 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5c450ba-2a6e-4e4c-a951-39cfe35d72c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55b0b44a-d12f-43da-b9cf-62e334ad7381', 'volume_name': 'volume-55b0b44a-d12f-43da-b9cf-62e334ad7381', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-00892b6e-0925-4055-8b69-6e7b1ffe3349 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01610e4b-6180-4da4-9faf-01cd88b70085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-00892b6e-0925-4055-8b69-6e7b1ffe3349 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01610e4b-6180-4da4-9faf-01cd88b70085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-00892b6e-0925-4055-8b69-6e7b1ffe3349 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c48251b-4f61-48da-a80b-849980277fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:15 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-00892b6e-0925-4055-8b69-6e7b1ffe3349 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Volume 55b0b44a-d12f-43da-b9cf-62e334ad7381: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55b0b44a-d12f-43da-b9cf-62e334ad7381', 'volume_size': 1} Sep 28 15:16:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-00892b6e-0925-4055-8b69-6e7b1ffe3349 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:15 devstack sudo[108182]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1a966db3-9c35-4d1f-85e7-0cb9edc7c314 tempest-CinderUnicodeTest-538198717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4573fff3-9f2a-409a-8a93-9ca20983f8a1 1073741824" returned: 0 in 0.762s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1a966db3-9c35-4d1f-85e7-0cb9edc7c314 tempest-CinderUnicodeTest-538198717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4573fff3-9f2a-409a-8a93-9ca20983f8a1 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:15 devstack sudo[108194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4573fff3-9f2a-409a-8a93-9ca20983f8a1 Sep 28 15:16:15 devstack sudo[108194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:15 devstack sudo[108191]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-13cfd5b8-5bb1-4bed-96c8-f9a703137761 tempest-CreateVolumesFromSnapshotTest-1830645918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-469e45cb-3512-47f9-91bb-d47b0bd3088b" returned: 0 in 0.480s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-13cfd5b8-5bb1-4bed-96c8-f9a703137761 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "cinder-quobyte-469e45cb-3512-47f9-91bb-d47b0bd3088b" released by "delete_volume" :: held 1.264s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:15 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-511ca029-325b-439b-ba1e-c10dc91c5002 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:16:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-511ca029-325b-439b-ba1e-c10dc91c5002 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Flow 'volume_create_manager' (7abc73cd-6124-4f24-95ff-2cda7258a359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-511ca029-325b-439b-ba1e-c10dc91c5002 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34ddebbb-66b4-4812-9eab-934aed881fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-511ca029-325b-439b-ba1e-c10dc91c5002 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34ddebbb-66b4-4812-9eab-934aed881fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2071419995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcf9ddf2-6464-41d0-9a8d-278138647fb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8c12fa0df284ba8a31ce3fa43751daa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:16Z,use_quota=True,user_id='baa9eac4a22f46afa81898d7da366a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-511ca029-325b-439b-ba1e-c10dc91c5002 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52d73e27-79d9-4463-9dda-275e35834d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-511ca029-325b-439b-ba1e-c10dc91c5002 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52d73e27-79d9-4463-9dda-275e35834d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-511ca029-325b-439b-ba1e-c10dc91c5002 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67cf361b-342a-48a8-b978-3dc531e962a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-511ca029-325b-439b-ba1e-c10dc91c5002 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67cf361b-342a-48a8-b978-3dc531e962a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcf9ddf2-6464-41d0-9a8d-278138647fb7', 'volume_name': 'volume-bcf9ddf2-6464-41d0-9a8d-278138647fb7', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-511ca029-325b-439b-ba1e-c10dc91c5002 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82180d3b-d0bc-4a69-97a6-684055591fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-511ca029-325b-439b-ba1e-c10dc91c5002 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82180d3b-d0bc-4a69-97a6-684055591fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-511ca029-325b-439b-ba1e-c10dc91c5002 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee356cfa-da54-4696-9b68-313a9e4e7d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:15 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-511ca029-325b-439b-ba1e-c10dc91c5002 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Volume bcf9ddf2-6464-41d0-9a8d-278138647fb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcf9ddf2-6464-41d0-9a8d-278138647fb7', 'volume_size': 1} Sep 28 15:16:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-511ca029-325b-439b-ba1e-c10dc91c5002 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:15 devstack sudo[108194]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1a966db3-9c35-4d1f-85e7-0cb9edc7c314 tempest-CinderUnicodeTest-538198717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4573fff3-9f2a-409a-8a93-9ca20983f8a1" returned: 0 in 0.507s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1a966db3-9c35-4d1f-85e7-0cb9edc7c314 tempest-CinderUnicodeTest-538198717 None] <== create_volume: return (1350ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:16:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1a966db3-9c35-4d1f-85e7-0cb9edc7c314 tempest-CinderUnicodeTest-538198717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.357s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-00892b6e-0925-4055-8b69-6e7b1ffe3349 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.719s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-00892b6e-0925-4055-8b69-6e7b1ffe3349 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-313708902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55b0b44a-d12f-43da-b9cf-62e334ad7381,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8c12fa0df284ba8a31ce3fa43751daa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:15Z,use_quota=True,user_id='baa9eac4a22f46afa81898d7da366a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:16:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-00892b6e-0925-4055-8b69-6e7b1ffe3349 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Creating volume 55b0b44a-d12f-43da-b9cf-62e334ad7381 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:16:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-00892b6e-0925-4055-8b69-6e7b1ffe3349 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-00892b6e-0925-4055-8b69-6e7b1ffe3349 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-00892b6e-0925-4055-8b69-6e7b1ffe3349 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-00892b6e-0925-4055-8b69-6e7b1ffe3349 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-00892b6e-0925-4055-8b69-6e7b1ffe3349 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-00892b6e-0925-4055-8b69-6e7b1ffe3349 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:16:15 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-00892b6e-0925-4055-8b69-6e7b1ffe3349 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:16:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-00892b6e-0925-4055-8b69-6e7b1ffe3349 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-55b0b44a-d12f-43da-b9cf-62e334ad7381 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:15 devstack sudo[108198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-55b0b44a-d12f-43da-b9cf-62e334ad7381 1073741824 Sep 28 15:16:15 devstack sudo[108198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:15 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-13cfd5b8-5bb1-4bed-96c8-f9a703137761 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Created reservations ['94f56059-8d63-4225-927c-e0b73eef9ce7', 'c638e416-aed4-446e-9886-5fbc02c02690', 'f1639568-88c2-4512-b4b0-5af1a85a3e27', '46b6e202-45b5-47d5-8717-53ca2fb6cded'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:16:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1a966db3-9c35-4d1f-85e7-0cb9edc7c314 tempest-CinderUnicodeTest-538198717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f53a46ca-3a89-4752-9f2f-30f8e9e76b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4573fff3-9f2a-409a-8a93-9ca20983f8a1', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1a966db3-9c35-4d1f-85e7-0cb9edc7c314 tempest-CinderUnicodeTest-538198717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4280519-9279-4cde-99ab-e1d6e03678a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:16 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-1a966db3-9c35-4d1f-85e7-0cb9edc7c314 tempest-CinderUnicodeTest-538198717 None] Volume volume-4573fff3-9f2a-409a-8a93-9ca20983f8a1 (4573fff3-9f2a-409a-8a93-9ca20983f8a1): created successfully Sep 28 15:16:16 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1a966db3-9c35-4d1f-85e7-0cb9edc7c314 tempest-CinderUnicodeTest-538198717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4280519-9279-4cde-99ab-e1d6e03678a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:16 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1a966db3-9c35-4d1f-85e7-0cb9edc7c314 tempest-CinderUnicodeTest-538198717 None] Flow 'volume_create_manager' (473f8739-6e1b-4295-b184-ce265f785255) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:16 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-1a966db3-9c35-4d1f-85e7-0cb9edc7c314 tempest-CinderUnicodeTest-538198717 None] Created volume successfully. Sep 28 15:16:16 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c3f620e-8d44-45c7-b454-e704f9c9a380 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:16:16 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5c3f620e-8d44-45c7-b454-e704f9c9a380 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Flow 'volume_create_manager' (7f1d5d56-e990-453a-b3c3-1fb48a615fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:16 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5c3f620e-8d44-45c7-b454-e704f9c9a380 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abfd463d-ca40-424d-97ad-95bc99d2edc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-13cfd5b8-5bb1-4bed-96c8-f9a703137761 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-13cfd5b8-5bb1-4bed-96c8-f9a703137761 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:16 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-13cfd5b8-5bb1-4bed-96c8-f9a703137761 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:16 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-13cfd5b8-5bb1-4bed-96c8-f9a703137761 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-13cfd5b8-5bb1-4bed-96c8-f9a703137761 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-13cfd5b8-5bb1-4bed-96c8-f9a703137761 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:16 devstack sudo[108200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:16:16 devstack sudo[108200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:16 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5c3f620e-8d44-45c7-b454-e704f9c9a380 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abfd463d-ca40-424d-97ad-95bc99d2edc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1713038914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a6b7471-8eca-4ecc-b80a-3eee1a06d453,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8c12fa0df284ba8a31ce3fa43751daa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:16Z,use_quota=True,user_id='baa9eac4a22f46afa81898d7da366a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:16 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5c3f620e-8d44-45c7-b454-e704f9c9a380 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ff85415-86d3-4ab1-87c6-0fd7b2ad074c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:16 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5c3f620e-8d44-45c7-b454-e704f9c9a380 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ff85415-86d3-4ab1-87c6-0fd7b2ad074c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:16 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5c3f620e-8d44-45c7-b454-e704f9c9a380 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53116df5-b322-4b95-89cd-1d564a6278e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:16 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5c3f620e-8d44-45c7-b454-e704f9c9a380 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53116df5-b322-4b95-89cd-1d564a6278e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a6b7471-8eca-4ecc-b80a-3eee1a06d453', 'volume_name': 'volume-6a6b7471-8eca-4ecc-b80a-3eee1a06d453', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:16 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5c3f620e-8d44-45c7-b454-e704f9c9a380 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb23ee81-8d7e-44fe-bbbf-8cabfb841185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:16 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5c3f620e-8d44-45c7-b454-e704f9c9a380 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb23ee81-8d7e-44fe-bbbf-8cabfb841185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:16 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5c3f620e-8d44-45c7-b454-e704f9c9a380 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (111adfa8-1fbe-4147-b530-0a7b4a28ffdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:16 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-5c3f620e-8d44-45c7-b454-e704f9c9a380 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Volume 6a6b7471-8eca-4ecc-b80a-3eee1a06d453: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a6b7471-8eca-4ecc-b80a-3eee1a06d453', 'volume_size': 1} Sep 28 15:16:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5c3f620e-8d44-45c7-b454-e704f9c9a380 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:16 devstack sudo[108200]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-13cfd5b8-5bb1-4bed-96c8-f9a703137761 tempest-CreateVolumesFromSnapshotTest-1830645918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.457s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:16 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-13cfd5b8-5bb1-4bed-96c8-f9a703137761 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:16:16 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-13cfd5b8-5bb1-4bed-96c8-f9a703137761 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Deleted volume successfully. Sep 28 15:16:16 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-13cfd5b8-5bb1-4bed-96c8-f9a703137761 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "cinder-469e45cb-3512-47f9-91bb-d47b0bd3088b-delete_volume" released by "delete_volume" :: held 2.521s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:16 devstack sudo[108198]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-00892b6e-0925-4055-8b69-6e7b1ffe3349 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-55b0b44a-d12f-43da-b9cf-62e334ad7381 1073741824" returned: 0 in 0.919s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-00892b6e-0925-4055-8b69-6e7b1ffe3349 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-55b0b44a-d12f-43da-b9cf-62e334ad7381 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:16 devstack sudo[108207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-55b0b44a-d12f-43da-b9cf-62e334ad7381 Sep 28 15:16:16 devstack sudo[108207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:16 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbc614d4-166c-41af-a358-bc19896fa854 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:16:16 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bbc614d4-166c-41af-a358-bc19896fa854 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Flow 'volume_create_manager' (d4799ad4-2a12-4b61-a997-034dc2996d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bbc614d4-166c-41af-a358-bc19896fa854 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3379be17-adc9-472c-b6bd-e64955299577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bbc614d4-166c-41af-a358-bc19896fa854 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3379be17-adc9-472c-b6bd-e64955299577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1692435514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2064982-4ede-40ad-ac9d-5d6abeeb16ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8c12fa0df284ba8a31ce3fa43751daa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:17Z,use_quota=True,user_id='baa9eac4a22f46afa81898d7da366a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bbc614d4-166c-41af-a358-bc19896fa854 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (987d94d3-0fa0-4d49-8aa2-832442ee0b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bbc614d4-166c-41af-a358-bc19896fa854 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (987d94d3-0fa0-4d49-8aa2-832442ee0b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bbc614d4-166c-41af-a358-bc19896fa854 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fafdb7e-9ab9-4f32-8ee0-352c6e1e0608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bbc614d4-166c-41af-a358-bc19896fa854 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fafdb7e-9ab9-4f32-8ee0-352c6e1e0608) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2064982-4ede-40ad-ac9d-5d6abeeb16ee', 'volume_name': 'volume-e2064982-4ede-40ad-ac9d-5d6abeeb16ee', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bbc614d4-166c-41af-a358-bc19896fa854 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bbd0ce6-700e-42c8-8fe4-ca834c5490e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bbc614d4-166c-41af-a358-bc19896fa854 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bbd0ce6-700e-42c8-8fe4-ca834c5490e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bbc614d4-166c-41af-a358-bc19896fa854 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f62b997c-a1bf-4b68-a169-03873bf90f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:17 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-bbc614d4-166c-41af-a358-bc19896fa854 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Volume e2064982-4ede-40ad-ac9d-5d6abeeb16ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2064982-4ede-40ad-ac9d-5d6abeeb16ee', 'volume_size': 1} Sep 28 15:16:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bbc614d4-166c-41af-a358-bc19896fa854 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:17 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:16:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:17 devstack sudo[108209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:16:17 devstack sudo[108209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:17 devstack sudo[108207]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-00892b6e-0925-4055-8b69-6e7b1ffe3349 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-55b0b44a-d12f-43da-b9cf-62e334ad7381" returned: 0 in 0.356s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-00892b6e-0925-4055-8b69-6e7b1ffe3349 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] <== create_volume: return (1360ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:16:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-00892b6e-0925-4055-8b69-6e7b1ffe3349 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.363s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-511ca029-325b-439b-ba1e-c10dc91c5002 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.390s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-511ca029-325b-439b-ba1e-c10dc91c5002 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2071419995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcf9ddf2-6464-41d0-9a8d-278138647fb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8c12fa0df284ba8a31ce3fa43751daa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:16Z,use_quota=True,user_id='baa9eac4a22f46afa81898d7da366a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:16:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-511ca029-325b-439b-ba1e-c10dc91c5002 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Creating volume bcf9ddf2-6464-41d0-9a8d-278138647fb7 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:16:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-511ca029-325b-439b-ba1e-c10dc91c5002 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-511ca029-325b-439b-ba1e-c10dc91c5002 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-511ca029-325b-439b-ba1e-c10dc91c5002 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-511ca029-325b-439b-ba1e-c10dc91c5002 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-511ca029-325b-439b-ba1e-c10dc91c5002 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-511ca029-325b-439b-ba1e-c10dc91c5002 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:16:17 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-511ca029-325b-439b-ba1e-c10dc91c5002 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:16:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-511ca029-325b-439b-ba1e-c10dc91c5002 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bcf9ddf2-6464-41d0-9a8d-278138647fb7 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-00892b6e-0925-4055-8b69-6e7b1ffe3349 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c48251b-4f61-48da-a80b-849980277fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55b0b44a-d12f-43da-b9cf-62e334ad7381', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-00892b6e-0925-4055-8b69-6e7b1ffe3349 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60ed9ce3-7fb9-40dd-9871-fd89af98a404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:17 devstack sudo[108212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bcf9ddf2-6464-41d0-9a8d-278138647fb7 1073741824 Sep 28 15:16:17 devstack sudo[108212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:17 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-00892b6e-0925-4055-8b69-6e7b1ffe3349 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Volume volume-55b0b44a-d12f-43da-b9cf-62e334ad7381 (55b0b44a-d12f-43da-b9cf-62e334ad7381): created successfully Sep 28 15:16:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-00892b6e-0925-4055-8b69-6e7b1ffe3349 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60ed9ce3-7fb9-40dd-9871-fd89af98a404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-00892b6e-0925-4055-8b69-6e7b1ffe3349 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Flow 'volume_create_manager' (4adb00a8-fa23-43eb-a6b1-ed6f4ab173e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:17 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-00892b6e-0925-4055-8b69-6e7b1ffe3349 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Created volume successfully. Sep 28 15:16:17 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-57777fc0-4866-4791-b5e2-dac12eeafbd9 tempest-CinderUnicodeTest-538198717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:16:17 devstack sudo[108209]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-57777fc0-4866-4791-b5e2-dac12eeafbd9 tempest-CinderUnicodeTest-538198717 None] Flow 'volume_create_manager' (22232a88-10b1-4c1b-bbce-8e4a4beae08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-57777fc0-4866-4791-b5e2-dac12eeafbd9 tempest-CinderUnicodeTest-538198717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5e17e35-43f4-4c1e-9017-36069de1f379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.439s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:17 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:16:17 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running periodic task VolumeManager._thread_info {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:16:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] thread count: 28 {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:16:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] thread info: [<_MainThread(MainThread, started 135146735652992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:16:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-57777fc0-4866-4791-b5e2-dac12eeafbd9 tempest-CinderUnicodeTest-538198717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5e17e35-43f4-4c1e-9017-36069de1f379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:17Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1084779651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23c790b4-8fa4-42af-99af-b1804c91d96e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='208de92cfead4f27a2fd76aa214d7019',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:17Z,use_quota=True,user_id='9367ab8187134d1ab5faac14667f173e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-57777fc0-4866-4791-b5e2-dac12eeafbd9 tempest-CinderUnicodeTest-538198717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2037b4d-4b1c-4ce6-929f-f84f37200f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-57777fc0-4866-4791-b5e2-dac12eeafbd9 tempest-CinderUnicodeTest-538198717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2037b4d-4b1c-4ce6-929f-f84f37200f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-57777fc0-4866-4791-b5e2-dac12eeafbd9 tempest-CinderUnicodeTest-538198717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1636bbd-e4de-48c1-a03f-dc90e884145b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-57777fc0-4866-4791-b5e2-dac12eeafbd9 tempest-CinderUnicodeTest-538198717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1636bbd-e4de-48c1-a03f-dc90e884145b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23c790b4-8fa4-42af-99af-b1804c91d96e', 'volume_name': 'volume-23c790b4-8fa4-42af-99af-b1804c91d96e', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-57777fc0-4866-4791-b5e2-dac12eeafbd9 tempest-CinderUnicodeTest-538198717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc3808f8-a295-40a9-9fa4-dada1dbc670f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-57777fc0-4866-4791-b5e2-dac12eeafbd9 tempest-CinderUnicodeTest-538198717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc3808f8-a295-40a9-9fa4-dada1dbc670f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-57777fc0-4866-4791-b5e2-dac12eeafbd9 tempest-CinderUnicodeTest-538198717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae1d2459-8338-4aaf-b613-2c04a07cabd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:17 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-57777fc0-4866-4791-b5e2-dac12eeafbd9 tempest-CinderUnicodeTest-538198717 None] Volume 23c790b4-8fa4-42af-99af-b1804c91d96e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23c790b4-8fa4-42af-99af-b1804c91d96e', 'volume_size': 1} Sep 28 15:16:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-57777fc0-4866-4791-b5e2-dac12eeafbd9 tempest-CinderUnicodeTest-538198717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:17 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fe78d7ac-e8fd-4d46-83db-fd7ade1df3ef tempest-CreateVolumesFromSnapshotTest-1830645918 None] Acquiring lock "cinder-cc2bf233-ae6f-4b60-931b-4b4c176ee327-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:17 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fe78d7ac-e8fd-4d46-83db-fd7ade1df3ef tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "cinder-cc2bf233-ae6f-4b60-931b-4b4c176ee327-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:18 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fe78d7ac-e8fd-4d46-83db-fd7ade1df3ef tempest-CreateVolumesFromSnapshotTest-1830645918 None] Acquiring lock "cinder-quobyte-cc2bf233-ae6f-4b60-931b-4b4c176ee327" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:18 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fe78d7ac-e8fd-4d46-83db-fd7ade1df3ef tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "cinder-quobyte-cc2bf233-ae6f-4b60-931b-4b4c176ee327" acquired by "delete_volume" :: waited 0.040s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:18 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[b131de9b-c3f8-49bc-83d3-e941398a22ef]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fe78d7ac-e8fd-4d46-83db-fd7ade1df3ef tempest-CreateVolumesFromSnapshotTest-1830645918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cc2bf233-ae6f-4b60-931b-4b4c176ee327 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:18 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-497eaa83-0340-483f-a321-02a0ff90e0b4 tempest-ProjectReaderTests-201161066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:16:18 devstack sudo[108212]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-497eaa83-0340-483f-a321-02a0ff90e0b4 tempest-ProjectReaderTests-201161066 None] Flow 'volume_create_manager' (9c482b1f-fabb-4fe2-ba90-a49be55af63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-497eaa83-0340-483f-a321-02a0ff90e0b4 tempest-ProjectReaderTests-201161066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef33d06c-ec58-4947-93cc-703adbf5bea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-511ca029-325b-439b-ba1e-c10dc91c5002 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bcf9ddf2-6464-41d0-9a8d-278138647fb7 1073741824" returned: 0 in 0.922s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-497eaa83-0340-483f-a321-02a0ff90e0b4 tempest-ProjectReaderTests-201161066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef33d06c-ec58-4947-93cc-703adbf5bea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1488289913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7b05c02-690f-49a2-b964-db39b2f9254d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='beacc83e875a45c5be6aab3dbf6c7a8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:18Z,use_quota=True,user_id='5e9fb6bfdda34a3e8b1648df2d0f74d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-497eaa83-0340-483f-a321-02a0ff90e0b4 tempest-ProjectReaderTests-201161066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1794b9e5-327b-41b3-972b-ec966bafa2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-497eaa83-0340-483f-a321-02a0ff90e0b4 tempest-ProjectReaderTests-201161066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1794b9e5-327b-41b3-972b-ec966bafa2ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-497eaa83-0340-483f-a321-02a0ff90e0b4 tempest-ProjectReaderTests-201161066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d417e669-008a-49ac-a984-4a75cd613036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-497eaa83-0340-483f-a321-02a0ff90e0b4 tempest-ProjectReaderTests-201161066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d417e669-008a-49ac-a984-4a75cd613036) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7b05c02-690f-49a2-b964-db39b2f9254d', 'volume_name': 'volume-f7b05c02-690f-49a2-b964-db39b2f9254d', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-497eaa83-0340-483f-a321-02a0ff90e0b4 tempest-ProjectReaderTests-201161066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e35a8d4-973d-49ad-acc6-91a200df63ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-497eaa83-0340-483f-a321-02a0ff90e0b4 tempest-ProjectReaderTests-201161066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e35a8d4-973d-49ad-acc6-91a200df63ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-497eaa83-0340-483f-a321-02a0ff90e0b4 tempest-ProjectReaderTests-201161066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cabf68e9-8bce-4bed-96ca-7bf83423f899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:18 devstack sudo[108219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cc2bf233-ae6f-4b60-931b-4b4c176ee327 Sep 28 15:16:18 devstack sudo[108219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:18 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-497eaa83-0340-483f-a321-02a0ff90e0b4 tempest-ProjectReaderTests-201161066 None] Volume f7b05c02-690f-49a2-b964-db39b2f9254d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7b05c02-690f-49a2-b964-db39b2f9254d', 'volume_size': 1} Sep 28 15:16:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-497eaa83-0340-483f-a321-02a0ff90e0b4 tempest-ProjectReaderTests-201161066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-511ca029-325b-439b-ba1e-c10dc91c5002 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bcf9ddf2-6464-41d0-9a8d-278138647fb7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:18 devstack sudo[108221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bcf9ddf2-6464-41d0-9a8d-278138647fb7 Sep 28 15:16:18 devstack sudo[108221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:18 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-15361b81-7d03-4b9e-8df3-4ada3f652a04 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:16:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-15361b81-7d03-4b9e-8df3-4ada3f652a04 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Flow 'volume_create_manager' (b3b5afcb-aff7-476c-b618-eab1baff8628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-15361b81-7d03-4b9e-8df3-4ada3f652a04 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7324df3e-8b3e-4eb9-920b-d9f834a0a7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-15361b81-7d03-4b9e-8df3-4ada3f652a04 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7324df3e-8b3e-4eb9-920b-d9f834a0a7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-554377128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9162c5f7-f87e-4c7a-be25-750d01547a3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8c12fa0df284ba8a31ce3fa43751daa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:18Z,use_quota=True,user_id='baa9eac4a22f46afa81898d7da366a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-15361b81-7d03-4b9e-8df3-4ada3f652a04 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dd18ce4-60a2-4c3c-aa3b-4de2c8ecc419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-15361b81-7d03-4b9e-8df3-4ada3f652a04 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dd18ce4-60a2-4c3c-aa3b-4de2c8ecc419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-15361b81-7d03-4b9e-8df3-4ada3f652a04 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c646d85-6449-4189-a593-77ec8ca70507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-15361b81-7d03-4b9e-8df3-4ada3f652a04 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c646d85-6449-4189-a593-77ec8ca70507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9162c5f7-f87e-4c7a-be25-750d01547a3d', 'volume_name': 'volume-9162c5f7-f87e-4c7a-be25-750d01547a3d', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-15361b81-7d03-4b9e-8df3-4ada3f652a04 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e19a7b0f-1f5b-442c-9522-3f0684659e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-15361b81-7d03-4b9e-8df3-4ada3f652a04 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e19a7b0f-1f5b-442c-9522-3f0684659e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-15361b81-7d03-4b9e-8df3-4ada3f652a04 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (118791a1-de85-4dc0-be6e-6c7d8c1c2825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:18 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-15361b81-7d03-4b9e-8df3-4ada3f652a04 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Volume 9162c5f7-f87e-4c7a-be25-750d01547a3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9162c5f7-f87e-4c7a-be25-750d01547a3d', 'volume_size': 1} Sep 28 15:16:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-15361b81-7d03-4b9e-8df3-4ada3f652a04 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:18 devstack sudo[108219]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fe78d7ac-e8fd-4d46-83db-fd7ade1df3ef tempest-CreateVolumesFromSnapshotTest-1830645918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cc2bf233-ae6f-4b60-931b-4b4c176ee327" returned: 0 in 0.476s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fe78d7ac-e8fd-4d46-83db-fd7ade1df3ef tempest-CreateVolumesFromSnapshotTest-1830645918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cc2bf233-ae6f-4b60-931b-4b4c176ee327 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:18 devstack sudo[108221]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-511ca029-325b-439b-ba1e-c10dc91c5002 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bcf9ddf2-6464-41d0-9a8d-278138647fb7" returned: 0 in 0.293s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-511ca029-325b-439b-ba1e-c10dc91c5002 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] <== create_volume: return (1349ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:16:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-511ca029-325b-439b-ba1e-c10dc91c5002 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.353s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5c3f620e-8d44-45c7-b454-e704f9c9a380 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.201s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5c3f620e-8d44-45c7-b454-e704f9c9a380 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1713038914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a6b7471-8eca-4ecc-b80a-3eee1a06d453,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8c12fa0df284ba8a31ce3fa43751daa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:16Z,use_quota=True,user_id='baa9eac4a22f46afa81898d7da366a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:16:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-5c3f620e-8d44-45c7-b454-e704f9c9a380 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Creating volume 6a6b7471-8eca-4ecc-b80a-3eee1a06d453 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:16:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5c3f620e-8d44-45c7-b454-e704f9c9a380 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5c3f620e-8d44-45c7-b454-e704f9c9a380 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5c3f620e-8d44-45c7-b454-e704f9c9a380 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:18 devstack sudo[108227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cc2bf233-ae6f-4b60-931b-4b4c176ee327 Sep 28 15:16:18 devstack sudo[108227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5c3f620e-8d44-45c7-b454-e704f9c9a380 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5c3f620e-8d44-45c7-b454-e704f9c9a380 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5c3f620e-8d44-45c7-b454-e704f9c9a380 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:16:18 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-5c3f620e-8d44-45c7-b454-e704f9c9a380 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:16:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5c3f620e-8d44-45c7-b454-e704f9c9a380 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6a6b7471-8eca-4ecc-b80a-3eee1a06d453 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:18 devstack sudo[108229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6a6b7471-8eca-4ecc-b80a-3eee1a06d453 1073741824 Sep 28 15:16:18 devstack sudo[108229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-511ca029-325b-439b-ba1e-c10dc91c5002 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee356cfa-da54-4696-9b68-313a9e4e7d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcf9ddf2-6464-41d0-9a8d-278138647fb7', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-511ca029-325b-439b-ba1e-c10dc91c5002 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb96c1aa-7c5e-4d94-b96f-dc93ba5f39e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:18 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-511ca029-325b-439b-ba1e-c10dc91c5002 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Volume volume-bcf9ddf2-6464-41d0-9a8d-278138647fb7 (bcf9ddf2-6464-41d0-9a8d-278138647fb7): created successfully Sep 28 15:16:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-511ca029-325b-439b-ba1e-c10dc91c5002 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb96c1aa-7c5e-4d94-b96f-dc93ba5f39e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-511ca029-325b-439b-ba1e-c10dc91c5002 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Flow 'volume_create_manager' (7abc73cd-6124-4f24-95ff-2cda7258a359) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:18 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-511ca029-325b-439b-ba1e-c10dc91c5002 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Created volume successfully. Sep 28 15:16:18 devstack sudo[108227]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fe78d7ac-e8fd-4d46-83db-fd7ade1df3ef tempest-CreateVolumesFromSnapshotTest-1830645918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cc2bf233-ae6f-4b60-931b-4b4c176ee327" returned: 0 in 0.301s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:18 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fe78d7ac-e8fd-4d46-83db-fd7ade1df3ef tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "cinder-quobyte-cc2bf233-ae6f-4b60-931b-4b4c176ee327" released by "delete_volume" :: held 0.853s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:18 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-fe78d7ac-e8fd-4d46-83db-fd7ade1df3ef tempest-CreateVolumesFromSnapshotTest-1830645918 None] Created reservations ['f1e43629-234b-4157-9e67-e3f0f5b6ebdd', 'a4906acf-0c7c-4ad0-aefe-ba45acaf8a3e', '75c369d4-1cf6-4069-ab00-6792dc8f4c13', 'd7024c0c-ef17-4522-94b2-3ab11b2b6500'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:16:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-fe78d7ac-e8fd-4d46-83db-fd7ade1df3ef tempest-CreateVolumesFromSnapshotTest-1830645918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-fe78d7ac-e8fd-4d46-83db-fd7ade1df3ef tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-fe78d7ac-e8fd-4d46-83db-fd7ade1df3ef tempest-CreateVolumesFromSnapshotTest-1830645918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-fe78d7ac-e8fd-4d46-83db-fd7ade1df3ef tempest-CreateVolumesFromSnapshotTest-1830645918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-fe78d7ac-e8fd-4d46-83db-fd7ade1df3ef tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fe78d7ac-e8fd-4d46-83db-fd7ade1df3ef tempest-CreateVolumesFromSnapshotTest-1830645918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:19 devstack sudo[108236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:16:19 devstack sudo[108236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:19 devstack sudo[108229]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:19 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d1ab735f-90f3-439b-8f52-b62c707e8335 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Acquiring lock "cinder-a41182d8-6098-4330-8c51-016dca113e90-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5c3f620e-8d44-45c7-b454-e704f9c9a380 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6a6b7471-8eca-4ecc-b80a-3eee1a06d453 1073741824" returned: 0 in 0.638s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:19 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d1ab735f-90f3-439b-8f52-b62c707e8335 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "cinder-a41182d8-6098-4330-8c51-016dca113e90-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:19 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d1ab735f-90f3-439b-8f52-b62c707e8335 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Acquiring lock "cinder-quobyte-e7691df8-36ca-431a-bfc9-dbd2f7a572f9" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:19 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d1ab735f-90f3-439b-8f52-b62c707e8335 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "cinder-quobyte-e7691df8-36ca-431a-bfc9-dbd2f7a572f9" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:19 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d1ab735f-90f3-439b-8f52-b62c707e8335 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Acquiring lock "cinder-quobyte-a41182d8-6098-4330-8c51-016dca113e90" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5c3f620e-8d44-45c7-b454-e704f9c9a380 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6a6b7471-8eca-4ecc-b80a-3eee1a06d453 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:19 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d1ab735f-90f3-439b-8f52-b62c707e8335 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "cinder-quobyte-a41182d8-6098-4330-8c51-016dca113e90" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-d1ab735f-90f3-439b-8f52-b62c707e8335 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Deleting offline snapshot a41182d8-6098-4330-8c51-016dca113e90 of volume e7691df8-36ca-431a-bfc9-dbd2f7a572f9 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:16:19 devstack sudo[108239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6a6b7471-8eca-4ecc-b80a-3eee1a06d453 Sep 28 15:16:19 devstack sudo[108239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:19 devstack sudo[108236]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-d1ab735f-90f3-439b-8f52-b62c707e8335 tempest-CreateVolumesFromSnapshotTest-1830645918 None] snapshot_file for this snap is: volume-e7691df8-36ca-431a-bfc9-dbd2f7a572f9.a41182d8-6098-4330-8c51-016dca113e90 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:16:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fe78d7ac-e8fd-4d46-83db-fd7ade1df3ef tempest-CreateVolumesFromSnapshotTest-1830645918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.333s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:19 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-fe78d7ac-e8fd-4d46-83db-fd7ade1df3ef tempest-CreateVolumesFromSnapshotTest-1830645918 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:16:19 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-fe78d7ac-e8fd-4d46-83db-fd7ade1df3ef tempest-CreateVolumesFromSnapshotTest-1830645918 None] Deleted volume successfully. Sep 28 15:16:19 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[7579af3a-6c0c-446c-b122-f4363f04ab40]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d1ab735f-90f3-439b-8f52-b62c707e8335 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e7691df8-36ca-431a-bfc9-dbd2f7a572f9.a41182d8-6098-4330-8c51-016dca113e90 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:19 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fe78d7ac-e8fd-4d46-83db-fd7ade1df3ef tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "cinder-cc2bf233-ae6f-4b60-931b-4b4c176ee327-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:19 devstack sudo[108241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e7691df8-36ca-431a-bfc9-dbd2f7a572f9.a41182d8-6098-4330-8c51-016dca113e90 Sep 28 15:16:19 devstack sudo[108241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:19 devstack sudo[108239]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5c3f620e-8d44-45c7-b454-e704f9c9a380 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6a6b7471-8eca-4ecc-b80a-3eee1a06d453" returned: 0 in 0.296s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5c3f620e-8d44-45c7-b454-e704f9c9a380 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:16:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5c3f620e-8d44-45c7-b454-e704f9c9a380 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bbc614d4-166c-41af-a358-bc19896fa854 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.574s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-bbc614d4-166c-41af-a358-bc19896fa854 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1692435514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2064982-4ede-40ad-ac9d-5d6abeeb16ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8c12fa0df284ba8a31ce3fa43751daa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:17Z,use_quota=True,user_id='baa9eac4a22f46afa81898d7da366a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:16:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-bbc614d4-166c-41af-a358-bc19896fa854 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Creating volume e2064982-4ede-40ad-ac9d-5d6abeeb16ee {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:16:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bbc614d4-166c-41af-a358-bc19896fa854 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bbc614d4-166c-41af-a358-bc19896fa854 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-bbc614d4-166c-41af-a358-bc19896fa854 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-bbc614d4-166c-41af-a358-bc19896fa854 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bbc614d4-166c-41af-a358-bc19896fa854 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-bbc614d4-166c-41af-a358-bc19896fa854 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:16:19 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-bbc614d4-166c-41af-a358-bc19896fa854 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:16:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bbc614d4-166c-41af-a358-bc19896fa854 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e2064982-4ede-40ad-ac9d-5d6abeeb16ee 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5c3f620e-8d44-45c7-b454-e704f9c9a380 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (111adfa8-1fbe-4147-b530-0a7b4a28ffdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a6b7471-8eca-4ecc-b80a-3eee1a06d453', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5c3f620e-8d44-45c7-b454-e704f9c9a380 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e18e8903-59b1-4d25-9ce7-8c2c6ee63672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:19 devstack sudo[108244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e2064982-4ede-40ad-ac9d-5d6abeeb16ee 1073741824 Sep 28 15:16:19 devstack sudo[108244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:19 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-5c3f620e-8d44-45c7-b454-e704f9c9a380 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Volume volume-6a6b7471-8eca-4ecc-b80a-3eee1a06d453 (6a6b7471-8eca-4ecc-b80a-3eee1a06d453): created successfully Sep 28 15:16:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5c3f620e-8d44-45c7-b454-e704f9c9a380 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e18e8903-59b1-4d25-9ce7-8c2c6ee63672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5c3f620e-8d44-45c7-b454-e704f9c9a380 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Flow 'volume_create_manager' (7f1d5d56-e990-453a-b3c3-1fb48a615fd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:19 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-5c3f620e-8d44-45c7-b454-e704f9c9a380 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Created volume successfully. Sep 28 15:16:19 devstack sudo[108241]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d1ab735f-90f3-439b-8f52-b62c707e8335 tempest-CreateVolumesFromSnapshotTest-1830645918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e7691df8-36ca-431a-bfc9-dbd2f7a572f9.a41182d8-6098-4330-8c51-016dca113e90" returned: 0 in 0.426s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-d1ab735f-90f3-439b-8f52-b62c707e8335 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7691df8-36ca-431a-bfc9-dbd2f7a572f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:16:19 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a36246-2ea2-4955-afd9-27fcb47a6cb5]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d1ab735f-90f3-439b-8f52-b62c707e8335 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e7691df8-36ca-431a-bfc9-dbd2f7a572f9 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:20 devstack sudo[108249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e7691df8-36ca-431a-bfc9-dbd2f7a572f9 Sep 28 15:16:20 devstack sudo[108249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:20 devstack sudo[108244]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bbc614d4-166c-41af-a358-bc19896fa854 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e2064982-4ede-40ad-ac9d-5d6abeeb16ee 1073741824" returned: 0 in 0.596s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bbc614d4-166c-41af-a358-bc19896fa854 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e2064982-4ede-40ad-ac9d-5d6abeeb16ee {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:20 devstack sudo[108258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e2064982-4ede-40ad-ac9d-5d6abeeb16ee Sep 28 15:16:20 devstack sudo[108258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:20 devstack sudo[108249]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d1ab735f-90f3-439b-8f52-b62c707e8335 tempest-CreateVolumesFromSnapshotTest-1830645918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e7691df8-36ca-431a-bfc9-dbd2f7a572f9" returned: 0 in 0.542s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d1ab735f-90f3-439b-8f52-b62c707e8335 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e7691df8-36ca-431a-bfc9-dbd2f7a572f9.a41182d8-6098-4330-8c51-016dca113e90 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:20 devstack sudo[108262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e7691df8-36ca-431a-bfc9-dbd2f7a572f9.a41182d8-6098-4330-8c51-016dca113e90 Sep 28 15:16:20 devstack sudo[108262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:20 devstack sudo[108258]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bbc614d4-166c-41af-a358-bc19896fa854 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e2064982-4ede-40ad-ac9d-5d6abeeb16ee" returned: 0 in 0.311s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:20 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-bbc614d4-166c-41af-a358-bc19896fa854 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:16:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bbc614d4-166c-41af-a358-bc19896fa854 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-57777fc0-4866-4791-b5e2-dac12eeafbd9 tempest-CinderUnicodeTest-538198717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.987s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:20 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-57777fc0-4866-4791-b5e2-dac12eeafbd9 tempest-CinderUnicodeTest-538198717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:17Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1084779651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23c790b4-8fa4-42af-99af-b1804c91d96e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='208de92cfead4f27a2fd76aa214d7019',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:17Z,use_quota=True,user_id='9367ab8187134d1ab5faac14667f173e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:16:20 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-57777fc0-4866-4791-b5e2-dac12eeafbd9 tempest-CinderUnicodeTest-538198717 None] Creating volume 23c790b4-8fa4-42af-99af-b1804c91d96e {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:16:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-57777fc0-4866-4791-b5e2-dac12eeafbd9 tempest-CinderUnicodeTest-538198717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-57777fc0-4866-4791-b5e2-dac12eeafbd9 tempest-CinderUnicodeTest-538198717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:20 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-57777fc0-4866-4791-b5e2-dac12eeafbd9 tempest-CinderUnicodeTest-538198717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:20 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-57777fc0-4866-4791-b5e2-dac12eeafbd9 tempest-CinderUnicodeTest-538198717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-57777fc0-4866-4791-b5e2-dac12eeafbd9 tempest-CinderUnicodeTest-538198717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:20 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-57777fc0-4866-4791-b5e2-dac12eeafbd9 tempest-CinderUnicodeTest-538198717 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:16:20 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-57777fc0-4866-4791-b5e2-dac12eeafbd9 tempest-CinderUnicodeTest-538198717 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:16:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-57777fc0-4866-4791-b5e2-dac12eeafbd9 tempest-CinderUnicodeTest-538198717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-23c790b4-8fa4-42af-99af-b1804c91d96e 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:20 devstack sudo[108265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-23c790b4-8fa4-42af-99af-b1804c91d96e 1073741824 Sep 28 15:16:20 devstack sudo[108265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bbc614d4-166c-41af-a358-bc19896fa854 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f62b997c-a1bf-4b68-a169-03873bf90f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2064982-4ede-40ad-ac9d-5d6abeeb16ee', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bbc614d4-166c-41af-a358-bc19896fa854 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c67f7ab4-0d2b-4247-a928-3772ea04000b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:20 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-bbc614d4-166c-41af-a358-bc19896fa854 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Volume volume-e2064982-4ede-40ad-ac9d-5d6abeeb16ee (e2064982-4ede-40ad-ac9d-5d6abeeb16ee): created successfully Sep 28 15:16:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bbc614d4-166c-41af-a358-bc19896fa854 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c67f7ab4-0d2b-4247-a928-3772ea04000b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bbc614d4-166c-41af-a358-bc19896fa854 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Flow 'volume_create_manager' (d4799ad4-2a12-4b61-a997-034dc2996d79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:20 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-bbc614d4-166c-41af-a358-bc19896fa854 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Created volume successfully. Sep 28 15:16:20 devstack sudo[108262]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d1ab735f-90f3-439b-8f52-b62c707e8335 tempest-CreateVolumesFromSnapshotTest-1830645918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e7691df8-36ca-431a-bfc9-dbd2f7a572f9.a41182d8-6098-4330-8c51-016dca113e90" returned: 0 in 0.453s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d1ab735f-90f3-439b-8f52-b62c707e8335 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e7691df8-36ca-431a-bfc9-dbd2f7a572f9.a41182d8-6098-4330-8c51-016dca113e90 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:20 devstack sudo[108270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e7691df8-36ca-431a-bfc9-dbd2f7a572f9.a41182d8-6098-4330-8c51-016dca113e90 Sep 28 15:16:20 devstack sudo[108270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:21 devstack sudo[108265]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-57777fc0-4866-4791-b5e2-dac12eeafbd9 tempest-CinderUnicodeTest-538198717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-23c790b4-8fa4-42af-99af-b1804c91d96e 1073741824" returned: 0 in 0.609s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:21 devstack sudo[108270]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d1ab735f-90f3-439b-8f52-b62c707e8335 tempest-CreateVolumesFromSnapshotTest-1830645918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e7691df8-36ca-431a-bfc9-dbd2f7a572f9.a41182d8-6098-4330-8c51-016dca113e90" returned: 0 in 0.368s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:21 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d1ab735f-90f3-439b-8f52-b62c707e8335 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "cinder-quobyte-a41182d8-6098-4330-8c51-016dca113e90" released by "_delete_snapshot" :: held 1.946s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:21 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d1ab735f-90f3-439b-8f52-b62c707e8335 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "cinder-quobyte-e7691df8-36ca-431a-bfc9-dbd2f7a572f9" released by "delete_snapshot" :: held 1.996s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-57777fc0-4866-4791-b5e2-dac12eeafbd9 tempest-CinderUnicodeTest-538198717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-23c790b4-8fa4-42af-99af-b1804c91d96e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:21 devstack sudo[108277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-23c790b4-8fa4-42af-99af-b1804c91d96e Sep 28 15:16:21 devstack sudo[108277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:21 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-d1ab735f-90f3-439b-8f52-b62c707e8335 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Created reservations ['4210d62c-ab3e-4324-91d5-e1643c33ed2d', 'a6fb8eb9-f301-4cde-9b12-9e5eb480d316', '2557e882-2bb5-413e-b6de-e9e23b7d8267', '18a9ba94-e9f5-4088-859c-cbebafabdc2c'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:16:21 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-d1ab735f-90f3-439b-8f52-b62c707e8335 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Delete snapshot completed successfully. Sep 28 15:16:21 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d1ab735f-90f3-439b-8f52-b62c707e8335 tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "cinder-a41182d8-6098-4330-8c51-016dca113e90-delete_snapshot" released by "delete_snapshot" :: held 2.217s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:21 devstack sudo[108277]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-57777fc0-4866-4791-b5e2-dac12eeafbd9 tempest-CinderUnicodeTest-538198717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-23c790b4-8fa4-42af-99af-b1804c91d96e" returned: 0 in 0.303s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:21 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-57777fc0-4866-4791-b5e2-dac12eeafbd9 tempest-CinderUnicodeTest-538198717 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:16:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-57777fc0-4866-4791-b5e2-dac12eeafbd9 tempest-CinderUnicodeTest-538198717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-497eaa83-0340-483f-a321-02a0ff90e0b4 tempest-ProjectReaderTests-201161066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.373s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:21 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-497eaa83-0340-483f-a321-02a0ff90e0b4 tempest-ProjectReaderTests-201161066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1488289913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7b05c02-690f-49a2-b964-db39b2f9254d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='beacc83e875a45c5be6aab3dbf6c7a8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:18Z,use_quota=True,user_id='5e9fb6bfdda34a3e8b1648df2d0f74d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:16:21 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-497eaa83-0340-483f-a321-02a0ff90e0b4 tempest-ProjectReaderTests-201161066 None] Creating volume f7b05c02-690f-49a2-b964-db39b2f9254d {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:16:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-497eaa83-0340-483f-a321-02a0ff90e0b4 tempest-ProjectReaderTests-201161066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-497eaa83-0340-483f-a321-02a0ff90e0b4 tempest-ProjectReaderTests-201161066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:21 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-497eaa83-0340-483f-a321-02a0ff90e0b4 tempest-ProjectReaderTests-201161066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:21 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-497eaa83-0340-483f-a321-02a0ff90e0b4 tempest-ProjectReaderTests-201161066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-497eaa83-0340-483f-a321-02a0ff90e0b4 tempest-ProjectReaderTests-201161066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:21 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-497eaa83-0340-483f-a321-02a0ff90e0b4 tempest-ProjectReaderTests-201161066 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:16:21 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-497eaa83-0340-483f-a321-02a0ff90e0b4 tempest-ProjectReaderTests-201161066 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:16:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-497eaa83-0340-483f-a321-02a0ff90e0b4 tempest-ProjectReaderTests-201161066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f7b05c02-690f-49a2-b964-db39b2f9254d 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:21 devstack sudo[108281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f7b05c02-690f-49a2-b964-db39b2f9254d 1073741824 Sep 28 15:16:21 devstack sudo[108281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:21 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-57777fc0-4866-4791-b5e2-dac12eeafbd9 tempest-CinderUnicodeTest-538198717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae1d2459-8338-4aaf-b613-2c04a07cabd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23c790b4-8fa4-42af-99af-b1804c91d96e', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:21 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-57777fc0-4866-4791-b5e2-dac12eeafbd9 tempest-CinderUnicodeTest-538198717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (242168f2-5539-466d-884a-a7acc1de08e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:21 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-57777fc0-4866-4791-b5e2-dac12eeafbd9 tempest-CinderUnicodeTest-538198717 None] Volume volume-23c790b4-8fa4-42af-99af-b1804c91d96e (23c790b4-8fa4-42af-99af-b1804c91d96e): created successfully Sep 28 15:16:21 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-57777fc0-4866-4791-b5e2-dac12eeafbd9 tempest-CinderUnicodeTest-538198717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (242168f2-5539-466d-884a-a7acc1de08e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:21 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-57777fc0-4866-4791-b5e2-dac12eeafbd9 tempest-CinderUnicodeTest-538198717 None] Flow 'volume_create_manager' (22232a88-10b1-4c1b-bbce-8e4a4beae08c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:21 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-57777fc0-4866-4791-b5e2-dac12eeafbd9 tempest-CinderUnicodeTest-538198717 None] Created volume successfully. Sep 28 15:16:22 devstack sudo[108281]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-497eaa83-0340-483f-a321-02a0ff90e0b4 tempest-ProjectReaderTests-201161066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f7b05c02-690f-49a2-b964-db39b2f9254d 1073741824" returned: 0 in 0.532s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-497eaa83-0340-483f-a321-02a0ff90e0b4 tempest-ProjectReaderTests-201161066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f7b05c02-690f-49a2-b964-db39b2f9254d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:22 devstack sudo[108287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f7b05c02-690f-49a2-b964-db39b2f9254d Sep 28 15:16:22 devstack sudo[108287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:22 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0280783e-82e8-4e30-a3fc-39f317704dcb tempest-CreateVolumesFromSnapshotTest-1830645918 None] Acquiring lock "cinder-e7691df8-36ca-431a-bfc9-dbd2f7a572f9-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:22 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0280783e-82e8-4e30-a3fc-39f317704dcb tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "cinder-e7691df8-36ca-431a-bfc9-dbd2f7a572f9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:22 devstack sudo[108287]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-497eaa83-0340-483f-a321-02a0ff90e0b4 tempest-ProjectReaderTests-201161066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f7b05c02-690f-49a2-b964-db39b2f9254d" returned: 0 in 0.383s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:22 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-497eaa83-0340-483f-a321-02a0ff90e0b4 tempest-ProjectReaderTests-201161066 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:16:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-497eaa83-0340-483f-a321-02a0ff90e0b4 tempest-ProjectReaderTests-201161066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-15361b81-7d03-4b9e-8df3-4ada3f652a04 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.185s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:22 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-15361b81-7d03-4b9e-8df3-4ada3f652a04 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-554377128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9162c5f7-f87e-4c7a-be25-750d01547a3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8c12fa0df284ba8a31ce3fa43751daa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:18Z,use_quota=True,user_id='baa9eac4a22f46afa81898d7da366a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:16:22 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-15361b81-7d03-4b9e-8df3-4ada3f652a04 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Creating volume 9162c5f7-f87e-4c7a-be25-750d01547a3d {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:16:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-15361b81-7d03-4b9e-8df3-4ada3f652a04 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-15361b81-7d03-4b9e-8df3-4ada3f652a04 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:22 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-15361b81-7d03-4b9e-8df3-4ada3f652a04 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:22 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-15361b81-7d03-4b9e-8df3-4ada3f652a04 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-15361b81-7d03-4b9e-8df3-4ada3f652a04 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:22 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-15361b81-7d03-4b9e-8df3-4ada3f652a04 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:16:22 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-15361b81-7d03-4b9e-8df3-4ada3f652a04 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:16:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-15361b81-7d03-4b9e-8df3-4ada3f652a04 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9162c5f7-f87e-4c7a-be25-750d01547a3d 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:22 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0280783e-82e8-4e30-a3fc-39f317704dcb tempest-CreateVolumesFromSnapshotTest-1830645918 None] Acquiring lock "cinder-quobyte-e7691df8-36ca-431a-bfc9-dbd2f7a572f9" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:22 devstack sudo[108290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9162c5f7-f87e-4c7a-be25-750d01547a3d 1073741824 Sep 28 15:16:22 devstack sudo[108290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-497eaa83-0340-483f-a321-02a0ff90e0b4 tempest-ProjectReaderTests-201161066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cabf68e9-8bce-4bed-96ca-7bf83423f899) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7b05c02-690f-49a2-b964-db39b2f9254d', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-497eaa83-0340-483f-a321-02a0ff90e0b4 tempest-ProjectReaderTests-201161066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad8a5ced-2e55-4657-bec7-d6430c18b68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:22 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0280783e-82e8-4e30-a3fc-39f317704dcb tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "cinder-quobyte-e7691df8-36ca-431a-bfc9-dbd2f7a572f9" acquired by "delete_volume" :: waited 0.048s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e423ff8c-1bc8-4360-b53d-ebee93706e36 tempest-CinderUnicodeTest-538198717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:22 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-497eaa83-0340-483f-a321-02a0ff90e0b4 tempest-ProjectReaderTests-201161066 None] Volume volume-f7b05c02-690f-49a2-b964-db39b2f9254d (f7b05c02-690f-49a2-b964-db39b2f9254d): created successfully Sep 28 15:16:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-497eaa83-0340-483f-a321-02a0ff90e0b4 tempest-ProjectReaderTests-201161066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad8a5ced-2e55-4657-bec7-d6430c18b68d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-497eaa83-0340-483f-a321-02a0ff90e0b4 tempest-ProjectReaderTests-201161066 None] Flow 'volume_create_manager' (9c482b1f-fabb-4fe2-ba90-a49be55af63b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:22 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a47ab6-b962-41c9-8daf-d296f0c1c0df]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0280783e-82e8-4e30-a3fc-39f317704dcb tempest-CreateVolumesFromSnapshotTest-1830645918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e7691df8-36ca-431a-bfc9-dbd2f7a572f9 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:22 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-497eaa83-0340-483f-a321-02a0ff90e0b4 tempest-ProjectReaderTests-201161066 None] Created volume successfully. Sep 28 15:16:22 devstack sudo[108292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e7691df8-36ca-431a-bfc9-dbd2f7a572f9 Sep 28 15:16:22 devstack sudo[108292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:23 devstack sudo[108290]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-15361b81-7d03-4b9e-8df3-4ada3f652a04 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9162c5f7-f87e-4c7a-be25-750d01547a3d 1073741824" returned: 0 in 0.554s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:23 devstack sudo[108292]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0280783e-82e8-4e30-a3fc-39f317704dcb tempest-CreateVolumesFromSnapshotTest-1830645918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e7691df8-36ca-431a-bfc9-dbd2f7a572f9" returned: 0 in 0.444s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0280783e-82e8-4e30-a3fc-39f317704dcb tempest-CreateVolumesFromSnapshotTest-1830645918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e7691df8-36ca-431a-bfc9-dbd2f7a572f9 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:23 devstack sudo[108300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e7691df8-36ca-431a-bfc9-dbd2f7a572f9 Sep 28 15:16:23 devstack sudo[108300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-15361b81-7d03-4b9e-8df3-4ada3f652a04 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9162c5f7-f87e-4c7a-be25-750d01547a3d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:23 devstack sudo[108302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9162c5f7-f87e-4c7a-be25-750d01547a3d Sep 28 15:16:23 devstack sudo[108302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:23 devstack sudo[108302]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-15361b81-7d03-4b9e-8df3-4ada3f652a04 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9162c5f7-f87e-4c7a-be25-750d01547a3d" returned: 0 in 0.285s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:23 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-15361b81-7d03-4b9e-8df3-4ada3f652a04 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:16:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-15361b81-7d03-4b9e-8df3-4ada3f652a04 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e423ff8c-1bc8-4360-b53d-ebee93706e36 tempest-CinderUnicodeTest-538198717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.801s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:23 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-e423ff8c-1bc8-4360-b53d-ebee93706e36 tempest-CinderUnicodeTest-538198717 None] Creating offline snapshot 3af67540-3ba6-4fa2-b39d-6fac8d4f85a8 of volume 23c790b4-8fa4-42af-99af-b1804c91d96e {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:16:23 devstack sudo[108300]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-15361b81-7d03-4b9e-8df3-4ada3f652a04 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (118791a1-de85-4dc0-be6e-6c7d8c1c2825) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9162c5f7-f87e-4c7a-be25-750d01547a3d', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-15361b81-7d03-4b9e-8df3-4ada3f652a04 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e653793e-9962-4399-8a4d-3963220d4e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0280783e-82e8-4e30-a3fc-39f317704dcb tempest-CreateVolumesFromSnapshotTest-1830645918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e7691df8-36ca-431a-bfc9-dbd2f7a572f9" returned: 0 in 0.392s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:23 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[7380c3df-e4c4-44b5-9520-f77ef78fa85d]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e423ff8c-1bc8-4360-b53d-ebee93706e36 tempest-CinderUnicodeTest-538198717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-23c790b4-8fa4-42af-99af-b1804c91d96e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:23 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0280783e-82e8-4e30-a3fc-39f317704dcb tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "cinder-quobyte-e7691df8-36ca-431a-bfc9-dbd2f7a572f9" released by "delete_volume" :: held 0.955s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:23 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-15361b81-7d03-4b9e-8df3-4ada3f652a04 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Volume volume-9162c5f7-f87e-4c7a-be25-750d01547a3d (9162c5f7-f87e-4c7a-be25-750d01547a3d): created successfully Sep 28 15:16:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-15361b81-7d03-4b9e-8df3-4ada3f652a04 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e653793e-9962-4399-8a4d-3963220d4e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-15361b81-7d03-4b9e-8df3-4ada3f652a04 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Flow 'volume_create_manager' (b3b5afcb-aff7-476c-b618-eab1baff8628) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:23 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-15361b81-7d03-4b9e-8df3-4ada3f652a04 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Created volume successfully. Sep 28 15:16:23 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-0280783e-82e8-4e30-a3fc-39f317704dcb tempest-CreateVolumesFromSnapshotTest-1830645918 None] Created reservations ['df9bc48d-fba8-47aa-98fc-a5972bbcbba9', 'b9836d6b-1031-4733-9dc5-e9178089b75d', '74392a7f-a938-42d5-811a-2c053bcf7356', 'd65de6eb-03b5-4dce-aea6-bc10738a4559'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:16:23 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-21d7df80-5a60-4aec-b4af-18b685e6f106 tempest-ProjectReaderTests-201161066 None] Acquiring lock "cinder-f7b05c02-690f-49a2-b964-db39b2f9254d-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:23 devstack sudo[108306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-23c790b4-8fa4-42af-99af-b1804c91d96e Sep 28 15:16:23 devstack sudo[108306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:23 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-21d7df80-5a60-4aec-b4af-18b685e6f106 tempest-ProjectReaderTests-201161066 None] Lock "cinder-f7b05c02-690f-49a2-b964-db39b2f9254d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:23 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-21d7df80-5a60-4aec-b4af-18b685e6f106 tempest-ProjectReaderTests-201161066 None] Acquiring lock "cinder-quobyte-f7b05c02-690f-49a2-b964-db39b2f9254d" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0280783e-82e8-4e30-a3fc-39f317704dcb tempest-CreateVolumesFromSnapshotTest-1830645918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0280783e-82e8-4e30-a3fc-39f317704dcb tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:23 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0280783e-82e8-4e30-a3fc-39f317704dcb tempest-CreateVolumesFromSnapshotTest-1830645918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:23 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0280783e-82e8-4e30-a3fc-39f317704dcb tempest-CreateVolumesFromSnapshotTest-1830645918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0280783e-82e8-4e30-a3fc-39f317704dcb tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0280783e-82e8-4e30-a3fc-39f317704dcb tempest-CreateVolumesFromSnapshotTest-1830645918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:23 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-21d7df80-5a60-4aec-b4af-18b685e6f106 tempest-ProjectReaderTests-201161066 None] Lock "cinder-quobyte-f7b05c02-690f-49a2-b964-db39b2f9254d" acquired by "delete_volume" :: waited 0.051s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:23 devstack sudo[108308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:16:23 devstack sudo[108308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:23 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[d726c524-19bb-45f5-9447-3b09dde6e9e9]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-21d7df80-5a60-4aec-b4af-18b685e6f106 tempest-ProjectReaderTests-201161066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f7b05c02-690f-49a2-b964-db39b2f9254d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:24 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8b7d92d7-73be-4ce2-860f-53f97a128c57 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Acquiring lock "cinder-9162c5f7-f87e-4c7a-be25-750d01547a3d-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:24 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8b7d92d7-73be-4ce2-860f-53f97a128c57 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Lock "cinder-9162c5f7-f87e-4c7a-be25-750d01547a3d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:24 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8b7d92d7-73be-4ce2-860f-53f97a128c57 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Acquiring lock "cinder-quobyte-9162c5f7-f87e-4c7a-be25-750d01547a3d" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:24 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8b7d92d7-73be-4ce2-860f-53f97a128c57 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Lock "cinder-quobyte-9162c5f7-f87e-4c7a-be25-750d01547a3d" acquired by "delete_volume" :: waited 0.022s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:24 devstack sudo[108310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f7b05c02-690f-49a2-b964-db39b2f9254d Sep 28 15:16:24 devstack sudo[108310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:24 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c06632-7900-4c80-8d13-12262c430a51]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8b7d92d7-73be-4ce2-860f-53f97a128c57 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9162c5f7-f87e-4c7a-be25-750d01547a3d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:24 devstack sudo[108306]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e423ff8c-1bc8-4360-b53d-ebee93706e36 tempest-CinderUnicodeTest-538198717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-23c790b4-8fa4-42af-99af-b1804c91d96e" returned: 0 in 0.612s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e423ff8c-1bc8-4360-b53d-ebee93706e36 tempest-CinderUnicodeTest-538198717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-23c790b4-8fa4-42af-99af-b1804c91d96e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-23c790b4-8fa4-42af-99af-b1804c91d96e.3af67540-3ba6-4fa2-b39d-6fac8d4f85a8 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:24 devstack sudo[108317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-23c790b4-8fa4-42af-99af-b1804c91d96e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-23c790b4-8fa4-42af-99af-b1804c91d96e.3af67540-3ba6-4fa2-b39d-6fac8d4f85a8 1G Sep 28 15:16:24 devstack sudo[108317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:24 devstack sudo[108308]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0280783e-82e8-4e30-a3fc-39f317704dcb tempest-CreateVolumesFromSnapshotTest-1830645918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.383s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:24 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-0280783e-82e8-4e30-a3fc-39f317704dcb tempest-CreateVolumesFromSnapshotTest-1830645918 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:16:24 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-0280783e-82e8-4e30-a3fc-39f317704dcb tempest-CreateVolumesFromSnapshotTest-1830645918 None] Deleted volume successfully. Sep 28 15:16:24 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0280783e-82e8-4e30-a3fc-39f317704dcb tempest-CreateVolumesFromSnapshotTest-1830645918 None] Lock "cinder-e7691df8-36ca-431a-bfc9-dbd2f7a572f9-delete_volume" released by "delete_volume" :: held 1.800s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:24 devstack sudo[108315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9162c5f7-f87e-4c7a-be25-750d01547a3d Sep 28 15:16:24 devstack sudo[108315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:24 devstack sudo[108310]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-21d7df80-5a60-4aec-b4af-18b685e6f106 tempest-ProjectReaderTests-201161066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f7b05c02-690f-49a2-b964-db39b2f9254d" returned: 0 in 0.548s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-21d7df80-5a60-4aec-b4af-18b685e6f106 tempest-ProjectReaderTests-201161066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f7b05c02-690f-49a2-b964-db39b2f9254d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:24 devstack sudo[108325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f7b05c02-690f-49a2-b964-db39b2f9254d Sep 28 15:16:24 devstack sudo[108325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:24 devstack sudo[108315]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8b7d92d7-73be-4ce2-860f-53f97a128c57 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9162c5f7-f87e-4c7a-be25-750d01547a3d" returned: 0 in 0.494s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8b7d92d7-73be-4ce2-860f-53f97a128c57 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9162c5f7-f87e-4c7a-be25-750d01547a3d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:24 devstack sudo[108331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9162c5f7-f87e-4c7a-be25-750d01547a3d Sep 28 15:16:24 devstack sudo[108331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:24 devstack sudo[108317]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e423ff8c-1bc8-4360-b53d-ebee93706e36 tempest-CinderUnicodeTest-538198717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-23c790b4-8fa4-42af-99af-b1804c91d96e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-23c790b4-8fa4-42af-99af-b1804c91d96e.3af67540-3ba6-4fa2-b39d-6fac8d4f85a8 1G" returned: 0 in 0.584s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e423ff8c-1bc8-4360-b53d-ebee93706e36 tempest-CinderUnicodeTest-538198717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23c790b4-8fa4-42af-99af-b1804c91d96e -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-23c790b4-8fa4-42af-99af-b1804c91d96e.3af67540-3ba6-4fa2-b39d-6fac8d4f85a8 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:24 devstack sudo[108334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23c790b4-8fa4-42af-99af-b1804c91d96e -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-23c790b4-8fa4-42af-99af-b1804c91d96e.3af67540-3ba6-4fa2-b39d-6fac8d4f85a8 Sep 28 15:16:24 devstack sudo[108334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:24 devstack sudo[108325]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-21d7df80-5a60-4aec-b4af-18b685e6f106 tempest-ProjectReaderTests-201161066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f7b05c02-690f-49a2-b964-db39b2f9254d" returned: 0 in 0.372s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:24 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-21d7df80-5a60-4aec-b4af-18b685e6f106 tempest-ProjectReaderTests-201161066 None] Lock "cinder-quobyte-f7b05c02-690f-49a2-b964-db39b2f9254d" released by "delete_volume" :: held 1.007s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:25 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-21d7df80-5a60-4aec-b4af-18b685e6f106 tempest-ProjectReaderTests-201161066 None] Created reservations ['ac3cc4b6-928f-4661-a2c5-6c1a55518986', '0bbc3f17-0a50-4283-ac78-95d8d8aa6835', '2f0e922a-a222-48e3-9bc8-7dda6160de46', '0cfe3d9a-05d8-42ba-aa3f-7a4d1258a291'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:16:25 devstack sudo[108331]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8b7d92d7-73be-4ce2-860f-53f97a128c57 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9162c5f7-f87e-4c7a-be25-750d01547a3d" returned: 0 in 0.410s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:25 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8b7d92d7-73be-4ce2-860f-53f97a128c57 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Lock "cinder-quobyte-9162c5f7-f87e-4c7a-be25-750d01547a3d" released by "delete_volume" :: held 0.978s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-21d7df80-5a60-4aec-b4af-18b685e6f106 tempest-ProjectReaderTests-201161066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-21d7df80-5a60-4aec-b4af-18b685e6f106 tempest-ProjectReaderTests-201161066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:25 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-21d7df80-5a60-4aec-b4af-18b685e6f106 tempest-ProjectReaderTests-201161066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:25 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-21d7df80-5a60-4aec-b4af-18b685e6f106 tempest-ProjectReaderTests-201161066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-21d7df80-5a60-4aec-b4af-18b685e6f106 tempest-ProjectReaderTests-201161066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-21d7df80-5a60-4aec-b4af-18b685e6f106 tempest-ProjectReaderTests-201161066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:25 devstack sudo[108341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:16:25 devstack sudo[108341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:25 devstack sudo[108334]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e423ff8c-1bc8-4360-b53d-ebee93706e36 tempest-CinderUnicodeTest-538198717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23c790b4-8fa4-42af-99af-b1804c91d96e -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-23c790b4-8fa4-42af-99af-b1804c91d96e.3af67540-3ba6-4fa2-b39d-6fac8d4f85a8" returned: 0 in 0.445s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:25 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-e423ff8c-1bc8-4360-b53d-ebee93706e36 tempest-CinderUnicodeTest-538198717 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-23c790b4-8fa4-42af-99af-b1804c91d96e.3af67540-3ba6-4fa2-b39d-6fac8d4f85a8 is being set with open permissions: ugo+rw Sep 28 15:16:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e423ff8c-1bc8-4360-b53d-ebee93706e36 tempest-CinderUnicodeTest-538198717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-23c790b4-8fa4-42af-99af-b1804c91d96e.3af67540-3ba6-4fa2-b39d-6fac8d4f85a8 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:25 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-8b7d92d7-73be-4ce2-860f-53f97a128c57 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Created reservations ['d152daf9-2800-4a7b-bac0-0c5dbb14828d', '925f0025-cf33-46e9-b95f-9667c8d08141', '30af52d5-fac0-43e0-b505-bd2d9a4047de', '1a295de9-58df-4b59-95ae-bbfed3d0dbf6'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:16:25 devstack sudo[108343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-23c790b4-8fa4-42af-99af-b1804c91d96e.3af67540-3ba6-4fa2-b39d-6fac8d4f85a8 Sep 28 15:16:25 devstack sudo[108343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8b7d92d7-73be-4ce2-860f-53f97a128c57 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8b7d92d7-73be-4ce2-860f-53f97a128c57 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:25 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8b7d92d7-73be-4ce2-860f-53f97a128c57 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:25 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8b7d92d7-73be-4ce2-860f-53f97a128c57 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8b7d92d7-73be-4ce2-860f-53f97a128c57 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8b7d92d7-73be-4ce2-860f-53f97a128c57 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:25 devstack sudo[108345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:16:25 devstack sudo[108345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:25 devstack sudo[108341]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-21d7df80-5a60-4aec-b4af-18b685e6f106 tempest-ProjectReaderTests-201161066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.366s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:25 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-21d7df80-5a60-4aec-b4af-18b685e6f106 tempest-ProjectReaderTests-201161066 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:16:25 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-21d7df80-5a60-4aec-b4af-18b685e6f106 tempest-ProjectReaderTests-201161066 None] Deleted volume successfully. Sep 28 15:16:25 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-21d7df80-5a60-4aec-b4af-18b685e6f106 tempest-ProjectReaderTests-201161066 None] Lock "cinder-f7b05c02-690f-49a2-b964-db39b2f9254d-delete_volume" released by "delete_volume" :: held 1.793s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:25 devstack sudo[108343]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e423ff8c-1bc8-4360-b53d-ebee93706e36 tempest-CinderUnicodeTest-538198717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-23c790b4-8fa4-42af-99af-b1804c91d96e.3af67540-3ba6-4fa2-b39d-6fac8d4f85a8" returned: 0 in 0.352s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e423ff8c-1bc8-4360-b53d-ebee93706e36 tempest-CinderUnicodeTest-538198717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-23c790b4-8fa4-42af-99af-b1804c91d96e.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:25 devstack sudo[108350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-23c790b4-8fa4-42af-99af-b1804c91d96e.info Sep 28 15:16:25 devstack sudo[108350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:25 devstack sudo[108345]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8b7d92d7-73be-4ce2-860f-53f97a128c57 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.330s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:25 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-8b7d92d7-73be-4ce2-860f-53f97a128c57 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:16:25 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-8b7d92d7-73be-4ce2-860f-53f97a128c57 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Deleted volume successfully. Sep 28 15:16:25 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8b7d92d7-73be-4ce2-860f-53f97a128c57 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Lock "cinder-9162c5f7-f87e-4c7a-be25-750d01547a3d-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:25 devstack sudo[108350]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e423ff8c-1bc8-4360-b53d-ebee93706e36 tempest-CinderUnicodeTest-538198717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-23c790b4-8fa4-42af-99af-b1804c91d96e.info" returned: 0 in 0.315s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:25 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-e423ff8c-1bc8-4360-b53d-ebee93706e36 tempest-CinderUnicodeTest-538198717 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-23c790b4-8fa4-42af-99af-b1804c91d96e.info is being set with open permissions: ugo+rw Sep 28 15:16:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e423ff8c-1bc8-4360-b53d-ebee93706e36 tempest-CinderUnicodeTest-538198717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-23c790b4-8fa4-42af-99af-b1804c91d96e.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:25 devstack sudo[108353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-23c790b4-8fa4-42af-99af-b1804c91d96e.info Sep 28 15:16:25 devstack sudo[108353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:26 devstack sudo[108353]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e423ff8c-1bc8-4360-b53d-ebee93706e36 tempest-CinderUnicodeTest-538198717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-23c790b4-8fa4-42af-99af-b1804c91d96e.info" returned: 0 in 0.334s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e423ff8c-1bc8-4360-b53d-ebee93706e36 tempest-CinderUnicodeTest-538198717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.799s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-771591cd-1a22-4080-8429-a6a76b52dfc4 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Acquiring lock "cinder-e2064982-4ede-40ad-ac9d-5d6abeeb16ee-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-771591cd-1a22-4080-8429-a6a76b52dfc4 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Lock "cinder-e2064982-4ede-40ad-ac9d-5d6abeeb16ee-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:26 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-e423ff8c-1bc8-4360-b53d-ebee93706e36 tempest-CinderUnicodeTest-538198717 None] Create snapshot completed successfully Sep 28 15:16:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-771591cd-1a22-4080-8429-a6a76b52dfc4 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Acquiring lock "cinder-quobyte-e2064982-4ede-40ad-ac9d-5d6abeeb16ee" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-771591cd-1a22-4080-8429-a6a76b52dfc4 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Lock "cinder-quobyte-e2064982-4ede-40ad-ac9d-5d6abeeb16ee" acquired by "delete_volume" :: waited 0.028s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:26 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc9ec36-005f-4782-8ed6-97f40c3a89f4]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-771591cd-1a22-4080-8429-a6a76b52dfc4 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e2064982-4ede-40ad-ac9d-5d6abeeb16ee {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:26 devstack sudo[108356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e2064982-4ede-40ad-ac9d-5d6abeeb16ee Sep 28 15:16:26 devstack sudo[108356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:26 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3aa80b7-7f66-4e3b-9e09-d78e6fb63c07 tempest-ProjectReaderTests-201161066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:16:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c3aa80b7-7f66-4e3b-9e09-d78e6fb63c07 tempest-ProjectReaderTests-201161066 None] Flow 'volume_create_manager' (9ed4163f-8c80-4d52-9f0c-dbf798565918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c3aa80b7-7f66-4e3b-9e09-d78e6fb63c07 tempest-ProjectReaderTests-201161066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (697322a2-9859-40ee-887d-9bf6ddced0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c3aa80b7-7f66-4e3b-9e09-d78e6fb63c07 tempest-ProjectReaderTests-201161066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (697322a2-9859-40ee-887d-9bf6ddced0e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1090405177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=137fcec7-5ad9-422a-859a-997bd9c750de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='beacc83e875a45c5be6aab3dbf6c7a8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:27Z,use_quota=True,user_id='5e9fb6bfdda34a3e8b1648df2d0f74d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c3aa80b7-7f66-4e3b-9e09-d78e6fb63c07 tempest-ProjectReaderTests-201161066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c922f9f-8ddb-47ad-ac61-c6c75b6a0157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c3aa80b7-7f66-4e3b-9e09-d78e6fb63c07 tempest-ProjectReaderTests-201161066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c922f9f-8ddb-47ad-ac61-c6c75b6a0157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c3aa80b7-7f66-4e3b-9e09-d78e6fb63c07 tempest-ProjectReaderTests-201161066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3102f65-8646-48a3-a815-97d03018e76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c3aa80b7-7f66-4e3b-9e09-d78e6fb63c07 tempest-ProjectReaderTests-201161066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3102f65-8646-48a3-a815-97d03018e76b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '137fcec7-5ad9-422a-859a-997bd9c750de', 'volume_name': 'volume-137fcec7-5ad9-422a-859a-997bd9c750de', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c3aa80b7-7f66-4e3b-9e09-d78e6fb63c07 tempest-ProjectReaderTests-201161066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4afcb75-0acc-4784-bb4e-969dbb23996f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c3aa80b7-7f66-4e3b-9e09-d78e6fb63c07 tempest-ProjectReaderTests-201161066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4afcb75-0acc-4784-bb4e-969dbb23996f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c3aa80b7-7f66-4e3b-9e09-d78e6fb63c07 tempest-ProjectReaderTests-201161066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4824ed0d-6c13-4314-9cd5-05725abffd2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:26 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-c3aa80b7-7f66-4e3b-9e09-d78e6fb63c07 tempest-ProjectReaderTests-201161066 None] Volume 137fcec7-5ad9-422a-859a-997bd9c750de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-137fcec7-5ad9-422a-859a-997bd9c750de', 'volume_size': 1} Sep 28 15:16:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c3aa80b7-7f66-4e3b-9e09-d78e6fb63c07 tempest-ProjectReaderTests-201161066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c3aa80b7-7f66-4e3b-9e09-d78e6fb63c07 tempest-ProjectReaderTests-201161066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c3aa80b7-7f66-4e3b-9e09-d78e6fb63c07 tempest-ProjectReaderTests-201161066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1090405177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=137fcec7-5ad9-422a-859a-997bd9c750de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='beacc83e875a45c5be6aab3dbf6c7a8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:27Z,use_quota=True,user_id='5e9fb6bfdda34a3e8b1648df2d0f74d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:16:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-c3aa80b7-7f66-4e3b-9e09-d78e6fb63c07 tempest-ProjectReaderTests-201161066 None] Creating volume 137fcec7-5ad9-422a-859a-997bd9c750de {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:16:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c3aa80b7-7f66-4e3b-9e09-d78e6fb63c07 tempest-ProjectReaderTests-201161066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c3aa80b7-7f66-4e3b-9e09-d78e6fb63c07 tempest-ProjectReaderTests-201161066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c3aa80b7-7f66-4e3b-9e09-d78e6fb63c07 tempest-ProjectReaderTests-201161066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c3aa80b7-7f66-4e3b-9e09-d78e6fb63c07 tempest-ProjectReaderTests-201161066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c3aa80b7-7f66-4e3b-9e09-d78e6fb63c07 tempest-ProjectReaderTests-201161066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c3aa80b7-7f66-4e3b-9e09-d78e6fb63c07 tempest-ProjectReaderTests-201161066 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:16:26 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-c3aa80b7-7f66-4e3b-9e09-d78e6fb63c07 tempest-ProjectReaderTests-201161066 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:16:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c3aa80b7-7f66-4e3b-9e09-d78e6fb63c07 tempest-ProjectReaderTests-201161066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-137fcec7-5ad9-422a-859a-997bd9c750de 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:26 devstack sudo[108358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-137fcec7-5ad9-422a-859a-997bd9c750de 1073741824 Sep 28 15:16:26 devstack sudo[108358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:27 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9e68237c-b015-4c63-86c6-292914d00516 tempest-CinderUnicodeTest-538198717 None] Acquiring lock "cinder-3af67540-3ba6-4fa2-b39d-6fac8d4f85a8-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:27 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9e68237c-b015-4c63-86c6-292914d00516 tempest-CinderUnicodeTest-538198717 None] Lock "cinder-3af67540-3ba6-4fa2-b39d-6fac8d4f85a8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:27 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9e68237c-b015-4c63-86c6-292914d00516 tempest-CinderUnicodeTest-538198717 None] Acquiring lock "cinder-quobyte-23c790b4-8fa4-42af-99af-b1804c91d96e" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:27 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9e68237c-b015-4c63-86c6-292914d00516 tempest-CinderUnicodeTest-538198717 None] Lock "cinder-quobyte-23c790b4-8fa4-42af-99af-b1804c91d96e" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:27 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9e68237c-b015-4c63-86c6-292914d00516 tempest-CinderUnicodeTest-538198717 None] Acquiring lock "cinder-quobyte-3af67540-3ba6-4fa2-b39d-6fac8d4f85a8" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:27 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9e68237c-b015-4c63-86c6-292914d00516 tempest-CinderUnicodeTest-538198717 None] Lock "cinder-quobyte-3af67540-3ba6-4fa2-b39d-6fac8d4f85a8" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-9e68237c-b015-4c63-86c6-292914d00516 tempest-CinderUnicodeTest-538198717 None] Deleting offline snapshot 3af67540-3ba6-4fa2-b39d-6fac8d4f85a8 of volume 23c790b4-8fa4-42af-99af-b1804c91d96e {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:16:27 devstack sudo[108356]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-9e68237c-b015-4c63-86c6-292914d00516 tempest-CinderUnicodeTest-538198717 None] snapshot_file for this snap is: volume-23c790b4-8fa4-42af-99af-b1804c91d96e.3af67540-3ba6-4fa2-b39d-6fac8d4f85a8 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:16:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-771591cd-1a22-4080-8429-a6a76b52dfc4 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e2064982-4ede-40ad-ac9d-5d6abeeb16ee" returned: 0 in 0.574s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-771591cd-1a22-4080-8429-a6a76b52dfc4 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e2064982-4ede-40ad-ac9d-5d6abeeb16ee {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:27 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3afae3-e89e-408c-8564-9443f9bc9f58]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9e68237c-b015-4c63-86c6-292914d00516 tempest-CinderUnicodeTest-538198717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-23c790b4-8fa4-42af-99af-b1804c91d96e.3af67540-3ba6-4fa2-b39d-6fac8d4f85a8 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:27 devstack sudo[108363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e2064982-4ede-40ad-ac9d-5d6abeeb16ee Sep 28 15:16:27 devstack sudo[108363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:27 devstack sudo[108364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-23c790b4-8fa4-42af-99af-b1804c91d96e.3af67540-3ba6-4fa2-b39d-6fac8d4f85a8 Sep 28 15:16:27 devstack sudo[108364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:27 devstack sudo[108363]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-771591cd-1a22-4080-8429-a6a76b52dfc4 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e2064982-4ede-40ad-ac9d-5d6abeeb16ee" returned: 0 in 0.298s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:27 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-771591cd-1a22-4080-8429-a6a76b52dfc4 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Lock "cinder-quobyte-e2064982-4ede-40ad-ac9d-5d6abeeb16ee" released by "delete_volume" :: held 0.964s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:27 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-771591cd-1a22-4080-8429-a6a76b52dfc4 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Created reservations ['ff1b6540-8aae-42f5-8bed-32f4fae1107c', '8efb9d80-248d-45a9-9e2d-f6ec2dc8e0ce', '1b0c9f47-e9be-433b-b8e6-8e76ec374e92', '57737107-b93d-466a-87cc-fb60f3f94f01'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:16:27 devstack sudo[108358]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c3aa80b7-7f66-4e3b-9e09-d78e6fb63c07 tempest-ProjectReaderTests-201161066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-137fcec7-5ad9-422a-859a-997bd9c750de 1073741824" returned: 0 in 0.674s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c3aa80b7-7f66-4e3b-9e09-d78e6fb63c07 tempest-ProjectReaderTests-201161066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-137fcec7-5ad9-422a-859a-997bd9c750de {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-771591cd-1a22-4080-8429-a6a76b52dfc4 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-771591cd-1a22-4080-8429-a6a76b52dfc4 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-771591cd-1a22-4080-8429-a6a76b52dfc4 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:27 devstack sudo[108364]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-771591cd-1a22-4080-8429-a6a76b52dfc4 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-771591cd-1a22-4080-8429-a6a76b52dfc4 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-771591cd-1a22-4080-8429-a6a76b52dfc4 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:27 devstack sudo[108375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-137fcec7-5ad9-422a-859a-997bd9c750de Sep 28 15:16:27 devstack sudo[108375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9e68237c-b015-4c63-86c6-292914d00516 tempest-CinderUnicodeTest-538198717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-23c790b4-8fa4-42af-99af-b1804c91d96e.3af67540-3ba6-4fa2-b39d-6fac8d4f85a8" returned: 0 in 0.592s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-9e68237c-b015-4c63-86c6-292914d00516 tempest-CinderUnicodeTest-538198717 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23c790b4-8fa4-42af-99af-b1804c91d96e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:16:27 devstack sudo[108377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:16:27 devstack sudo[108377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:27 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[e211da00-85f0-4190-a9f0-fad25c9cdd4e]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9e68237c-b015-4c63-86c6-292914d00516 tempest-CinderUnicodeTest-538198717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-23c790b4-8fa4-42af-99af-b1804c91d96e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:28 devstack sudo[108379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-23c790b4-8fa4-42af-99af-b1804c91d96e Sep 28 15:16:28 devstack sudo[108379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:28 devstack sudo[108375]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c3aa80b7-7f66-4e3b-9e09-d78e6fb63c07 tempest-ProjectReaderTests-201161066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-137fcec7-5ad9-422a-859a-997bd9c750de" returned: 0 in 0.373s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:28 devstack sudo[108377]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:28 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c3aa80b7-7f66-4e3b-9e09-d78e6fb63c07 tempest-ProjectReaderTests-201161066 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:16:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c3aa80b7-7f66-4e3b-9e09-d78e6fb63c07 tempest-ProjectReaderTests-201161066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-771591cd-1a22-4080-8429-a6a76b52dfc4 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.347s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:28 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-771591cd-1a22-4080-8429-a6a76b52dfc4 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:16:28 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-771591cd-1a22-4080-8429-a6a76b52dfc4 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Deleted volume successfully. Sep 28 15:16:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c3aa80b7-7f66-4e3b-9e09-d78e6fb63c07 tempest-ProjectReaderTests-201161066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4824ed0d-6c13-4314-9cd5-05725abffd2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-137fcec7-5ad9-422a-859a-997bd9c750de', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c3aa80b7-7f66-4e3b-9e09-d78e6fb63c07 tempest-ProjectReaderTests-201161066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d0fbc3c-9ba4-4873-be74-8e519502405c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:28 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-c3aa80b7-7f66-4e3b-9e09-d78e6fb63c07 tempest-ProjectReaderTests-201161066 None] Volume volume-137fcec7-5ad9-422a-859a-997bd9c750de (137fcec7-5ad9-422a-859a-997bd9c750de): created successfully Sep 28 15:16:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c3aa80b7-7f66-4e3b-9e09-d78e6fb63c07 tempest-ProjectReaderTests-201161066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d0fbc3c-9ba4-4873-be74-8e519502405c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c3aa80b7-7f66-4e3b-9e09-d78e6fb63c07 tempest-ProjectReaderTests-201161066 None] Flow 'volume_create_manager' (9ed4163f-8c80-4d52-9f0c-dbf798565918) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:28 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-771591cd-1a22-4080-8429-a6a76b52dfc4 tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Lock "cinder-e2064982-4ede-40ad-ac9d-5d6abeeb16ee-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:28 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-c3aa80b7-7f66-4e3b-9e09-d78e6fb63c07 tempest-ProjectReaderTests-201161066 None] Created volume successfully. Sep 28 15:16:28 devstack sudo[108379]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9e68237c-b015-4c63-86c6-292914d00516 tempest-CinderUnicodeTest-538198717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-23c790b4-8fa4-42af-99af-b1804c91d96e" returned: 0 in 0.542s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9e68237c-b015-4c63-86c6-292914d00516 tempest-CinderUnicodeTest-538198717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-23c790b4-8fa4-42af-99af-b1804c91d96e.3af67540-3ba6-4fa2-b39d-6fac8d4f85a8 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:28 devstack sudo[108386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-23c790b4-8fa4-42af-99af-b1804c91d96e.3af67540-3ba6-4fa2-b39d-6fac8d4f85a8 Sep 28 15:16:28 devstack sudo[108386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:28 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-55e8a57e-f2d7-47b4-b8d9-22cc8382096c tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Acquiring lock "cinder-6a6b7471-8eca-4ecc-b80a-3eee1a06d453-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:28 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-55e8a57e-f2d7-47b4-b8d9-22cc8382096c tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Lock "cinder-6a6b7471-8eca-4ecc-b80a-3eee1a06d453-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:28 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-55e8a57e-f2d7-47b4-b8d9-22cc8382096c tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Acquiring lock "cinder-quobyte-6a6b7471-8eca-4ecc-b80a-3eee1a06d453" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:28 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-55e8a57e-f2d7-47b4-b8d9-22cc8382096c tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Lock "cinder-quobyte-6a6b7471-8eca-4ecc-b80a-3eee1a06d453" acquired by "delete_volume" :: waited 0.030s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:28 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01301b7-fea4-4df4-8c16-fc3383119de1]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-55e8a57e-f2d7-47b4-b8d9-22cc8382096c tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6a6b7471-8eca-4ecc-b80a-3eee1a06d453 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:28 devstack sudo[108386]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9e68237c-b015-4c63-86c6-292914d00516 tempest-CinderUnicodeTest-538198717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-23c790b4-8fa4-42af-99af-b1804c91d96e.3af67540-3ba6-4fa2-b39d-6fac8d4f85a8" returned: 0 in 0.553s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9e68237c-b015-4c63-86c6-292914d00516 tempest-CinderUnicodeTest-538198717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-23c790b4-8fa4-42af-99af-b1804c91d96e.3af67540-3ba6-4fa2-b39d-6fac8d4f85a8 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:28 devstack sudo[108393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-23c790b4-8fa4-42af-99af-b1804c91d96e.3af67540-3ba6-4fa2-b39d-6fac8d4f85a8 Sep 28 15:16:28 devstack sudo[108393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:29 devstack sudo[108392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6a6b7471-8eca-4ecc-b80a-3eee1a06d453 Sep 28 15:16:29 devstack sudo[108392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:29 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7cbbeb13-b162-4f4e-aa46-a02904b402e8 tempest-ProjectReaderTests-201161066 None] Acquiring lock "cinder-137fcec7-5ad9-422a-859a-997bd9c750de-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:29 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7cbbeb13-b162-4f4e-aa46-a02904b402e8 tempest-ProjectReaderTests-201161066 None] Lock "cinder-137fcec7-5ad9-422a-859a-997bd9c750de-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:29 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7cbbeb13-b162-4f4e-aa46-a02904b402e8 tempest-ProjectReaderTests-201161066 None] Acquiring lock "cinder-quobyte-137fcec7-5ad9-422a-859a-997bd9c750de" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:29 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7cbbeb13-b162-4f4e-aa46-a02904b402e8 tempest-ProjectReaderTests-201161066 None] Lock "cinder-quobyte-137fcec7-5ad9-422a-859a-997bd9c750de" acquired by "delete_volume" :: waited 0.017s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:29 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[0085c7c9-13ca-4130-ade8-e37e112c66f3]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7cbbeb13-b162-4f4e-aa46-a02904b402e8 tempest-ProjectReaderTests-201161066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-137fcec7-5ad9-422a-859a-997bd9c750de {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:29 devstack sudo[108393]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:29 devstack sudo[108396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-137fcec7-5ad9-422a-859a-997bd9c750de Sep 28 15:16:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9e68237c-b015-4c63-86c6-292914d00516 tempest-CinderUnicodeTest-538198717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-23c790b4-8fa4-42af-99af-b1804c91d96e.3af67540-3ba6-4fa2-b39d-6fac8d4f85a8" returned: 0 in 0.433s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:29 devstack sudo[108396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:29 devstack sudo[108392]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:29 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9e68237c-b015-4c63-86c6-292914d00516 tempest-CinderUnicodeTest-538198717 None] Lock "cinder-quobyte-3af67540-3ba6-4fa2-b39d-6fac8d4f85a8" released by "_delete_snapshot" :: held 2.317s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-55e8a57e-f2d7-47b4-b8d9-22cc8382096c tempest-CreateVolumesFromSourceVolumeTest-927595281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6a6b7471-8eca-4ecc-b80a-3eee1a06d453" returned: 0 in 0.562s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-55e8a57e-f2d7-47b4-b8d9-22cc8382096c tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6a6b7471-8eca-4ecc-b80a-3eee1a06d453 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:29 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9e68237c-b015-4c63-86c6-292914d00516 tempest-CinderUnicodeTest-538198717 None] Lock "cinder-quobyte-23c790b4-8fa4-42af-99af-b1804c91d96e" released by "delete_snapshot" :: held 2.368s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:29 devstack sudo[108402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6a6b7471-8eca-4ecc-b80a-3eee1a06d453 Sep 28 15:16:29 devstack sudo[108402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:29 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-9e68237c-b015-4c63-86c6-292914d00516 tempest-CinderUnicodeTest-538198717 None] Created reservations ['1f23da15-7a4f-4aa3-a568-6e855096e24a', 'e958d590-c253-4f05-9e6b-bca29deaa226', 'c624929f-77a1-4c52-88b8-dc4ce8083543', 'dcaed2cd-0bd2-463c-98b2-1d62f15b0bd6'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:16:29 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-9e68237c-b015-4c63-86c6-292914d00516 tempest-CinderUnicodeTest-538198717 None] Delete snapshot completed successfully. Sep 28 15:16:29 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9e68237c-b015-4c63-86c6-292914d00516 tempest-CinderUnicodeTest-538198717 None] Lock "cinder-3af67540-3ba6-4fa2-b39d-6fac8d4f85a8-delete_snapshot" released by "delete_snapshot" :: held 2.610s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:29 devstack sudo[108396]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7cbbeb13-b162-4f4e-aa46-a02904b402e8 tempest-ProjectReaderTests-201161066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-137fcec7-5ad9-422a-859a-997bd9c750de" returned: 0 in 0.474s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7cbbeb13-b162-4f4e-aa46-a02904b402e8 tempest-ProjectReaderTests-201161066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-137fcec7-5ad9-422a-859a-997bd9c750de {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:29 devstack sudo[108407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-137fcec7-5ad9-422a-859a-997bd9c750de Sep 28 15:16:29 devstack sudo[108407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:29 devstack sudo[108402]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-55e8a57e-f2d7-47b4-b8d9-22cc8382096c tempest-CreateVolumesFromSourceVolumeTest-927595281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6a6b7471-8eca-4ecc-b80a-3eee1a06d453" returned: 0 in 0.357s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:29 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-55e8a57e-f2d7-47b4-b8d9-22cc8382096c tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Lock "cinder-quobyte-6a6b7471-8eca-4ecc-b80a-3eee1a06d453" released by "delete_volume" :: held 1.003s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:29 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-55e8a57e-f2d7-47b4-b8d9-22cc8382096c tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Created reservations ['a7616858-4517-4095-ba3a-92b50e73f1f3', '06b07ca1-e675-4b20-8647-65d198f75b19', '384b2a84-ea1d-472b-9520-a2af10fd0eb8', '96bf6a3e-d7fa-4718-a4e9-3a06e313316e'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:16:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-55e8a57e-f2d7-47b4-b8d9-22cc8382096c tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-55e8a57e-f2d7-47b4-b8d9-22cc8382096c tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-55e8a57e-f2d7-47b4-b8d9-22cc8382096c tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-55e8a57e-f2d7-47b4-b8d9-22cc8382096c tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-55e8a57e-f2d7-47b4-b8d9-22cc8382096c tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-55e8a57e-f2d7-47b4-b8d9-22cc8382096c tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:30 devstack sudo[108411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:16:30 devstack sudo[108411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:30 devstack sudo[108407]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7cbbeb13-b162-4f4e-aa46-a02904b402e8 tempest-ProjectReaderTests-201161066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-137fcec7-5ad9-422a-859a-997bd9c750de" returned: 0 in 0.395s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7cbbeb13-b162-4f4e-aa46-a02904b402e8 tempest-ProjectReaderTests-201161066 None] Lock "cinder-quobyte-137fcec7-5ad9-422a-859a-997bd9c750de" released by "delete_volume" :: held 0.941s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:30 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-88d9d530-7731-4aa6-aa9b-9fa9f6248028 tempest-ProjectMemberTests-293722149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:16:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-88d9d530-7731-4aa6-aa9b-9fa9f6248028 tempest-ProjectMemberTests-293722149 None] Flow 'volume_create_manager' (ed10b3b2-f859-4ad3-9d98-98f1757673f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-88d9d530-7731-4aa6-aa9b-9fa9f6248028 tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (562819e1-6133-4c49-a946-6973fce05af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-88d9d530-7731-4aa6-aa9b-9fa9f6248028 tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (562819e1-6133-4c49-a946-6973fce05af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1104504849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebc70068-0f22-4cae-ad45-92a7d13f3766,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd1cca6dd0284a7c863af0b50e63e06b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:30Z,use_quota=True,user_id='f79e6dc0ec9740e0ab12c9a6bf177496',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-88d9d530-7731-4aa6-aa9b-9fa9f6248028 tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (310ca8c1-75f7-48e0-967c-1039eca31d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-88d9d530-7731-4aa6-aa9b-9fa9f6248028 tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (310ca8c1-75f7-48e0-967c-1039eca31d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-88d9d530-7731-4aa6-aa9b-9fa9f6248028 tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (748190af-e0e3-4136-9ad6-52597c602384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-88d9d530-7731-4aa6-aa9b-9fa9f6248028 tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (748190af-e0e3-4136-9ad6-52597c602384) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebc70068-0f22-4cae-ad45-92a7d13f3766', 'volume_name': 'volume-ebc70068-0f22-4cae-ad45-92a7d13f3766', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-88d9d530-7731-4aa6-aa9b-9fa9f6248028 tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41a09ae0-e6eb-41c2-8863-1fc7ad20a983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-88d9d530-7731-4aa6-aa9b-9fa9f6248028 tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41a09ae0-e6eb-41c2-8863-1fc7ad20a983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-88d9d530-7731-4aa6-aa9b-9fa9f6248028 tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54ec1261-5c20-4c79-906d-3cf3184964f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:30 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-88d9d530-7731-4aa6-aa9b-9fa9f6248028 tempest-ProjectMemberTests-293722149 None] Volume ebc70068-0f22-4cae-ad45-92a7d13f3766: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebc70068-0f22-4cae-ad45-92a7d13f3766', 'volume_size': 1} Sep 28 15:16:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-88d9d530-7731-4aa6-aa9b-9fa9f6248028 tempest-ProjectMemberTests-293722149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-88d9d530-7731-4aa6-aa9b-9fa9f6248028 tempest-ProjectMemberTests-293722149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-88d9d530-7731-4aa6-aa9b-9fa9f6248028 tempest-ProjectMemberTests-293722149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1104504849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebc70068-0f22-4cae-ad45-92a7d13f3766,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd1cca6dd0284a7c863af0b50e63e06b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:30Z,use_quota=True,user_id='f79e6dc0ec9740e0ab12c9a6bf177496',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:16:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-88d9d530-7731-4aa6-aa9b-9fa9f6248028 tempest-ProjectMemberTests-293722149 None] Creating volume ebc70068-0f22-4cae-ad45-92a7d13f3766 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:16:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-88d9d530-7731-4aa6-aa9b-9fa9f6248028 tempest-ProjectMemberTests-293722149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-88d9d530-7731-4aa6-aa9b-9fa9f6248028 tempest-ProjectMemberTests-293722149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-88d9d530-7731-4aa6-aa9b-9fa9f6248028 tempest-ProjectMemberTests-293722149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-88d9d530-7731-4aa6-aa9b-9fa9f6248028 tempest-ProjectMemberTests-293722149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-88d9d530-7731-4aa6-aa9b-9fa9f6248028 tempest-ProjectMemberTests-293722149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-88d9d530-7731-4aa6-aa9b-9fa9f6248028 tempest-ProjectMemberTests-293722149 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:16:30 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-88d9d530-7731-4aa6-aa9b-9fa9f6248028 tempest-ProjectMemberTests-293722149 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:16:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-88d9d530-7731-4aa6-aa9b-9fa9f6248028 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ebc70068-0f22-4cae-ad45-92a7d13f3766 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5202cbd7-15c4-4120-acc5-8dc6c3cce39d tempest-CinderUnicodeTest-538198717 None] Acquiring lock "cinder-23c790b4-8fa4-42af-99af-b1804c91d96e-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:30 devstack sudo[108413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ebc70068-0f22-4cae-ad45-92a7d13f3766 1073741824 Sep 28 15:16:30 devstack sudo[108413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5202cbd7-15c4-4120-acc5-8dc6c3cce39d tempest-CinderUnicodeTest-538198717 None] Lock "cinder-23c790b4-8fa4-42af-99af-b1804c91d96e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:30 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-7cbbeb13-b162-4f4e-aa46-a02904b402e8 tempest-ProjectReaderTests-201161066 None] Created reservations ['f3f7bc26-f716-4081-8126-bf918eaf218d', '44927979-5c86-4a84-8a0f-2cd304956305', '569882a8-390b-4eff-a201-eddfee2fdacb', 'e28aa57c-2400-413d-be7a-0539ee6611ab'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:16:30 devstack sudo[108411]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-55e8a57e-f2d7-47b4-b8d9-22cc8382096c tempest-CreateVolumesFromSourceVolumeTest-927595281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.357s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:30 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-55e8a57e-f2d7-47b4-b8d9-22cc8382096c tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:16:30 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-55e8a57e-f2d7-47b4-b8d9-22cc8382096c tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Deleted volume successfully. Sep 28 15:16:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5202cbd7-15c4-4120-acc5-8dc6c3cce39d tempest-CinderUnicodeTest-538198717 None] Acquiring lock "cinder-quobyte-23c790b4-8fa4-42af-99af-b1804c91d96e" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-55e8a57e-f2d7-47b4-b8d9-22cc8382096c tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Lock "cinder-6a6b7471-8eca-4ecc-b80a-3eee1a06d453-delete_volume" released by "delete_volume" :: held 1.743s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5202cbd7-15c4-4120-acc5-8dc6c3cce39d tempest-CinderUnicodeTest-538198717 None] Lock "cinder-quobyte-23c790b4-8fa4-42af-99af-b1804c91d96e" acquired by "delete_volume" :: waited 0.032s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7cbbeb13-b162-4f4e-aa46-a02904b402e8 tempest-ProjectReaderTests-201161066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7cbbeb13-b162-4f4e-aa46-a02904b402e8 tempest-ProjectReaderTests-201161066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7cbbeb13-b162-4f4e-aa46-a02904b402e8 tempest-ProjectReaderTests-201161066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7cbbeb13-b162-4f4e-aa46-a02904b402e8 tempest-ProjectReaderTests-201161066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7cbbeb13-b162-4f4e-aa46-a02904b402e8 tempest-ProjectReaderTests-201161066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7cbbeb13-b162-4f4e-aa46-a02904b402e8 tempest-ProjectReaderTests-201161066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:30 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c4c861-30d4-4ed2-8240-0226ffcf5303]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5202cbd7-15c4-4120-acc5-8dc6c3cce39d tempest-CinderUnicodeTest-538198717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-23c790b4-8fa4-42af-99af-b1804c91d96e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:30 devstack sudo[108416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:16:30 devstack sudo[108416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:30 devstack sudo[108417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-23c790b4-8fa4-42af-99af-b1804c91d96e Sep 28 15:16:30 devstack sudo[108417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:30 devstack sudo[108416]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7cbbeb13-b162-4f4e-aa46-a02904b402e8 tempest-ProjectReaderTests-201161066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.289s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:30 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-7cbbeb13-b162-4f4e-aa46-a02904b402e8 tempest-ProjectReaderTests-201161066 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:16:30 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-7cbbeb13-b162-4f4e-aa46-a02904b402e8 tempest-ProjectReaderTests-201161066 None] Deleted volume successfully. Sep 28 15:16:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7cbbeb13-b162-4f4e-aa46-a02904b402e8 tempest-ProjectReaderTests-201161066 None] Lock "cinder-137fcec7-5ad9-422a-859a-997bd9c750de-delete_volume" released by "delete_volume" :: held 1.759s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:30 devstack sudo[108413]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-88d9d530-7731-4aa6-aa9b-9fa9f6248028 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ebc70068-0f22-4cae-ad45-92a7d13f3766 1073741824" returned: 0 in 0.624s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-88d9d530-7731-4aa6-aa9b-9fa9f6248028 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ebc70068-0f22-4cae-ad45-92a7d13f3766 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:31 devstack sudo[108425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ebc70068-0f22-4cae-ad45-92a7d13f3766 Sep 28 15:16:31 devstack sudo[108425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:31 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6ed76eac-5083-4cca-8073-f968fc83158b tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Acquiring lock "cinder-bcf9ddf2-6464-41d0-9a8d-278138647fb7-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:31 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6ed76eac-5083-4cca-8073-f968fc83158b tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Lock "cinder-bcf9ddf2-6464-41d0-9a8d-278138647fb7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:31 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6ed76eac-5083-4cca-8073-f968fc83158b tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Acquiring lock "cinder-quobyte-bcf9ddf2-6464-41d0-9a8d-278138647fb7" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:31 devstack sudo[108417]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:31 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6ed76eac-5083-4cca-8073-f968fc83158b tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Lock "cinder-quobyte-bcf9ddf2-6464-41d0-9a8d-278138647fb7" acquired by "delete_volume" :: waited 0.032s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5202cbd7-15c4-4120-acc5-8dc6c3cce39d tempest-CinderUnicodeTest-538198717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-23c790b4-8fa4-42af-99af-b1804c91d96e" returned: 0 in 0.584s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5202cbd7-15c4-4120-acc5-8dc6c3cce39d tempest-CinderUnicodeTest-538198717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-23c790b4-8fa4-42af-99af-b1804c91d96e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:31 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[367fd316-1da7-4bce-b28d-c95235e4b6ba]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6ed76eac-5083-4cca-8073-f968fc83158b tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bcf9ddf2-6464-41d0-9a8d-278138647fb7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:31 devstack sudo[108431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-23c790b4-8fa4-42af-99af-b1804c91d96e Sep 28 15:16:31 devstack sudo[108431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:31 devstack sudo[108432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bcf9ddf2-6464-41d0-9a8d-278138647fb7 Sep 28 15:16:31 devstack sudo[108432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:31 devstack sudo[108425]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-88d9d530-7731-4aa6-aa9b-9fa9f6248028 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ebc70068-0f22-4cae-ad45-92a7d13f3766" returned: 0 in 0.349s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:31 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-88d9d530-7731-4aa6-aa9b-9fa9f6248028 tempest-ProjectMemberTests-293722149 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:16:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-88d9d530-7731-4aa6-aa9b-9fa9f6248028 tempest-ProjectMemberTests-293722149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-88d9d530-7731-4aa6-aa9b-9fa9f6248028 tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54ec1261-5c20-4c79-906d-3cf3184964f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebc70068-0f22-4cae-ad45-92a7d13f3766', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-88d9d530-7731-4aa6-aa9b-9fa9f6248028 tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5b802b9-69e9-4662-b49b-ad5aa7cd231d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:31 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-88d9d530-7731-4aa6-aa9b-9fa9f6248028 tempest-ProjectMemberTests-293722149 None] Volume volume-ebc70068-0f22-4cae-ad45-92a7d13f3766 (ebc70068-0f22-4cae-ad45-92a7d13f3766): created successfully Sep 28 15:16:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-88d9d530-7731-4aa6-aa9b-9fa9f6248028 tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5b802b9-69e9-4662-b49b-ad5aa7cd231d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-88d9d530-7731-4aa6-aa9b-9fa9f6248028 tempest-ProjectMemberTests-293722149 None] Flow 'volume_create_manager' (ed10b3b2-f859-4ad3-9d98-98f1757673f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:31 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-88d9d530-7731-4aa6-aa9b-9fa9f6248028 tempest-ProjectMemberTests-293722149 None] Created volume successfully. Sep 28 15:16:31 devstack sudo[108431]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5202cbd7-15c4-4120-acc5-8dc6c3cce39d tempest-CinderUnicodeTest-538198717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-23c790b4-8fa4-42af-99af-b1804c91d96e" returned: 0 in 0.318s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:31 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5202cbd7-15c4-4120-acc5-8dc6c3cce39d tempest-CinderUnicodeTest-538198717 None] Lock "cinder-quobyte-23c790b4-8fa4-42af-99af-b1804c91d96e" released by "delete_volume" :: held 1.013s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:31 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-5202cbd7-15c4-4120-acc5-8dc6c3cce39d tempest-CinderUnicodeTest-538198717 None] Created reservations ['d6230021-d655-4de5-9f98-28f49aeeb814', 'b6c4680a-9f72-45de-a549-cf2ef5bcb6bf', '1761c93d-380d-48a6-a2d0-bdfaba30be89', '78b10b17-d184-4b92-b01d-b2a86394fad0'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:16:31 devstack sudo[108432]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6ed76eac-5083-4cca-8073-f968fc83158b tempest-CreateVolumesFromSourceVolumeTest-927595281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bcf9ddf2-6464-41d0-9a8d-278138647fb7" returned: 0 in 0.486s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6ed76eac-5083-4cca-8073-f968fc83158b tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bcf9ddf2-6464-41d0-9a8d-278138647fb7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5202cbd7-15c4-4120-acc5-8dc6c3cce39d tempest-CinderUnicodeTest-538198717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5202cbd7-15c4-4120-acc5-8dc6c3cce39d tempest-CinderUnicodeTest-538198717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:31 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5202cbd7-15c4-4120-acc5-8dc6c3cce39d tempest-CinderUnicodeTest-538198717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:31 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5202cbd7-15c4-4120-acc5-8dc6c3cce39d tempest-CinderUnicodeTest-538198717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5202cbd7-15c4-4120-acc5-8dc6c3cce39d tempest-CinderUnicodeTest-538198717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5202cbd7-15c4-4120-acc5-8dc6c3cce39d tempest-CinderUnicodeTest-538198717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:31 devstack sudo[108441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bcf9ddf2-6464-41d0-9a8d-278138647fb7 Sep 28 15:16:31 devstack sudo[108441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:31 devstack sudo[108442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:16:31 devstack sudo[108442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:31 devstack sudo[108441]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6ed76eac-5083-4cca-8073-f968fc83158b tempest-CreateVolumesFromSourceVolumeTest-927595281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bcf9ddf2-6464-41d0-9a8d-278138647fb7" returned: 0 in 0.324s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:32 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6ed76eac-5083-4cca-8073-f968fc83158b tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Lock "cinder-quobyte-bcf9ddf2-6464-41d0-9a8d-278138647fb7" released by "delete_volume" :: held 0.867s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:32 devstack sudo[108442]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5202cbd7-15c4-4120-acc5-8dc6c3cce39d tempest-CinderUnicodeTest-538198717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.329s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:32 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-5202cbd7-15c4-4120-acc5-8dc6c3cce39d tempest-CinderUnicodeTest-538198717 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:16:32 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-5202cbd7-15c4-4120-acc5-8dc6c3cce39d tempest-CinderUnicodeTest-538198717 None] Deleted volume successfully. Sep 28 15:16:32 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5202cbd7-15c4-4120-acc5-8dc6c3cce39d tempest-CinderUnicodeTest-538198717 None] Lock "cinder-23c790b4-8fa4-42af-99af-b1804c91d96e-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:32 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-6ed76eac-5083-4cca-8073-f968fc83158b tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Created reservations ['13cfb7bd-3b80-4a3e-8331-11b31e0f9bf7', '3a6704a2-148a-4474-b86d-4cd58673b3f6', '299495ce-3a0b-406b-90bb-3ffe7f7f2a9d', 'd4449630-d67c-45a7-bf24-d59b65090f56'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:16:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6ed76eac-5083-4cca-8073-f968fc83158b tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6ed76eac-5083-4cca-8073-f968fc83158b tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:32 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-6ed76eac-5083-4cca-8073-f968fc83158b tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:32 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-6ed76eac-5083-4cca-8073-f968fc83158b tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6ed76eac-5083-4cca-8073-f968fc83158b tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6ed76eac-5083-4cca-8073-f968fc83158b tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:32 devstack sudo[108447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:16:32 devstack sudo[108447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:32 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-089042df-7a02-4bfb-b14c-8c40e719749f tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Acquiring lock "cinder-55b0b44a-d12f-43da-b9cf-62e334ad7381-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:32 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-089042df-7a02-4bfb-b14c-8c40e719749f tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Lock "cinder-55b0b44a-d12f-43da-b9cf-62e334ad7381-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:32 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-089042df-7a02-4bfb-b14c-8c40e719749f tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Acquiring lock "cinder-quobyte-55b0b44a-d12f-43da-b9cf-62e334ad7381" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:32 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-089042df-7a02-4bfb-b14c-8c40e719749f tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Lock "cinder-quobyte-55b0b44a-d12f-43da-b9cf-62e334ad7381" acquired by "delete_volume" :: waited 0.023s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:32 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[65691b85-a928-45fb-9dc2-23da0eccc80a]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-089042df-7a02-4bfb-b14c-8c40e719749f tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-55b0b44a-d12f-43da-b9cf-62e334ad7381 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:32 devstack sudo[108447]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:32 devstack sudo[108449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-55b0b44a-d12f-43da-b9cf-62e334ad7381 Sep 28 15:16:32 devstack sudo[108449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6ed76eac-5083-4cca-8073-f968fc83158b tempest-CreateVolumesFromSourceVolumeTest-927595281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.426s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:32 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-6ed76eac-5083-4cca-8073-f968fc83158b tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:16:32 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-6ed76eac-5083-4cca-8073-f968fc83158b tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Deleted volume successfully. Sep 28 15:16:32 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6ed76eac-5083-4cca-8073-f968fc83158b tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Lock "cinder-bcf9ddf2-6464-41d0-9a8d-278138647fb7-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:32 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6f5a02a9-5469-4d1d-9e65-3d7c510c452d tempest-CinderUnicodeTest-538198717 None] Acquiring lock "cinder-4573fff3-9f2a-409a-8a93-9ca20983f8a1-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:32 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6f5a02a9-5469-4d1d-9e65-3d7c510c452d tempest-CinderUnicodeTest-538198717 None] Lock "cinder-4573fff3-9f2a-409a-8a93-9ca20983f8a1-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:32 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6f5a02a9-5469-4d1d-9e65-3d7c510c452d tempest-CinderUnicodeTest-538198717 None] Acquiring lock "cinder-quobyte-4573fff3-9f2a-409a-8a93-9ca20983f8a1" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:32 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6f5a02a9-5469-4d1d-9e65-3d7c510c452d tempest-CinderUnicodeTest-538198717 None] Lock "cinder-quobyte-4573fff3-9f2a-409a-8a93-9ca20983f8a1" acquired by "delete_volume" :: waited 0.029s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:32 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[782f24fa-42d9-4e01-8f1c-a9064a8d0fa0]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6f5a02a9-5469-4d1d-9e65-3d7c510c452d tempest-CinderUnicodeTest-538198717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4573fff3-9f2a-409a-8a93-9ca20983f8a1 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:33 devstack sudo[108449]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-089042df-7a02-4bfb-b14c-8c40e719749f tempest-CreateVolumesFromSourceVolumeTest-927595281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-55b0b44a-d12f-43da-b9cf-62e334ad7381" returned: 0 in 0.600s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-089042df-7a02-4bfb-b14c-8c40e719749f tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-55b0b44a-d12f-43da-b9cf-62e334ad7381 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:33 devstack sudo[108456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-55b0b44a-d12f-43da-b9cf-62e334ad7381 Sep 28 15:16:33 devstack sudo[108456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:33 devstack sudo[108455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4573fff3-9f2a-409a-8a93-9ca20983f8a1 Sep 28 15:16:33 devstack sudo[108455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dd20f5fd-6cf3-4118-8ebf-8883010fe0d7 tempest-ProjectMemberTests-293722149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dd20f5fd-6cf3-4118-8ebf-8883010fe0d7 tempest-ProjectMemberTests-293722149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:33 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-dd20f5fd-6cf3-4118-8ebf-8883010fe0d7 tempest-ProjectMemberTests-293722149 None] Creating offline snapshot 516d0503-9f48-4482-846e-9e7e87bdc7e8 of volume ebc70068-0f22-4cae-ad45-92a7d13f3766 {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:16:33 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24ca977-bf84-4f96-9f9a-5b338f2bbb5f]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dd20f5fd-6cf3-4118-8ebf-8883010fe0d7 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ebc70068-0f22-4cae-ad45-92a7d13f3766 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:33 devstack sudo[108459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ebc70068-0f22-4cae-ad45-92a7d13f3766 Sep 28 15:16:33 devstack sudo[108459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:33 devstack sudo[108456]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-089042df-7a02-4bfb-b14c-8c40e719749f tempest-CreateVolumesFromSourceVolumeTest-927595281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-55b0b44a-d12f-43da-b9cf-62e334ad7381" returned: 0 in 0.453s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-089042df-7a02-4bfb-b14c-8c40e719749f tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Lock "cinder-quobyte-55b0b44a-d12f-43da-b9cf-62e334ad7381" released by "delete_volume" :: held 1.141s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:33 devstack sudo[108455]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6f5a02a9-5469-4d1d-9e65-3d7c510c452d tempest-CinderUnicodeTest-538198717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4573fff3-9f2a-409a-8a93-9ca20983f8a1" returned: 0 in 0.632s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6f5a02a9-5469-4d1d-9e65-3d7c510c452d tempest-CinderUnicodeTest-538198717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4573fff3-9f2a-409a-8a93-9ca20983f8a1 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:33 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-089042df-7a02-4bfb-b14c-8c40e719749f tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Created reservations ['cfb53ef8-45d7-4236-9883-52a9d64cfd5a', '28c9d8d8-8da2-4ed8-9e19-5fa68e48a680', 'e2536b41-5612-4fa9-b8de-ff79f491bb36', '7fad9c5a-e673-40ca-9a1d-b5939bf3d702'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:16:33 devstack sudo[108471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4573fff3-9f2a-409a-8a93-9ca20983f8a1 Sep 28 15:16:33 devstack sudo[108471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-089042df-7a02-4bfb-b14c-8c40e719749f tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-089042df-7a02-4bfb-b14c-8c40e719749f tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:33 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-089042df-7a02-4bfb-b14c-8c40e719749f tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:33 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-089042df-7a02-4bfb-b14c-8c40e719749f tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-089042df-7a02-4bfb-b14c-8c40e719749f tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-089042df-7a02-4bfb-b14c-8c40e719749f tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:33 devstack sudo[108475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:16:33 devstack sudo[108475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:33 devstack sudo[108459]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dd20f5fd-6cf3-4118-8ebf-8883010fe0d7 tempest-ProjectMemberTests-293722149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ebc70068-0f22-4cae-ad45-92a7d13f3766" returned: 0 in 0.590s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dd20f5fd-6cf3-4118-8ebf-8883010fe0d7 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ebc70068-0f22-4cae-ad45-92a7d13f3766,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ebc70068-0f22-4cae-ad45-92a7d13f3766.516d0503-9f48-4482-846e-9e7e87bdc7e8 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:33 devstack sudo[108478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ebc70068-0f22-4cae-ad45-92a7d13f3766,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ebc70068-0f22-4cae-ad45-92a7d13f3766.516d0503-9f48-4482-846e-9e7e87bdc7e8 1G Sep 28 15:16:33 devstack sudo[108478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:34 devstack sudo[108471]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6f5a02a9-5469-4d1d-9e65-3d7c510c452d tempest-CinderUnicodeTest-538198717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-4573fff3-9f2a-409a-8a93-9ca20983f8a1" returned: 0 in 0.444s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:34 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6f5a02a9-5469-4d1d-9e65-3d7c510c452d tempest-CinderUnicodeTest-538198717 None] Lock "cinder-quobyte-4573fff3-9f2a-409a-8a93-9ca20983f8a1" released by "delete_volume" :: held 1.144s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:34 devstack sudo[108475]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:34 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-6f5a02a9-5469-4d1d-9e65-3d7c510c452d tempest-CinderUnicodeTest-538198717 None] Created reservations ['de0be966-adf4-4cd9-93d8-fac50c5e8eea', 'a827f993-30eb-4dfe-92b9-8c2f55d06772', 'f07a85f5-f4cc-4350-931e-2a5ed25e2c10', '390a72aa-b6ac-4a11-bdb7-3082f94d35d7'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:16:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-089042df-7a02-4bfb-b14c-8c40e719749f tempest-CreateVolumesFromSourceVolumeTest-927595281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.394s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:34 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-089042df-7a02-4bfb-b14c-8c40e719749f tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:16:34 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-089042df-7a02-4bfb-b14c-8c40e719749f tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Deleted volume successfully. Sep 28 15:16:34 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-089042df-7a02-4bfb-b14c-8c40e719749f tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Lock "cinder-55b0b44a-d12f-43da-b9cf-62e334ad7381-delete_volume" released by "delete_volume" :: held 1.894s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6f5a02a9-5469-4d1d-9e65-3d7c510c452d tempest-CinderUnicodeTest-538198717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6f5a02a9-5469-4d1d-9e65-3d7c510c452d tempest-CinderUnicodeTest-538198717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:34 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-6f5a02a9-5469-4d1d-9e65-3d7c510c452d tempest-CinderUnicodeTest-538198717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:34 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-6f5a02a9-5469-4d1d-9e65-3d7c510c452d tempest-CinderUnicodeTest-538198717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6f5a02a9-5469-4d1d-9e65-3d7c510c452d tempest-CinderUnicodeTest-538198717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6f5a02a9-5469-4d1d-9e65-3d7c510c452d tempest-CinderUnicodeTest-538198717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:34 devstack sudo[108484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:16:34 devstack sudo[108484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:34 devstack sudo[108478]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dd20f5fd-6cf3-4118-8ebf-8883010fe0d7 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ebc70068-0f22-4cae-ad45-92a7d13f3766,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ebc70068-0f22-4cae-ad45-92a7d13f3766.516d0503-9f48-4482-846e-9e7e87bdc7e8 1G" returned: 0 in 0.746s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dd20f5fd-6cf3-4118-8ebf-8883010fe0d7 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebc70068-0f22-4cae-ad45-92a7d13f3766 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ebc70068-0f22-4cae-ad45-92a7d13f3766.516d0503-9f48-4482-846e-9e7e87bdc7e8 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:34 devstack sudo[108484]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:34 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-735440b5-ad42-43c1-a9c5-afa4e253b5ab tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Acquiring lock "cinder-890f16d4-4391-4924-8c1d-82a3041b8700-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:34 devstack sudo[108488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebc70068-0f22-4cae-ad45-92a7d13f3766 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ebc70068-0f22-4cae-ad45-92a7d13f3766.516d0503-9f48-4482-846e-9e7e87bdc7e8 Sep 28 15:16:34 devstack sudo[108488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6f5a02a9-5469-4d1d-9e65-3d7c510c452d tempest-CinderUnicodeTest-538198717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.394s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:34 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-6f5a02a9-5469-4d1d-9e65-3d7c510c452d tempest-CinderUnicodeTest-538198717 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:16:34 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-6f5a02a9-5469-4d1d-9e65-3d7c510c452d tempest-CinderUnicodeTest-538198717 None] Deleted volume successfully. Sep 28 15:16:34 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-735440b5-ad42-43c1-a9c5-afa4e253b5ab tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Lock "cinder-890f16d4-4391-4924-8c1d-82a3041b8700-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:34 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6f5a02a9-5469-4d1d-9e65-3d7c510c452d tempest-CinderUnicodeTest-538198717 None] Lock "cinder-4573fff3-9f2a-409a-8a93-9ca20983f8a1-delete_volume" released by "delete_volume" :: held 1.923s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:34 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-735440b5-ad42-43c1-a9c5-afa4e253b5ab tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Acquiring lock "cinder-quobyte-890f16d4-4391-4924-8c1d-82a3041b8700" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:34 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-735440b5-ad42-43c1-a9c5-afa4e253b5ab tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Lock "cinder-quobyte-890f16d4-4391-4924-8c1d-82a3041b8700" acquired by "delete_volume" :: waited 0.013s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:34 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0caa0c1-0e9a-4fba-96fd-a275ede37541]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-735440b5-ad42-43c1-a9c5-afa4e253b5ab tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-890f16d4-4391-4924-8c1d-82a3041b8700 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:34 devstack sudo[108490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-890f16d4-4391-4924-8c1d-82a3041b8700 Sep 28 15:16:34 devstack sudo[108490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:34 devstack sudo[108488]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dd20f5fd-6cf3-4118-8ebf-8883010fe0d7 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebc70068-0f22-4cae-ad45-92a7d13f3766 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ebc70068-0f22-4cae-ad45-92a7d13f3766.516d0503-9f48-4482-846e-9e7e87bdc7e8" returned: 0 in 0.347s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:34 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-dd20f5fd-6cf3-4118-8ebf-8883010fe0d7 tempest-ProjectMemberTests-293722149 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ebc70068-0f22-4cae-ad45-92a7d13f3766.516d0503-9f48-4482-846e-9e7e87bdc7e8 is being set with open permissions: ugo+rw Sep 28 15:16:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dd20f5fd-6cf3-4118-8ebf-8883010fe0d7 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ebc70068-0f22-4cae-ad45-92a7d13f3766.516d0503-9f48-4482-846e-9e7e87bdc7e8 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:35 devstack sudo[108495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ebc70068-0f22-4cae-ad45-92a7d13f3766.516d0503-9f48-4482-846e-9e7e87bdc7e8 Sep 28 15:16:35 devstack sudo[108495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:35 devstack sudo[108490]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-735440b5-ad42-43c1-a9c5-afa4e253b5ab tempest-CreateVolumesFromSourceVolumeTest-927595281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-890f16d4-4391-4924-8c1d-82a3041b8700" returned: 0 in 0.426s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-735440b5-ad42-43c1-a9c5-afa4e253b5ab tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-890f16d4-4391-4924-8c1d-82a3041b8700 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:35 devstack sudo[108501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-890f16d4-4391-4924-8c1d-82a3041b8700 Sep 28 15:16:35 devstack sudo[108501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:35 devstack sudo[108495]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dd20f5fd-6cf3-4118-8ebf-8883010fe0d7 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ebc70068-0f22-4cae-ad45-92a7d13f3766.516d0503-9f48-4482-846e-9e7e87bdc7e8" returned: 0 in 0.336s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dd20f5fd-6cf3-4118-8ebf-8883010fe0d7 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ebc70068-0f22-4cae-ad45-92a7d13f3766.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:35 devstack sudo[108504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ebc70068-0f22-4cae-ad45-92a7d13f3766.info Sep 28 15:16:35 devstack sudo[108504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:35 devstack sudo[108501]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-735440b5-ad42-43c1-a9c5-afa4e253b5ab tempest-CreateVolumesFromSourceVolumeTest-927595281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-890f16d4-4391-4924-8c1d-82a3041b8700" returned: 0 in 0.397s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:35 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-735440b5-ad42-43c1-a9c5-afa4e253b5ab tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Lock "cinder-quobyte-890f16d4-4391-4924-8c1d-82a3041b8700" released by "delete_volume" :: held 0.891s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:35 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-735440b5-ad42-43c1-a9c5-afa4e253b5ab tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Created reservations ['819146c6-2ed4-45fe-8e3e-097c8eca6580', '76491bde-ed9c-4edf-94e7-e396a2d02c09', '058afcfd-b3ed-4a91-a38d-844804dc7304', '276078f6-9376-4112-bb39-d6b3f10b1f0d'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:16:35 devstack sudo[108504]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dd20f5fd-6cf3-4118-8ebf-8883010fe0d7 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ebc70068-0f22-4cae-ad45-92a7d13f3766.info" returned: 0 in 0.379s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:35 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-dd20f5fd-6cf3-4118-8ebf-8883010fe0d7 tempest-ProjectMemberTests-293722149 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ebc70068-0f22-4cae-ad45-92a7d13f3766.info is being set with open permissions: ugo+rw Sep 28 15:16:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dd20f5fd-6cf3-4118-8ebf-8883010fe0d7 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ebc70068-0f22-4cae-ad45-92a7d13f3766.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:35 devstack sudo[108508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ebc70068-0f22-4cae-ad45-92a7d13f3766.info Sep 28 15:16:35 devstack sudo[108508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-735440b5-ad42-43c1-a9c5-afa4e253b5ab tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-735440b5-ad42-43c1-a9c5-afa4e253b5ab tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-735440b5-ad42-43c1-a9c5-afa4e253b5ab tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-735440b5-ad42-43c1-a9c5-afa4e253b5ab tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-735440b5-ad42-43c1-a9c5-afa4e253b5ab tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-735440b5-ad42-43c1-a9c5-afa4e253b5ab tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:35 devstack sudo[108510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:16:35 devstack sudo[108510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:36 devstack sudo[108508]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:36 devstack sudo[108510]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dd20f5fd-6cf3-4118-8ebf-8883010fe0d7 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ebc70068-0f22-4cae-ad45-92a7d13f3766.info" returned: 0 in 0.669s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dd20f5fd-6cf3-4118-8ebf-8883010fe0d7 tempest-ProjectMemberTests-293722149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.221s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-735440b5-ad42-43c1-a9c5-afa4e253b5ab tempest-CreateVolumesFromSourceVolumeTest-927595281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.522s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:36 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-735440b5-ad42-43c1-a9c5-afa4e253b5ab tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:16:36 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-735440b5-ad42-43c1-a9c5-afa4e253b5ab tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Deleted volume successfully. Sep 28 15:16:36 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-dd20f5fd-6cf3-4118-8ebf-8883010fe0d7 tempest-ProjectMemberTests-293722149 None] Create snapshot completed successfully Sep 28 15:16:36 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-735440b5-ad42-43c1-a9c5-afa4e253b5ab tempest-CreateVolumesFromSourceVolumeTest-927595281 None] Lock "cinder-890f16d4-4391-4924-8c1d-82a3041b8700-delete_volume" released by "delete_volume" :: held 1.834s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:37 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f0388576-75cd-4873-8e89-1669fed13842 tempest-ProjectMemberTests-293722149 None] Acquiring lock "cinder-516d0503-9f48-4482-846e-9e7e87bdc7e8-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:37 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f0388576-75cd-4873-8e89-1669fed13842 tempest-ProjectMemberTests-293722149 None] Lock "cinder-516d0503-9f48-4482-846e-9e7e87bdc7e8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:37 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f0388576-75cd-4873-8e89-1669fed13842 tempest-ProjectMemberTests-293722149 None] Acquiring lock "cinder-quobyte-ebc70068-0f22-4cae-ad45-92a7d13f3766" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:37 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f0388576-75cd-4873-8e89-1669fed13842 tempest-ProjectMemberTests-293722149 None] Lock "cinder-quobyte-ebc70068-0f22-4cae-ad45-92a7d13f3766" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:37 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f0388576-75cd-4873-8e89-1669fed13842 tempest-ProjectMemberTests-293722149 None] Acquiring lock "cinder-quobyte-516d0503-9f48-4482-846e-9e7e87bdc7e8" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:37 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f0388576-75cd-4873-8e89-1669fed13842 tempest-ProjectMemberTests-293722149 None] Lock "cinder-quobyte-516d0503-9f48-4482-846e-9e7e87bdc7e8" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:37 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-f0388576-75cd-4873-8e89-1669fed13842 tempest-ProjectMemberTests-293722149 None] Deleting offline snapshot 516d0503-9f48-4482-846e-9e7e87bdc7e8 of volume ebc70068-0f22-4cae-ad45-92a7d13f3766 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:16:37 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-f0388576-75cd-4873-8e89-1669fed13842 tempest-ProjectMemberTests-293722149 None] snapshot_file for this snap is: volume-ebc70068-0f22-4cae-ad45-92a7d13f3766.516d0503-9f48-4482-846e-9e7e87bdc7e8 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:16:37 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[4247beb6-ac60-4350-9e10-c52867b20880]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f0388576-75cd-4873-8e89-1669fed13842 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ebc70068-0f22-4cae-ad45-92a7d13f3766.516d0503-9f48-4482-846e-9e7e87bdc7e8 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:37 devstack sudo[108514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ebc70068-0f22-4cae-ad45-92a7d13f3766.516d0503-9f48-4482-846e-9e7e87bdc7e8 Sep 28 15:16:37 devstack sudo[108514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:38 devstack sudo[108514]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f0388576-75cd-4873-8e89-1669fed13842 tempest-ProjectMemberTests-293722149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ebc70068-0f22-4cae-ad45-92a7d13f3766.516d0503-9f48-4482-846e-9e7e87bdc7e8" returned: 0 in 0.642s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:38 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-f0388576-75cd-4873-8e89-1669fed13842 tempest-ProjectMemberTests-293722149 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebc70068-0f22-4cae-ad45-92a7d13f3766(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:16:38 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf1cb36-a941-4260-a7b3-4f2f3a42cdf1]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f0388576-75cd-4873-8e89-1669fed13842 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ebc70068-0f22-4cae-ad45-92a7d13f3766 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:38 devstack sudo[108520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ebc70068-0f22-4cae-ad45-92a7d13f3766 Sep 28 15:16:38 devstack sudo[108520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:39 devstack sudo[108520]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f0388576-75cd-4873-8e89-1669fed13842 tempest-ProjectMemberTests-293722149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ebc70068-0f22-4cae-ad45-92a7d13f3766" returned: 0 in 0.691s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f0388576-75cd-4873-8e89-1669fed13842 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ebc70068-0f22-4cae-ad45-92a7d13f3766.516d0503-9f48-4482-846e-9e7e87bdc7e8 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:39 devstack sudo[108525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ebc70068-0f22-4cae-ad45-92a7d13f3766.516d0503-9f48-4482-846e-9e7e87bdc7e8 Sep 28 15:16:39 devstack sudo[108525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:39 devstack sudo[108525]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f0388576-75cd-4873-8e89-1669fed13842 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ebc70068-0f22-4cae-ad45-92a7d13f3766.516d0503-9f48-4482-846e-9e7e87bdc7e8" returned: 0 in 0.495s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f0388576-75cd-4873-8e89-1669fed13842 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ebc70068-0f22-4cae-ad45-92a7d13f3766.516d0503-9f48-4482-846e-9e7e87bdc7e8 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:39 devstack sudo[108531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ebc70068-0f22-4cae-ad45-92a7d13f3766.516d0503-9f48-4482-846e-9e7e87bdc7e8 Sep 28 15:16:39 devstack sudo[108531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:39 devstack sudo[108531]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f0388576-75cd-4873-8e89-1669fed13842 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ebc70068-0f22-4cae-ad45-92a7d13f3766.516d0503-9f48-4482-846e-9e7e87bdc7e8" returned: 0 in 0.448s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:40 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f0388576-75cd-4873-8e89-1669fed13842 tempest-ProjectMemberTests-293722149 None] Lock "cinder-quobyte-516d0503-9f48-4482-846e-9e7e87bdc7e8" released by "_delete_snapshot" :: held 2.483s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:40 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f0388576-75cd-4873-8e89-1669fed13842 tempest-ProjectMemberTests-293722149 None] Lock "cinder-quobyte-ebc70068-0f22-4cae-ad45-92a7d13f3766" released by "delete_snapshot" :: held 2.514s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:40 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-f0388576-75cd-4873-8e89-1669fed13842 tempest-ProjectMemberTests-293722149 None] Created reservations ['5e6308d3-f472-4a01-b27a-e9f551b4b8be', '3c988e24-1a65-40ec-9a46-19c7cfd8ed27', 'bb3f8ee4-e340-4c70-8ef8-da7f20b20fee', '9c57e393-5dd9-4488-b3fe-83c9a12d44e4'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:16:40 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-f0388576-75cd-4873-8e89-1669fed13842 tempest-ProjectMemberTests-293722149 None] Delete snapshot completed successfully. Sep 28 15:16:40 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f0388576-75cd-4873-8e89-1669fed13842 tempest-ProjectMemberTests-293722149 None] Lock "cinder-516d0503-9f48-4482-846e-9e7e87bdc7e8-delete_snapshot" released by "delete_snapshot" :: held 2.721s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:40 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-da9ee1bd-fd1a-46db-92b5-9d815ad5646c tempest-ProjectMemberTests-293722149 None] Acquiring lock "cinder-ebc70068-0f22-4cae-ad45-92a7d13f3766-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:40 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-da9ee1bd-fd1a-46db-92b5-9d815ad5646c tempest-ProjectMemberTests-293722149 None] Lock "cinder-ebc70068-0f22-4cae-ad45-92a7d13f3766-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-da9ee1bd-fd1a-46db-92b5-9d815ad5646c tempest-ProjectMemberTests-293722149 None] Acquiring lock "cinder-quobyte-ebc70068-0f22-4cae-ad45-92a7d13f3766" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-da9ee1bd-fd1a-46db-92b5-9d815ad5646c tempest-ProjectMemberTests-293722149 None] Lock "cinder-quobyte-ebc70068-0f22-4cae-ad45-92a7d13f3766" acquired by "delete_volume" :: waited 0.036s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:41 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cef355b-0dcc-44ac-aab2-19ae7f7122ef]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-da9ee1bd-fd1a-46db-92b5-9d815ad5646c tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ebc70068-0f22-4cae-ad45-92a7d13f3766 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:41 devstack sudo[108534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ebc70068-0f22-4cae-ad45-92a7d13f3766 Sep 28 15:16:41 devstack sudo[108534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:41 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-29d29986-5cba-4d86-b1c4-bbc8419df006 tempest-VolumeDependencyTests-248422175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:16:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-29d29986-5cba-4d86-b1c4-bbc8419df006 tempest-VolumeDependencyTests-248422175 None] Flow 'volume_create_manager' (cdf5e780-f9a1-4f99-af89-8dc5f1818148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-29d29986-5cba-4d86-b1c4-bbc8419df006 tempest-VolumeDependencyTests-248422175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10228d79-b73d-4c55-b322-4ea5a53dcd42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-29d29986-5cba-4d86-b1c4-bbc8419df006 tempest-VolumeDependencyTests-248422175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10228d79-b73d-4c55-b322-4ea5a53dcd42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1320865504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bff27e0c-cfaa-4914-bd40-6032597d92da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d842602f5c04663a218f25851b47aa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:41Z,use_quota=True,user_id='b54d9999fabe434d8a5e0c30751191ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-29d29986-5cba-4d86-b1c4-bbc8419df006 tempest-VolumeDependencyTests-248422175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19d64109-db05-4713-9cb7-9f8f57e08f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-29d29986-5cba-4d86-b1c4-bbc8419df006 tempest-VolumeDependencyTests-248422175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19d64109-db05-4713-9cb7-9f8f57e08f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-29d29986-5cba-4d86-b1c4-bbc8419df006 tempest-VolumeDependencyTests-248422175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76510de6-8f42-4f4c-a768-fb3175563f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-29d29986-5cba-4d86-b1c4-bbc8419df006 tempest-VolumeDependencyTests-248422175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76510de6-8f42-4f4c-a768-fb3175563f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bff27e0c-cfaa-4914-bd40-6032597d92da', 'volume_name': 'volume-bff27e0c-cfaa-4914-bd40-6032597d92da', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-29d29986-5cba-4d86-b1c4-bbc8419df006 tempest-VolumeDependencyTests-248422175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b25364b8-eb20-4d09-823e-3d9a6547e3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-29d29986-5cba-4d86-b1c4-bbc8419df006 tempest-VolumeDependencyTests-248422175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b25364b8-eb20-4d09-823e-3d9a6547e3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-29d29986-5cba-4d86-b1c4-bbc8419df006 tempest-VolumeDependencyTests-248422175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d984447-2993-45fe-9c93-99832566ee41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:41 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-29d29986-5cba-4d86-b1c4-bbc8419df006 tempest-VolumeDependencyTests-248422175 None] Volume bff27e0c-cfaa-4914-bd40-6032597d92da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bff27e0c-cfaa-4914-bd40-6032597d92da', 'volume_size': 1} Sep 28 15:16:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-29d29986-5cba-4d86-b1c4-bbc8419df006 tempest-VolumeDependencyTests-248422175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-29d29986-5cba-4d86-b1c4-bbc8419df006 tempest-VolumeDependencyTests-248422175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:41 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-29d29986-5cba-4d86-b1c4-bbc8419df006 tempest-VolumeDependencyTests-248422175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1320865504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bff27e0c-cfaa-4914-bd40-6032597d92da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d842602f5c04663a218f25851b47aa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:41Z,use_quota=True,user_id='b54d9999fabe434d8a5e0c30751191ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:16:41 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-29d29986-5cba-4d86-b1c4-bbc8419df006 tempest-VolumeDependencyTests-248422175 None] Creating volume bff27e0c-cfaa-4914-bd40-6032597d92da {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:16:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-29d29986-5cba-4d86-b1c4-bbc8419df006 tempest-VolumeDependencyTests-248422175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-29d29986-5cba-4d86-b1c4-bbc8419df006 tempest-VolumeDependencyTests-248422175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:41 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-29d29986-5cba-4d86-b1c4-bbc8419df006 tempest-VolumeDependencyTests-248422175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:41 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-29d29986-5cba-4d86-b1c4-bbc8419df006 tempest-VolumeDependencyTests-248422175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-29d29986-5cba-4d86-b1c4-bbc8419df006 tempest-VolumeDependencyTests-248422175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:41 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-29d29986-5cba-4d86-b1c4-bbc8419df006 tempest-VolumeDependencyTests-248422175 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:16:41 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-29d29986-5cba-4d86-b1c4-bbc8419df006 tempest-VolumeDependencyTests-248422175 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:16:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-29d29986-5cba-4d86-b1c4-bbc8419df006 tempest-VolumeDependencyTests-248422175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bff27e0c-cfaa-4914-bd40-6032597d92da 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:41 devstack sudo[108537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bff27e0c-cfaa-4914-bd40-6032597d92da 1073741824 Sep 28 15:16:41 devstack sudo[108537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:41 devstack sudo[108534]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-da9ee1bd-fd1a-46db-92b5-9d815ad5646c tempest-ProjectMemberTests-293722149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ebc70068-0f22-4cae-ad45-92a7d13f3766" returned: 0 in 0.508s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-da9ee1bd-fd1a-46db-92b5-9d815ad5646c tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ebc70068-0f22-4cae-ad45-92a7d13f3766 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:41 devstack sudo[108542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ebc70068-0f22-4cae-ad45-92a7d13f3766 Sep 28 15:16:41 devstack sudo[108542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:42 devstack sudo[108542]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-da9ee1bd-fd1a-46db-92b5-9d815ad5646c tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-ebc70068-0f22-4cae-ad45-92a7d13f3766" returned: 0 in 0.428s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:42 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-da9ee1bd-fd1a-46db-92b5-9d815ad5646c tempest-ProjectMemberTests-293722149 None] Lock "cinder-quobyte-ebc70068-0f22-4cae-ad45-92a7d13f3766" released by "delete_volume" :: held 1.067s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:42 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-da9ee1bd-fd1a-46db-92b5-9d815ad5646c tempest-ProjectMemberTests-293722149 None] Created reservations ['9f64c5e1-b630-4e72-a6a9-1af7c7fed1d7', '70a99527-95c0-414b-8b6b-adbe07f12705', '5f1b84ea-33d5-49cf-91e0-a7b4be3f7c01', '2798bfeb-b708-4209-9c02-41f36314d6bf'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:16:42 devstack sudo[108537]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-29d29986-5cba-4d86-b1c4-bbc8419df006 tempest-VolumeDependencyTests-248422175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bff27e0c-cfaa-4914-bd40-6032597d92da 1073741824" returned: 0 in 0.785s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-29d29986-5cba-4d86-b1c4-bbc8419df006 tempest-VolumeDependencyTests-248422175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bff27e0c-cfaa-4914-bd40-6032597d92da {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:42 devstack sudo[108549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bff27e0c-cfaa-4914-bd40-6032597d92da Sep 28 15:16:42 devstack sudo[108549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-da9ee1bd-fd1a-46db-92b5-9d815ad5646c tempest-ProjectMemberTests-293722149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-da9ee1bd-fd1a-46db-92b5-9d815ad5646c tempest-ProjectMemberTests-293722149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:42 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-da9ee1bd-fd1a-46db-92b5-9d815ad5646c tempest-ProjectMemberTests-293722149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:42 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-da9ee1bd-fd1a-46db-92b5-9d815ad5646c tempest-ProjectMemberTests-293722149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-da9ee1bd-fd1a-46db-92b5-9d815ad5646c tempest-ProjectMemberTests-293722149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-da9ee1bd-fd1a-46db-92b5-9d815ad5646c tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:42 devstack sudo[108551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:16:42 devstack sudo[108551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:42 devstack sudo[108551]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-da9ee1bd-fd1a-46db-92b5-9d815ad5646c tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.360s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:42 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-da9ee1bd-fd1a-46db-92b5-9d815ad5646c tempest-ProjectMemberTests-293722149 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:16:42 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-da9ee1bd-fd1a-46db-92b5-9d815ad5646c tempest-ProjectMemberTests-293722149 None] Deleted volume successfully. Sep 28 15:16:42 devstack sudo[108549]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-29d29986-5cba-4d86-b1c4-bbc8419df006 tempest-VolumeDependencyTests-248422175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bff27e0c-cfaa-4914-bd40-6032597d92da" returned: 0 in 0.490s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:42 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-da9ee1bd-fd1a-46db-92b5-9d815ad5646c tempest-ProjectMemberTests-293722149 None] Lock "cinder-ebc70068-0f22-4cae-ad45-92a7d13f3766-delete_volume" released by "delete_volume" :: held 1.854s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:42 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-29d29986-5cba-4d86-b1c4-bbc8419df006 tempest-VolumeDependencyTests-248422175 None] <== create_volume: return (1363ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:16:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-29d29986-5cba-4d86-b1c4-bbc8419df006 tempest-VolumeDependencyTests-248422175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.370s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-29d29986-5cba-4d86-b1c4-bbc8419df006 tempest-VolumeDependencyTests-248422175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d984447-2993-45fe-9c93-99832566ee41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bff27e0c-cfaa-4914-bd40-6032597d92da', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-29d29986-5cba-4d86-b1c4-bbc8419df006 tempest-VolumeDependencyTests-248422175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c82062d8-8200-4796-b81b-d08a3fb0e8ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:42 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-29d29986-5cba-4d86-b1c4-bbc8419df006 tempest-VolumeDependencyTests-248422175 None] Volume volume-bff27e0c-cfaa-4914-bd40-6032597d92da (bff27e0c-cfaa-4914-bd40-6032597d92da): created successfully Sep 28 15:16:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-29d29986-5cba-4d86-b1c4-bbc8419df006 tempest-VolumeDependencyTests-248422175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c82062d8-8200-4796-b81b-d08a3fb0e8ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-29d29986-5cba-4d86-b1c4-bbc8419df006 tempest-VolumeDependencyTests-248422175 None] Flow 'volume_create_manager' (cdf5e780-f9a1-4f99-af89-8dc5f1818148) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:42 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-29d29986-5cba-4d86-b1c4-bbc8419df006 tempest-VolumeDependencyTests-248422175 None] Created volume successfully. Sep 28 15:16:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-87bcf25e-d4ed-424f-bf7c-97fcb3fb2518 tempest-VolumeDependencyTests-248422175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-87bcf25e-d4ed-424f-bf7c-97fcb3fb2518 tempest-VolumeDependencyTests-248422175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:43 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-87bcf25e-d4ed-424f-bf7c-97fcb3fb2518 tempest-VolumeDependencyTests-248422175 None] Creating offline snapshot 5b65e5c2-961e-4ebe-a256-8562b669ee94 of volume bff27e0c-cfaa-4914-bd40-6032597d92da {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:16:43 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[3512553f-4f7c-45fa-8dd2-1891989e0f39]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-87bcf25e-d4ed-424f-bf7c-97fcb3fb2518 tempest-VolumeDependencyTests-248422175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bff27e0c-cfaa-4914-bd40-6032597d92da {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:44 devstack sudo[108591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bff27e0c-cfaa-4914-bd40-6032597d92da Sep 28 15:16:44 devstack sudo[108591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:44 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=206,cinder:UPDATE=311,cinder:DELETE=25,cinder:INSERT=83 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:16:44 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-294c5dbe-eba7-4149-a126-9231b2dbdabb tempest-ProjectMemberTests-293722149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:16:44 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-294c5dbe-eba7-4149-a126-9231b2dbdabb tempest-ProjectMemberTests-293722149 None] Flow 'volume_create_manager' (28430e81-4098-4293-ba88-cfb830013d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:44 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-294c5dbe-eba7-4149-a126-9231b2dbdabb tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81ea4236-ceed-4688-b759-209768d96c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:44 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-294c5dbe-eba7-4149-a126-9231b2dbdabb tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81ea4236-ceed-4688-b759-209768d96c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-73791941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdb86ebd-85d6-48ed-8b05-783b85e61ceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd1cca6dd0284a7c863af0b50e63e06b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:44Z,use_quota=True,user_id='f79e6dc0ec9740e0ab12c9a6bf177496',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:44 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-294c5dbe-eba7-4149-a126-9231b2dbdabb tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d062622-e255-48b6-a14f-a0f58a89e734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:44 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-294c5dbe-eba7-4149-a126-9231b2dbdabb tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d062622-e255-48b6-a14f-a0f58a89e734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:44 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-294c5dbe-eba7-4149-a126-9231b2dbdabb tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72949976-6283-4116-8923-4825ec98258c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:44 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-294c5dbe-eba7-4149-a126-9231b2dbdabb tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72949976-6283-4116-8923-4825ec98258c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdb86ebd-85d6-48ed-8b05-783b85e61ceb', 'volume_name': 'volume-cdb86ebd-85d6-48ed-8b05-783b85e61ceb', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:44 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-294c5dbe-eba7-4149-a126-9231b2dbdabb tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (315b76b7-979c-48ae-bb3e-1a975d9070b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:44 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-294c5dbe-eba7-4149-a126-9231b2dbdabb tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (315b76b7-979c-48ae-bb3e-1a975d9070b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:44 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-294c5dbe-eba7-4149-a126-9231b2dbdabb tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ea7f962-8249-4ee6-a3e3-c2e742f133db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:44 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-294c5dbe-eba7-4149-a126-9231b2dbdabb tempest-ProjectMemberTests-293722149 None] Volume cdb86ebd-85d6-48ed-8b05-783b85e61ceb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdb86ebd-85d6-48ed-8b05-783b85e61ceb', 'volume_size': 1} Sep 28 15:16:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-294c5dbe-eba7-4149-a126-9231b2dbdabb tempest-ProjectMemberTests-293722149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:44 devstack sudo[108591]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-87bcf25e-d4ed-424f-bf7c-97fcb3fb2518 tempest-VolumeDependencyTests-248422175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bff27e0c-cfaa-4914-bd40-6032597d92da" returned: 0 in 0.637s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-87bcf25e-d4ed-424f-bf7c-97fcb3fb2518 tempest-VolumeDependencyTests-248422175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bff27e0c-cfaa-4914-bd40-6032597d92da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bff27e0c-cfaa-4914-bd40-6032597d92da.5b65e5c2-961e-4ebe-a256-8562b669ee94 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:44 devstack sudo[108596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bff27e0c-cfaa-4914-bd40-6032597d92da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bff27e0c-cfaa-4914-bd40-6032597d92da.5b65e5c2-961e-4ebe-a256-8562b669ee94 1G Sep 28 15:16:44 devstack sudo[108596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:45 devstack sudo[108596]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-87bcf25e-d4ed-424f-bf7c-97fcb3fb2518 tempest-VolumeDependencyTests-248422175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bff27e0c-cfaa-4914-bd40-6032597d92da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bff27e0c-cfaa-4914-bd40-6032597d92da.5b65e5c2-961e-4ebe-a256-8562b669ee94 1G" returned: 0 in 0.709s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-87bcf25e-d4ed-424f-bf7c-97fcb3fb2518 tempest-VolumeDependencyTests-248422175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bff27e0c-cfaa-4914-bd40-6032597d92da -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bff27e0c-cfaa-4914-bd40-6032597d92da.5b65e5c2-961e-4ebe-a256-8562b669ee94 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:45 devstack sudo[108602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bff27e0c-cfaa-4914-bd40-6032597d92da -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bff27e0c-cfaa-4914-bd40-6032597d92da.5b65e5c2-961e-4ebe-a256-8562b669ee94 Sep 28 15:16:45 devstack sudo[108602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:45 devstack sudo[108602]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-87bcf25e-d4ed-424f-bf7c-97fcb3fb2518 tempest-VolumeDependencyTests-248422175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bff27e0c-cfaa-4914-bd40-6032597d92da -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bff27e0c-cfaa-4914-bd40-6032597d92da.5b65e5c2-961e-4ebe-a256-8562b669ee94" returned: 0 in 0.456s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:45 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-87bcf25e-d4ed-424f-bf7c-97fcb3fb2518 tempest-VolumeDependencyTests-248422175 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bff27e0c-cfaa-4914-bd40-6032597d92da.5b65e5c2-961e-4ebe-a256-8562b669ee94 is being set with open permissions: ugo+rw Sep 28 15:16:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-87bcf25e-d4ed-424f-bf7c-97fcb3fb2518 tempest-VolumeDependencyTests-248422175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bff27e0c-cfaa-4914-bd40-6032597d92da.5b65e5c2-961e-4ebe-a256-8562b669ee94 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:45 devstack sudo[108607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bff27e0c-cfaa-4914-bd40-6032597d92da.5b65e5c2-961e-4ebe-a256-8562b669ee94 Sep 28 15:16:45 devstack sudo[108607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:46 devstack sudo[108607]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-87bcf25e-d4ed-424f-bf7c-97fcb3fb2518 tempest-VolumeDependencyTests-248422175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bff27e0c-cfaa-4914-bd40-6032597d92da.5b65e5c2-961e-4ebe-a256-8562b669ee94" returned: 0 in 0.380s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-87bcf25e-d4ed-424f-bf7c-97fcb3fb2518 tempest-VolumeDependencyTests-248422175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bff27e0c-cfaa-4914-bd40-6032597d92da.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:46 devstack sudo[108610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bff27e0c-cfaa-4914-bd40-6032597d92da.info Sep 28 15:16:46 devstack sudo[108610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:46 devstack sudo[108610]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-87bcf25e-d4ed-424f-bf7c-97fcb3fb2518 tempest-VolumeDependencyTests-248422175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bff27e0c-cfaa-4914-bd40-6032597d92da.info" returned: 0 in 0.403s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:46 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-87bcf25e-d4ed-424f-bf7c-97fcb3fb2518 tempest-VolumeDependencyTests-248422175 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bff27e0c-cfaa-4914-bd40-6032597d92da.info is being set with open permissions: ugo+rw Sep 28 15:16:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-87bcf25e-d4ed-424f-bf7c-97fcb3fb2518 tempest-VolumeDependencyTests-248422175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bff27e0c-cfaa-4914-bd40-6032597d92da.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:46 devstack sudo[108613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bff27e0c-cfaa-4914-bd40-6032597d92da.info Sep 28 15:16:46 devstack sudo[108613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:46 devstack sudo[108613]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-87bcf25e-d4ed-424f-bf7c-97fcb3fb2518 tempest-VolumeDependencyTests-248422175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bff27e0c-cfaa-4914-bd40-6032597d92da.info" returned: 0 in 0.425s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-87bcf25e-d4ed-424f-bf7c-97fcb3fb2518 tempest-VolumeDependencyTests-248422175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.187s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-294c5dbe-eba7-4149-a126-9231b2dbdabb tempest-ProjectMemberTests-293722149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.592s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:46 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-294c5dbe-eba7-4149-a126-9231b2dbdabb tempest-ProjectMemberTests-293722149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-73791941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdb86ebd-85d6-48ed-8b05-783b85e61ceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd1cca6dd0284a7c863af0b50e63e06b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:44Z,use_quota=True,user_id='f79e6dc0ec9740e0ab12c9a6bf177496',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:16:46 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-294c5dbe-eba7-4149-a126-9231b2dbdabb tempest-ProjectMemberTests-293722149 None] Creating volume cdb86ebd-85d6-48ed-8b05-783b85e61ceb {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:16:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-294c5dbe-eba7-4149-a126-9231b2dbdabb tempest-ProjectMemberTests-293722149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-294c5dbe-eba7-4149-a126-9231b2dbdabb tempest-ProjectMemberTests-293722149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:46 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-294c5dbe-eba7-4149-a126-9231b2dbdabb tempest-ProjectMemberTests-293722149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:46 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-294c5dbe-eba7-4149-a126-9231b2dbdabb tempest-ProjectMemberTests-293722149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-294c5dbe-eba7-4149-a126-9231b2dbdabb tempest-ProjectMemberTests-293722149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:46 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-294c5dbe-eba7-4149-a126-9231b2dbdabb tempest-ProjectMemberTests-293722149 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:16:46 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-294c5dbe-eba7-4149-a126-9231b2dbdabb tempest-ProjectMemberTests-293722149 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:16:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-294c5dbe-eba7-4149-a126-9231b2dbdabb tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cdb86ebd-85d6-48ed-8b05-783b85e61ceb 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:47 devstack sudo[108616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cdb86ebd-85d6-48ed-8b05-783b85e61ceb 1073741824 Sep 28 15:16:47 devstack sudo[108616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:47 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-87bcf25e-d4ed-424f-bf7c-97fcb3fb2518 tempest-VolumeDependencyTests-248422175 None] Create snapshot completed successfully Sep 28 15:16:47 devstack sudo[108616]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-294c5dbe-eba7-4149-a126-9231b2dbdabb tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cdb86ebd-85d6-48ed-8b05-783b85e61ceb 1073741824" returned: 0 in 0.699s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-294c5dbe-eba7-4149-a126-9231b2dbdabb tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cdb86ebd-85d6-48ed-8b05-783b85e61ceb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:47 devstack sudo[108622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cdb86ebd-85d6-48ed-8b05-783b85e61ceb Sep 28 15:16:47 devstack sudo[108622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:48 devstack sudo[108622]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-294c5dbe-eba7-4149-a126-9231b2dbdabb tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cdb86ebd-85d6-48ed-8b05-783b85e61ceb" returned: 0 in 0.310s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:48 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-294c5dbe-eba7-4149-a126-9231b2dbdabb tempest-ProjectMemberTests-293722149 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:16:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-294c5dbe-eba7-4149-a126-9231b2dbdabb tempest-ProjectMemberTests-293722149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-294c5dbe-eba7-4149-a126-9231b2dbdabb tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ea7f962-8249-4ee6-a3e3-c2e742f133db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdb86ebd-85d6-48ed-8b05-783b85e61ceb', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-294c5dbe-eba7-4149-a126-9231b2dbdabb tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb5c1b7d-03fc-49aa-9797-aa83ef05102e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:48 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-294c5dbe-eba7-4149-a126-9231b2dbdabb tempest-ProjectMemberTests-293722149 None] Volume volume-cdb86ebd-85d6-48ed-8b05-783b85e61ceb (cdb86ebd-85d6-48ed-8b05-783b85e61ceb): created successfully Sep 28 15:16:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-294c5dbe-eba7-4149-a126-9231b2dbdabb tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb5c1b7d-03fc-49aa-9797-aa83ef05102e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-294c5dbe-eba7-4149-a126-9231b2dbdabb tempest-ProjectMemberTests-293722149 None] Flow 'volume_create_manager' (28430e81-4098-4293-ba88-cfb830013d79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:48 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-294c5dbe-eba7-4149-a126-9231b2dbdabb tempest-ProjectMemberTests-293722149 None] Created volume successfully. Sep 28 15:16:49 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b304faa-c893-46a1-ad54-91bab713cffd tempest-VolumeDependencyTests-248422175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:16:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6b304faa-c893-46a1-ad54-91bab713cffd tempest-VolumeDependencyTests-248422175 None] Flow 'volume_create_manager' (f0accb0a-5e1a-4709-a00b-1c4aabe4af79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6b304faa-c893-46a1-ad54-91bab713cffd tempest-VolumeDependencyTests-248422175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (954dc493-3761-45f0-95c9-ae03a8c7e03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6b304faa-c893-46a1-ad54-91bab713cffd tempest-VolumeDependencyTests-248422175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (954dc493-3761-45f0-95c9-ae03a8c7e03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1448271144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a396808-e1f2-4d49-b3ac-705d35e67e2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d842602f5c04663a218f25851b47aa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5b65e5c2-961e-4ebe-a256-8562b669ee94,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:49Z,use_quota=True,user_id='b54d9999fabe434d8a5e0c30751191ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6b304faa-c893-46a1-ad54-91bab713cffd tempest-VolumeDependencyTests-248422175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ada183d6-b6d2-41bf-a5af-5eac268c7eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6b304faa-c893-46a1-ad54-91bab713cffd tempest-VolumeDependencyTests-248422175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ada183d6-b6d2-41bf-a5af-5eac268c7eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6b304faa-c893-46a1-ad54-91bab713cffd tempest-VolumeDependencyTests-248422175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd2d2956-e28c-4a70-83e2-cff7977e9e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6b304faa-c893-46a1-ad54-91bab713cffd tempest-VolumeDependencyTests-248422175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd2d2956-e28c-4a70-83e2-cff7977e9e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2a396808-e1f2-4d49-b3ac-705d35e67e2a', 'volume_name': 'volume-2a396808-e1f2-4d49-b3ac-705d35e67e2a', 'volume_size': 1, 'snapshot_id': '5b65e5c2-961e-4ebe-a256-8562b669ee94'}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6b304faa-c893-46a1-ad54-91bab713cffd tempest-VolumeDependencyTests-248422175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5771931-e750-4f29-828b-565da9da7764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6b304faa-c893-46a1-ad54-91bab713cffd tempest-VolumeDependencyTests-248422175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5771931-e750-4f29-828b-565da9da7764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6b304faa-c893-46a1-ad54-91bab713cffd tempest-VolumeDependencyTests-248422175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41cb70a8-64e2-4f7b-81f3-4dc74d47a05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:49 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-6b304faa-c893-46a1-ad54-91bab713cffd tempest-VolumeDependencyTests-248422175 None] Volume 2a396808-e1f2-4d49-b3ac-705d35e67e2a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2a396808-e1f2-4d49-b3ac-705d35e67e2a', 'volume_size': 1, 'snapshot_id': '5b65e5c2-961e-4ebe-a256-8562b669ee94'} Sep 28 15:16:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6b304faa-c893-46a1-ad54-91bab713cffd tempest-VolumeDependencyTests-248422175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6b304faa-c893-46a1-ad54-91bab713cffd tempest-VolumeDependencyTests-248422175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:49 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6b304faa-c893-46a1-ad54-91bab713cffd tempest-VolumeDependencyTests-248422175 None] Acquiring lock "cinder-quobyte-5b65e5c2-961e-4ebe-a256-8562b669ee94-2a396808-e1f2-4d49-b3ac-705d35e67e2a" by "_create_volume_from_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:49 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6b304faa-c893-46a1-ad54-91bab713cffd tempest-VolumeDependencyTests-248422175 None] Lock "cinder-quobyte-5b65e5c2-961e-4ebe-a256-8562b669ee94-2a396808-e1f2-4d49-b3ac-705d35e67e2a" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-6b304faa-c893-46a1-ad54-91bab713cffd tempest-VolumeDependencyTests-248422175 None] Creating volume 2a396808-e1f2-4d49-b3ac-705d35e67e2a from snapshot 5b65e5c2-961e-4ebe-a256-8562b669ee94 {{(pid=87116) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 15:16:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6b304faa-c893-46a1-ad54-91bab713cffd tempest-VolumeDependencyTests-248422175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6b304faa-c893-46a1-ad54-91bab713cffd tempest-VolumeDependencyTests-248422175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-6b304faa-c893-46a1-ad54-91bab713cffd tempest-VolumeDependencyTests-248422175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-6b304faa-c893-46a1-ad54-91bab713cffd tempest-VolumeDependencyTests-248422175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6b304faa-c893-46a1-ad54-91bab713cffd tempest-VolumeDependencyTests-248422175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-6b304faa-c893-46a1-ad54-91bab713cffd tempest-VolumeDependencyTests-248422175 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:16:49 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6b304faa-c893-46a1-ad54-91bab713cffd tempest-VolumeDependencyTests-248422175 None] Acquiring lock "cinder-quobyte-2a396808-e1f2-4d49-b3ac-705d35e67e2a" by "_copy_volume_from_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-07964298-d6d7-4be0-8747-6804d15672a8 tempest-ProjectMemberTests-293722149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:49 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6b304faa-c893-46a1-ad54-91bab713cffd tempest-VolumeDependencyTests-248422175 None] Lock "cinder-quobyte-2a396808-e1f2-4d49-b3ac-705d35e67e2a" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-6b304faa-c893-46a1-ad54-91bab713cffd tempest-VolumeDependencyTests-248422175 None] snapshot: 5b65e5c2-961e-4ebe-a256-8562b669ee94, volume: 2a396808-e1f2-4d49-b3ac-705d35e67e2a, {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 15:16:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6b304faa-c893-46a1-ad54-91bab713cffd tempest-VolumeDependencyTests-248422175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6b304faa-c893-46a1-ad54-91bab713cffd tempest-VolumeDependencyTests-248422175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-6b304faa-c893-46a1-ad54-91bab713cffd tempest-VolumeDependencyTests-248422175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-6b304faa-c893-46a1-ad54-91bab713cffd tempest-VolumeDependencyTests-248422175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6b304faa-c893-46a1-ad54-91bab713cffd tempest-VolumeDependencyTests-248422175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:49 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb47b24b-0f3a-4a61-a799-dc33eb7b2e49]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6b304faa-c893-46a1-ad54-91bab713cffd tempest-VolumeDependencyTests-248422175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bff27e0c-cfaa-4914-bd40-6032597d92da.5b65e5c2-961e-4ebe-a256-8562b669ee94 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:49 devstack sudo[108625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bff27e0c-cfaa-4914-bd40-6032597d92da.5b65e5c2-961e-4ebe-a256-8562b669ee94 Sep 28 15:16:49 devstack sudo[108625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:49 devstack sudo[108625]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6b304faa-c893-46a1-ad54-91bab713cffd tempest-VolumeDependencyTests-248422175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bff27e0c-cfaa-4914-bd40-6032597d92da.5b65e5c2-961e-4ebe-a256-8562b669ee94" returned: 0 in 0.449s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-6b304faa-c893-46a1-ad54-91bab713cffd tempest-VolumeDependencyTests-248422175 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bff27e0c-cfaa-4914-bd40-6032597d92da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:16:49 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bca3f87-42b6-4922-866d-f6bf73ad58f4]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6b304faa-c893-46a1-ad54-91bab713cffd tempest-VolumeDependencyTests-248422175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bff27e0c-cfaa-4914-bd40-6032597d92da {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:50 devstack sudo[108630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bff27e0c-cfaa-4914-bd40-6032597d92da Sep 28 15:16:50 devstack sudo[108630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:50 devstack sudo[108630]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6b304faa-c893-46a1-ad54-91bab713cffd tempest-VolumeDependencyTests-248422175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bff27e0c-cfaa-4914-bd40-6032597d92da" returned: 0 in 0.493s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:50 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-6b304faa-c893-46a1-ad54-91bab713cffd tempest-VolumeDependencyTests-248422175 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bff27e0c-cfaa-4914-bd40-6032597d92da {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 15:16:50 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-6b304faa-c893-46a1-ad54-91bab713cffd tempest-VolumeDependencyTests-248422175 None] Creating direct copy from snapshot {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 15:16:50 devstack cinder-volume[87116]: DEBUG cinder.utils [None req-6b304faa-c893-46a1-ad54-91bab713cffd tempest-VolumeDependencyTests-248422175 None] Path /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2a396808-e1f2-4d49-b3ac-705d35e67e2a not found in is_blk_device check {{(pid=87116) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 15:16:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6b304faa-c893-46a1-ad54-91bab713cffd tempest-VolumeDependencyTests-248422175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bff27e0c-cfaa-4914-bd40-6032597d92da /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2a396808-e1f2-4d49-b3ac-705d35e67e2a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:50 devstack sudo[108635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bff27e0c-cfaa-4914-bd40-6032597d92da /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2a396808-e1f2-4d49-b3ac-705d35e67e2a Sep 28 15:16:50 devstack sudo[108635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:58 devstack sudo[108635]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6b304faa-c893-46a1-ad54-91bab713cffd tempest-VolumeDependencyTests-248422175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bff27e0c-cfaa-4914-bd40-6032597d92da /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2a396808-e1f2-4d49-b3ac-705d35e67e2a" returned: 0 in 7.782s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:58 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-6b304faa-c893-46a1-ad54-91bab713cffd tempest-VolumeDependencyTests-248422175 None] Image conversion details: src /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bff27e0c-cfaa-4914-bd40-6032597d92da, size 1024.00 MB, duration 7.78 sec, destination /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2a396808-e1f2-4d49-b3ac-705d35e67e2a {{(pid=87116) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:16:58 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-6b304faa-c893-46a1-ad54-91bab713cffd tempest-VolumeDependencyTests-248422175 None] Converted 1024.00 MB image at 131.56 MB/s Sep 28 15:16:58 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-6b304faa-c893-46a1-ad54-91bab713cffd tempest-VolumeDependencyTests-248422175 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2a396808-e1f2-4d49-b3ac-705d35e67e2a is being set with open permissions: ugo+rw Sep 28 15:16:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6b304faa-c893-46a1-ad54-91bab713cffd tempest-VolumeDependencyTests-248422175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2a396808-e1f2-4d49-b3ac-705d35e67e2a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:58 devstack sudo[108650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2a396808-e1f2-4d49-b3ac-705d35e67e2a Sep 28 15:16:58 devstack sudo[108650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:58 devstack sudo[108650]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6b304faa-c893-46a1-ad54-91bab713cffd tempest-VolumeDependencyTests-248422175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2a396808-e1f2-4d49-b3ac-705d35e67e2a" returned: 0 in 0.318s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:58 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6b304faa-c893-46a1-ad54-91bab713cffd tempest-VolumeDependencyTests-248422175 None] Lock "cinder-quobyte-2a396808-e1f2-4d49-b3ac-705d35e67e2a" released by "_copy_volume_from_snapshot" :: held 9.178s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:58 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=215,cinder:UPDATE=267,cinder:DELETE=26,cinder:INSERT=70 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:16:58 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6b304faa-c893-46a1-ad54-91bab713cffd tempest-VolumeDependencyTests-248422175 None] Lock "cinder-quobyte-5b65e5c2-961e-4ebe-a256-8562b669ee94-2a396808-e1f2-4d49-b3ac-705d35e67e2a" released by "_create_volume_from_snapshot" :: held 9.269s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6b304faa-c893-46a1-ad54-91bab713cffd tempest-VolumeDependencyTests-248422175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.305s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-07964298-d6d7-4be0-8747-6804d15672a8 tempest-ProjectMemberTests-293722149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.241s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-07964298-d6d7-4be0-8747-6804d15672a8 tempest-ProjectMemberTests-293722149 None] Creating offline snapshot 2ddaaa04-df8f-4669-8d13-7fcff1e871b3 of volume cdb86ebd-85d6-48ed-8b05-783b85e61ceb {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:16:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6b304faa-c893-46a1-ad54-91bab713cffd tempest-VolumeDependencyTests-248422175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41cb70a8-64e2-4f7b-81f3-4dc74d47a05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a396808-e1f2-4d49-b3ac-705d35e67e2a', 'volume_size': 1, 'snapshot_id': '5b65e5c2-961e-4ebe-a256-8562b669ee94'}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6b304faa-c893-46a1-ad54-91bab713cffd tempest-VolumeDependencyTests-248422175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b30e2fa1-e0c8-4110-b6bc-7792131aa483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:58 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[cefe7afc-1878-4091-994b-b0a455ce1665]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-07964298-d6d7-4be0-8747-6804d15672a8 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cdb86ebd-85d6-48ed-8b05-783b85e61ceb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:58 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-6b304faa-c893-46a1-ad54-91bab713cffd tempest-VolumeDependencyTests-248422175 None] Volume volume-2a396808-e1f2-4d49-b3ac-705d35e67e2a (2a396808-e1f2-4d49-b3ac-705d35e67e2a): created successfully Sep 28 15:16:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6b304faa-c893-46a1-ad54-91bab713cffd tempest-VolumeDependencyTests-248422175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b30e2fa1-e0c8-4110-b6bc-7792131aa483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6b304faa-c893-46a1-ad54-91bab713cffd tempest-VolumeDependencyTests-248422175 None] Flow 'volume_create_manager' (f0accb0a-5e1a-4709-a00b-1c4aabe4af79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:58 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-6b304faa-c893-46a1-ad54-91bab713cffd tempest-VolumeDependencyTests-248422175 None] Created volume successfully. Sep 28 15:16:58 devstack sudo[108653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cdb86ebd-85d6-48ed-8b05-783b85e61ceb Sep 28 15:16:58 devstack sudo[108653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:59 devstack sudo[108653]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-07964298-d6d7-4be0-8747-6804d15672a8 tempest-ProjectMemberTests-293722149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cdb86ebd-85d6-48ed-8b05-783b85e61ceb" returned: 0 in 0.540s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-07964298-d6d7-4be0-8747-6804d15672a8 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cdb86ebd-85d6-48ed-8b05-783b85e61ceb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cdb86ebd-85d6-48ed-8b05-783b85e61ceb.2ddaaa04-df8f-4669-8d13-7fcff1e871b3 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:59 devstack sudo[108658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cdb86ebd-85d6-48ed-8b05-783b85e61ceb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cdb86ebd-85d6-48ed-8b05-783b85e61ceb.2ddaaa04-df8f-4669-8d13-7fcff1e871b3 1G Sep 28 15:16:59 devstack sudo[108658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:59 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-bbbb7265-fdb7-4e9f-a828-3d094640e95c tempest-VolumeDependencyTests-248422175 None] Acquiring lock "cinder-5b65e5c2-961e-4ebe-a256-8562b669ee94-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:59 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-bbbb7265-fdb7-4e9f-a828-3d094640e95c tempest-VolumeDependencyTests-248422175 None] Lock "cinder-5b65e5c2-961e-4ebe-a256-8562b669ee94-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:59 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-bbbb7265-fdb7-4e9f-a828-3d094640e95c tempest-VolumeDependencyTests-248422175 None] Acquiring lock "cinder-quobyte-bff27e0c-cfaa-4914-bd40-6032597d92da" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:59 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-bbbb7265-fdb7-4e9f-a828-3d094640e95c tempest-VolumeDependencyTests-248422175 None] Lock "cinder-quobyte-bff27e0c-cfaa-4914-bd40-6032597d92da" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:59 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-bbbb7265-fdb7-4e9f-a828-3d094640e95c tempest-VolumeDependencyTests-248422175 None] Acquiring lock "cinder-quobyte-5b65e5c2-961e-4ebe-a256-8562b669ee94" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:59 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-bbbb7265-fdb7-4e9f-a828-3d094640e95c tempest-VolumeDependencyTests-248422175 None] Lock "cinder-quobyte-5b65e5c2-961e-4ebe-a256-8562b669ee94" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-bbbb7265-fdb7-4e9f-a828-3d094640e95c tempest-VolumeDependencyTests-248422175 None] Deleting offline snapshot 5b65e5c2-961e-4ebe-a256-8562b669ee94 of volume bff27e0c-cfaa-4914-bd40-6032597d92da {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:16:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-bbbb7265-fdb7-4e9f-a828-3d094640e95c tempest-VolumeDependencyTests-248422175 None] snapshot_file for this snap is: volume-bff27e0c-cfaa-4914-bd40-6032597d92da.5b65e5c2-961e-4ebe-a256-8562b669ee94 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:16:59 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e96ae9-1467-4aa7-bab2-4d693c5db744]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bbbb7265-fdb7-4e9f-a828-3d094640e95c tempest-VolumeDependencyTests-248422175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bff27e0c-cfaa-4914-bd40-6032597d92da.5b65e5c2-961e-4ebe-a256-8562b669ee94 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:59 devstack sudo[108660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bff27e0c-cfaa-4914-bd40-6032597d92da.5b65e5c2-961e-4ebe-a256-8562b669ee94 Sep 28 15:16:59 devstack sudo[108660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:59 devstack sudo[108658]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-07964298-d6d7-4be0-8747-6804d15672a8 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cdb86ebd-85d6-48ed-8b05-783b85e61ceb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cdb86ebd-85d6-48ed-8b05-783b85e61ceb.2ddaaa04-df8f-4669-8d13-7fcff1e871b3 1G" returned: 0 in 0.673s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-07964298-d6d7-4be0-8747-6804d15672a8 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdb86ebd-85d6-48ed-8b05-783b85e61ceb -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cdb86ebd-85d6-48ed-8b05-783b85e61ceb.2ddaaa04-df8f-4669-8d13-7fcff1e871b3 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:59 devstack sudo[108660]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bbbb7265-fdb7-4e9f-a828-3d094640e95c tempest-VolumeDependencyTests-248422175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bff27e0c-cfaa-4914-bd40-6032597d92da.5b65e5c2-961e-4ebe-a256-8562b669ee94" returned: 0 in 0.509s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-bbbb7265-fdb7-4e9f-a828-3d094640e95c tempest-VolumeDependencyTests-248422175 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bff27e0c-cfaa-4914-bd40-6032597d92da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:16:59 devstack sudo[108669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdb86ebd-85d6-48ed-8b05-783b85e61ceb -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cdb86ebd-85d6-48ed-8b05-783b85e61ceb.2ddaaa04-df8f-4669-8d13-7fcff1e871b3 Sep 28 15:16:59 devstack sudo[108669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:59 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6aa8822-1fd7-454a-92dd-153cfc6e85d6]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bbbb7265-fdb7-4e9f-a828-3d094640e95c tempest-VolumeDependencyTests-248422175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bff27e0c-cfaa-4914-bd40-6032597d92da {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:00 devstack sudo[108671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bff27e0c-cfaa-4914-bd40-6032597d92da Sep 28 15:17:00 devstack sudo[108671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:00 devstack sudo[108669]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-07964298-d6d7-4be0-8747-6804d15672a8 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdb86ebd-85d6-48ed-8b05-783b85e61ceb -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cdb86ebd-85d6-48ed-8b05-783b85e61ceb.2ddaaa04-df8f-4669-8d13-7fcff1e871b3" returned: 0 in 0.403s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:00 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-07964298-d6d7-4be0-8747-6804d15672a8 tempest-ProjectMemberTests-293722149 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cdb86ebd-85d6-48ed-8b05-783b85e61ceb.2ddaaa04-df8f-4669-8d13-7fcff1e871b3 is being set with open permissions: ugo+rw Sep 28 15:17:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-07964298-d6d7-4be0-8747-6804d15672a8 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cdb86ebd-85d6-48ed-8b05-783b85e61ceb.2ddaaa04-df8f-4669-8d13-7fcff1e871b3 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:00 devstack sudo[108676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cdb86ebd-85d6-48ed-8b05-783b85e61ceb.2ddaaa04-df8f-4669-8d13-7fcff1e871b3 Sep 28 15:17:00 devstack sudo[108676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:00 devstack sudo[108671]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bbbb7265-fdb7-4e9f-a828-3d094640e95c tempest-VolumeDependencyTests-248422175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bff27e0c-cfaa-4914-bd40-6032597d92da" returned: 0 in 0.646s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bbbb7265-fdb7-4e9f-a828-3d094640e95c tempest-VolumeDependencyTests-248422175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bff27e0c-cfaa-4914-bd40-6032597d92da.5b65e5c2-961e-4ebe-a256-8562b669ee94 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:00 devstack sudo[108676]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:00 devstack sudo[108682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bff27e0c-cfaa-4914-bd40-6032597d92da.5b65e5c2-961e-4ebe-a256-8562b669ee94 Sep 28 15:17:00 devstack sudo[108682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-07964298-d6d7-4be0-8747-6804d15672a8 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cdb86ebd-85d6-48ed-8b05-783b85e61ceb.2ddaaa04-df8f-4669-8d13-7fcff1e871b3" returned: 0 in 0.360s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-07964298-d6d7-4be0-8747-6804d15672a8 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cdb86ebd-85d6-48ed-8b05-783b85e61ceb.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:00 devstack sudo[108684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cdb86ebd-85d6-48ed-8b05-783b85e61ceb.info Sep 28 15:17:00 devstack sudo[108684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:01 devstack sudo[108684]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-07964298-d6d7-4be0-8747-6804d15672a8 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cdb86ebd-85d6-48ed-8b05-783b85e61ceb.info" returned: 0 in 0.335s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:01 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-07964298-d6d7-4be0-8747-6804d15672a8 tempest-ProjectMemberTests-293722149 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cdb86ebd-85d6-48ed-8b05-783b85e61ceb.info is being set with open permissions: ugo+rw Sep 28 15:17:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-07964298-d6d7-4be0-8747-6804d15672a8 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cdb86ebd-85d6-48ed-8b05-783b85e61ceb.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:01 devstack sudo[108682]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bbbb7265-fdb7-4e9f-a828-3d094640e95c tempest-VolumeDependencyTests-248422175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bff27e0c-cfaa-4914-bd40-6032597d92da.5b65e5c2-961e-4ebe-a256-8562b669ee94" returned: 0 in 0.451s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bbbb7265-fdb7-4e9f-a828-3d094640e95c tempest-VolumeDependencyTests-248422175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bff27e0c-cfaa-4914-bd40-6032597d92da.5b65e5c2-961e-4ebe-a256-8562b669ee94 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:01 devstack sudo[108690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cdb86ebd-85d6-48ed-8b05-783b85e61ceb.info Sep 28 15:17:01 devstack sudo[108690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:01 devstack sudo[108695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bff27e0c-cfaa-4914-bd40-6032597d92da.5b65e5c2-961e-4ebe-a256-8562b669ee94 Sep 28 15:17:01 devstack sudo[108695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:01 devstack sudo[108690]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-07964298-d6d7-4be0-8747-6804d15672a8 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cdb86ebd-85d6-48ed-8b05-783b85e61ceb.info" returned: 0 in 0.326s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-07964298-d6d7-4be0-8747-6804d15672a8 tempest-ProjectMemberTests-293722149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.793s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:01 devstack sudo[108695]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bbbb7265-fdb7-4e9f-a828-3d094640e95c tempest-VolumeDependencyTests-248422175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bff27e0c-cfaa-4914-bd40-6032597d92da.5b65e5c2-961e-4ebe-a256-8562b669ee94" returned: 0 in 0.347s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:01 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-bbbb7265-fdb7-4e9f-a828-3d094640e95c tempest-VolumeDependencyTests-248422175 None] Lock "cinder-quobyte-5b65e5c2-961e-4ebe-a256-8562b669ee94" released by "_delete_snapshot" :: held 2.133s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:01 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-07964298-d6d7-4be0-8747-6804d15672a8 tempest-ProjectMemberTests-293722149 None] Create snapshot completed successfully Sep 28 15:17:01 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-bbbb7265-fdb7-4e9f-a828-3d094640e95c tempest-VolumeDependencyTests-248422175 None] Lock "cinder-quobyte-bff27e0c-cfaa-4914-bd40-6032597d92da" released by "delete_snapshot" :: held 2.166s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:01 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-bbbb7265-fdb7-4e9f-a828-3d094640e95c tempest-VolumeDependencyTests-248422175 None] Created reservations ['fa3b8d4a-c9a5-4dec-8e25-1dd4fbb7c7ca', '874906ec-3b41-4406-8cfa-dddf4c822ebc', 'de8bedca-a698-432d-9ecf-6970b573712a', '8afb3b2f-0ac5-4898-8d01-9e06990903aa'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:17:01 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-bbbb7265-fdb7-4e9f-a828-3d094640e95c tempest-VolumeDependencyTests-248422175 None] Delete snapshot completed successfully. Sep 28 15:17:01 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-bbbb7265-fdb7-4e9f-a828-3d094640e95c tempest-VolumeDependencyTests-248422175 None] Lock "cinder-5b65e5c2-961e-4ebe-a256-8562b669ee94-delete_snapshot" released by "delete_snapshot" :: held 2.368s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-43a04c08-02c5-4994-bb81-41ebe5f77ec5 tempest-ProjectMemberTests-293722149 None] Acquiring lock "cinder-2ddaaa04-df8f-4669-8d13-7fcff1e871b3-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-43a04c08-02c5-4994-bb81-41ebe5f77ec5 tempest-ProjectMemberTests-293722149 None] Lock "cinder-2ddaaa04-df8f-4669-8d13-7fcff1e871b3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-43a04c08-02c5-4994-bb81-41ebe5f77ec5 tempest-ProjectMemberTests-293722149 None] Acquiring lock "cinder-quobyte-cdb86ebd-85d6-48ed-8b05-783b85e61ceb" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-43a04c08-02c5-4994-bb81-41ebe5f77ec5 tempest-ProjectMemberTests-293722149 None] Lock "cinder-quobyte-cdb86ebd-85d6-48ed-8b05-783b85e61ceb" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-43a04c08-02c5-4994-bb81-41ebe5f77ec5 tempest-ProjectMemberTests-293722149 None] Acquiring lock "cinder-quobyte-2ddaaa04-df8f-4669-8d13-7fcff1e871b3" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-43a04c08-02c5-4994-bb81-41ebe5f77ec5 tempest-ProjectMemberTests-293722149 None] Lock "cinder-quobyte-2ddaaa04-df8f-4669-8d13-7fcff1e871b3" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-43a04c08-02c5-4994-bb81-41ebe5f77ec5 tempest-ProjectMemberTests-293722149 None] Deleting offline snapshot 2ddaaa04-df8f-4669-8d13-7fcff1e871b3 of volume cdb86ebd-85d6-48ed-8b05-783b85e61ceb {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:17:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-43a04c08-02c5-4994-bb81-41ebe5f77ec5 tempest-ProjectMemberTests-293722149 None] snapshot_file for this snap is: volume-cdb86ebd-85d6-48ed-8b05-783b85e61ceb.2ddaaa04-df8f-4669-8d13-7fcff1e871b3 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:17:02 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed1ce0a-83ac-43df-93fb-6d5916ee62fc]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-43a04c08-02c5-4994-bb81-41ebe5f77ec5 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cdb86ebd-85d6-48ed-8b05-783b85e61ceb.2ddaaa04-df8f-4669-8d13-7fcff1e871b3 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c082a001-431a-413d-9dd3-2b1e2c3f492e tempest-VolumeDependencyTests-248422175 None] Acquiring lock "cinder-bff27e0c-cfaa-4914-bd40-6032597d92da-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c082a001-431a-413d-9dd3-2b1e2c3f492e tempest-VolumeDependencyTests-248422175 None] Lock "cinder-bff27e0c-cfaa-4914-bd40-6032597d92da-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c082a001-431a-413d-9dd3-2b1e2c3f492e tempest-VolumeDependencyTests-248422175 None] Acquiring lock "cinder-quobyte-bff27e0c-cfaa-4914-bd40-6032597d92da" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c082a001-431a-413d-9dd3-2b1e2c3f492e tempest-VolumeDependencyTests-248422175 None] Lock "cinder-quobyte-bff27e0c-cfaa-4914-bd40-6032597d92da" acquired by "delete_volume" :: waited 0.019s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:02 devstack sudo[108700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cdb86ebd-85d6-48ed-8b05-783b85e61ceb.2ddaaa04-df8f-4669-8d13-7fcff1e871b3 Sep 28 15:17:02 devstack sudo[108700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:02 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[71018638-7ba7-49cb-867d-8e267d6bdf96]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c082a001-431a-413d-9dd3-2b1e2c3f492e tempest-VolumeDependencyTests-248422175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bff27e0c-cfaa-4914-bd40-6032597d92da {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:02 devstack sudo[108702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bff27e0c-cfaa-4914-bd40-6032597d92da Sep 28 15:17:02 devstack sudo[108702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:03 devstack sudo[108700]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-43a04c08-02c5-4994-bb81-41ebe5f77ec5 tempest-ProjectMemberTests-293722149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cdb86ebd-85d6-48ed-8b05-783b85e61ceb.2ddaaa04-df8f-4669-8d13-7fcff1e871b3" returned: 0 in 0.562s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-43a04c08-02c5-4994-bb81-41ebe5f77ec5 tempest-ProjectMemberTests-293722149 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cdb86ebd-85d6-48ed-8b05-783b85e61ceb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:17:03 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[148615f0-8779-451c-a55e-7f47b48e84d2]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-43a04c08-02c5-4994-bb81-41ebe5f77ec5 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cdb86ebd-85d6-48ed-8b05-783b85e61ceb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:03 devstack sudo[108702]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c082a001-431a-413d-9dd3-2b1e2c3f492e tempest-VolumeDependencyTests-248422175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bff27e0c-cfaa-4914-bd40-6032597d92da" returned: 0 in 0.443s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c082a001-431a-413d-9dd3-2b1e2c3f492e tempest-VolumeDependencyTests-248422175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bff27e0c-cfaa-4914-bd40-6032597d92da {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:03 devstack sudo[108707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cdb86ebd-85d6-48ed-8b05-783b85e61ceb Sep 28 15:17:03 devstack sudo[108707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:03 devstack sudo[108711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bff27e0c-cfaa-4914-bd40-6032597d92da Sep 28 15:17:03 devstack sudo[108711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:03 devstack sudo[108711]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c082a001-431a-413d-9dd3-2b1e2c3f492e tempest-VolumeDependencyTests-248422175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-bff27e0c-cfaa-4914-bd40-6032597d92da" returned: 0 in 0.290s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:03 devstack sudo[108707]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:03 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c082a001-431a-413d-9dd3-2b1e2c3f492e tempest-VolumeDependencyTests-248422175 None] Lock "cinder-quobyte-bff27e0c-cfaa-4914-bd40-6032597d92da" released by "delete_volume" :: held 0.832s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-43a04c08-02c5-4994-bb81-41ebe5f77ec5 tempest-ProjectMemberTests-293722149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cdb86ebd-85d6-48ed-8b05-783b85e61ceb" returned: 0 in 0.464s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-43a04c08-02c5-4994-bb81-41ebe5f77ec5 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cdb86ebd-85d6-48ed-8b05-783b85e61ceb.2ddaaa04-df8f-4669-8d13-7fcff1e871b3 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:03 devstack sudo[108718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cdb86ebd-85d6-48ed-8b05-783b85e61ceb.2ddaaa04-df8f-4669-8d13-7fcff1e871b3 Sep 28 15:17:03 devstack sudo[108718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:03 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-c082a001-431a-413d-9dd3-2b1e2c3f492e tempest-VolumeDependencyTests-248422175 None] Created reservations ['d7c3a668-d542-4efa-b0f5-972e8f3121af', 'e639c803-f5f6-45b1-b81b-1d3d3b5e12d5', 'a9df4005-ae07-4ce8-b9de-7416dbfe5b75', 'e70d275d-7456-4e0e-8dfd-7344d41d68e7'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:17:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c082a001-431a-413d-9dd3-2b1e2c3f492e tempest-VolumeDependencyTests-248422175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c082a001-431a-413d-9dd3-2b1e2c3f492e tempest-VolumeDependencyTests-248422175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c082a001-431a-413d-9dd3-2b1e2c3f492e tempest-VolumeDependencyTests-248422175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c082a001-431a-413d-9dd3-2b1e2c3f492e tempest-VolumeDependencyTests-248422175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c082a001-431a-413d-9dd3-2b1e2c3f492e tempest-VolumeDependencyTests-248422175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c082a001-431a-413d-9dd3-2b1e2c3f492e tempest-VolumeDependencyTests-248422175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:03 devstack sudo[108720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:17:03 devstack sudo[108720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:03 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-796fcb7d-9ec9-4104-9c7b-253cd715e2b8 tempest-VolumeDependencyTests-248422175 None] Acquiring lock "cinder-2a396808-e1f2-4d49-b3ac-705d35e67e2a-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:03 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-796fcb7d-9ec9-4104-9c7b-253cd715e2b8 tempest-VolumeDependencyTests-248422175 None] Lock "cinder-2a396808-e1f2-4d49-b3ac-705d35e67e2a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:03 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-796fcb7d-9ec9-4104-9c7b-253cd715e2b8 tempest-VolumeDependencyTests-248422175 None] Acquiring lock "cinder-quobyte-2a396808-e1f2-4d49-b3ac-705d35e67e2a" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:03 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-796fcb7d-9ec9-4104-9c7b-253cd715e2b8 tempest-VolumeDependencyTests-248422175 None] Lock "cinder-quobyte-2a396808-e1f2-4d49-b3ac-705d35e67e2a" acquired by "delete_volume" :: waited 0.020s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:04 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[16abebad-989b-480e-b361-ab691fb70415]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-796fcb7d-9ec9-4104-9c7b-253cd715e2b8 tempest-VolumeDependencyTests-248422175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2a396808-e1f2-4d49-b3ac-705d35e67e2a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:04 devstack sudo[108718]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-43a04c08-02c5-4994-bb81-41ebe5f77ec5 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cdb86ebd-85d6-48ed-8b05-783b85e61ceb.2ddaaa04-df8f-4669-8d13-7fcff1e871b3" returned: 0 in 0.534s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-43a04c08-02c5-4994-bb81-41ebe5f77ec5 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cdb86ebd-85d6-48ed-8b05-783b85e61ceb.2ddaaa04-df8f-4669-8d13-7fcff1e871b3 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:04 devstack sudo[108728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cdb86ebd-85d6-48ed-8b05-783b85e61ceb.2ddaaa04-df8f-4669-8d13-7fcff1e871b3 Sep 28 15:17:04 devstack sudo[108728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:04 devstack sudo[108720]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c082a001-431a-413d-9dd3-2b1e2c3f492e tempest-VolumeDependencyTests-248422175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.451s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:04 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-c082a001-431a-413d-9dd3-2b1e2c3f492e tempest-VolumeDependencyTests-248422175 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:17:04 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-c082a001-431a-413d-9dd3-2b1e2c3f492e tempest-VolumeDependencyTests-248422175 None] Deleted volume successfully. Sep 28 15:17:04 devstack sudo[108726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2a396808-e1f2-4d49-b3ac-705d35e67e2a Sep 28 15:17:04 devstack sudo[108726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:04 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c082a001-431a-413d-9dd3-2b1e2c3f492e tempest-VolumeDependencyTests-248422175 None] Lock "cinder-bff27e0c-cfaa-4914-bd40-6032597d92da-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:04 devstack sudo[108728]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-43a04c08-02c5-4994-bb81-41ebe5f77ec5 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cdb86ebd-85d6-48ed-8b05-783b85e61ceb.2ddaaa04-df8f-4669-8d13-7fcff1e871b3" returned: 0 in 0.326s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:04 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-43a04c08-02c5-4994-bb81-41ebe5f77ec5 tempest-ProjectMemberTests-293722149 None] Lock "cinder-quobyte-2ddaaa04-df8f-4669-8d13-7fcff1e871b3" released by "_delete_snapshot" :: held 2.053s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:04 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-43a04c08-02c5-4994-bb81-41ebe5f77ec5 tempest-ProjectMemberTests-293722149 None] Lock "cinder-quobyte-cdb86ebd-85d6-48ed-8b05-783b85e61ceb" released by "delete_snapshot" :: held 2.095s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:04 devstack sudo[108726]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-796fcb7d-9ec9-4104-9c7b-253cd715e2b8 tempest-VolumeDependencyTests-248422175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2a396808-e1f2-4d49-b3ac-705d35e67e2a" returned: 0 in 0.501s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-796fcb7d-9ec9-4104-9c7b-253cd715e2b8 tempest-VolumeDependencyTests-248422175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2a396808-e1f2-4d49-b3ac-705d35e67e2a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:04 devstack sudo[108735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2a396808-e1f2-4d49-b3ac-705d35e67e2a Sep 28 15:17:04 devstack sudo[108735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:04 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-43a04c08-02c5-4994-bb81-41ebe5f77ec5 tempest-ProjectMemberTests-293722149 None] Created reservations ['032971f7-156e-496e-be9a-e28263b20eeb', 'e1e16908-c9bd-43b9-88c7-1f6930b6580f', 'f2958cac-c364-43d6-89f6-d7604fce3b6e', '66c5acd3-bd64-4627-9ecf-843415fac7c9'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:17:04 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-43a04c08-02c5-4994-bb81-41ebe5f77ec5 tempest-ProjectMemberTests-293722149 None] Delete snapshot completed successfully. Sep 28 15:17:04 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-43a04c08-02c5-4994-bb81-41ebe5f77ec5 tempest-ProjectMemberTests-293722149 None] Lock "cinder-2ddaaa04-df8f-4669-8d13-7fcff1e871b3-delete_snapshot" released by "delete_snapshot" :: held 2.344s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:04 devstack sudo[108735]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-796fcb7d-9ec9-4104-9c7b-253cd715e2b8 tempest-VolumeDependencyTests-248422175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2a396808-e1f2-4d49-b3ac-705d35e67e2a" returned: 0 in 0.340s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:04 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-796fcb7d-9ec9-4104-9c7b-253cd715e2b8 tempest-VolumeDependencyTests-248422175 None] Lock "cinder-quobyte-2a396808-e1f2-4d49-b3ac-705d35e67e2a" released by "delete_volume" :: held 0.891s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:04 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-796fcb7d-9ec9-4104-9c7b-253cd715e2b8 tempest-VolumeDependencyTests-248422175 None] Created reservations ['33279802-af2d-486e-aeac-0a8fc179e5d3', '73de6735-53e6-4182-8bbe-73d84bd4224e', 'ae57c269-8517-48c0-b8ad-0130b9049aaa', 'c41ccb49-c0c3-42a7-adbe-6503ddca300f'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:17:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-796fcb7d-9ec9-4104-9c7b-253cd715e2b8 tempest-VolumeDependencyTests-248422175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-796fcb7d-9ec9-4104-9c7b-253cd715e2b8 tempest-VolumeDependencyTests-248422175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:05 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-796fcb7d-9ec9-4104-9c7b-253cd715e2b8 tempest-VolumeDependencyTests-248422175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:05 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-796fcb7d-9ec9-4104-9c7b-253cd715e2b8 tempest-VolumeDependencyTests-248422175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-796fcb7d-9ec9-4104-9c7b-253cd715e2b8 tempest-VolumeDependencyTests-248422175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-796fcb7d-9ec9-4104-9c7b-253cd715e2b8 tempest-VolumeDependencyTests-248422175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:05 devstack sudo[108738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:17:05 devstack sudo[108738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:05 devstack sudo[108738]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-796fcb7d-9ec9-4104-9c7b-253cd715e2b8 tempest-VolumeDependencyTests-248422175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.268s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:05 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-796fcb7d-9ec9-4104-9c7b-253cd715e2b8 tempest-VolumeDependencyTests-248422175 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:17:05 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-796fcb7d-9ec9-4104-9c7b-253cd715e2b8 tempest-VolumeDependencyTests-248422175 None] Deleted volume successfully. Sep 28 15:17:05 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-796fcb7d-9ec9-4104-9c7b-253cd715e2b8 tempest-VolumeDependencyTests-248422175 None] Lock "cinder-2a396808-e1f2-4d49-b3ac-705d35e67e2a-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:05 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-83628c0b-8dfb-4550-9013-2b126a0fdd99 tempest-ProjectMemberTests-293722149 None] Acquiring lock "cinder-cdb86ebd-85d6-48ed-8b05-783b85e61ceb-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:05 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-83628c0b-8dfb-4550-9013-2b126a0fdd99 tempest-ProjectMemberTests-293722149 None] Lock "cinder-cdb86ebd-85d6-48ed-8b05-783b85e61ceb-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:05 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-83628c0b-8dfb-4550-9013-2b126a0fdd99 tempest-ProjectMemberTests-293722149 None] Acquiring lock "cinder-quobyte-cdb86ebd-85d6-48ed-8b05-783b85e61ceb" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:05 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-83628c0b-8dfb-4550-9013-2b126a0fdd99 tempest-ProjectMemberTests-293722149 None] Lock "cinder-quobyte-cdb86ebd-85d6-48ed-8b05-783b85e61ceb" acquired by "delete_volume" :: waited 0.019s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:05 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e3a698-656d-4420-80aa-cd7fc01f879e]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-83628c0b-8dfb-4550-9013-2b126a0fdd99 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cdb86ebd-85d6-48ed-8b05-783b85e61ceb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:05 devstack sudo[108741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cdb86ebd-85d6-48ed-8b05-783b85e61ceb Sep 28 15:17:05 devstack sudo[108741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:06 devstack sudo[108741]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-83628c0b-8dfb-4550-9013-2b126a0fdd99 tempest-ProjectMemberTests-293722149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cdb86ebd-85d6-48ed-8b05-783b85e61ceb" returned: 0 in 0.469s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-83628c0b-8dfb-4550-9013-2b126a0fdd99 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cdb86ebd-85d6-48ed-8b05-783b85e61ceb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:06 devstack sudo[108746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cdb86ebd-85d6-48ed-8b05-783b85e61ceb Sep 28 15:17:06 devstack sudo[108746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:06 devstack sudo[108746]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-83628c0b-8dfb-4550-9013-2b126a0fdd99 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-cdb86ebd-85d6-48ed-8b05-783b85e61ceb" returned: 0 in 0.318s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-83628c0b-8dfb-4550-9013-2b126a0fdd99 tempest-ProjectMemberTests-293722149 None] Lock "cinder-quobyte-cdb86ebd-85d6-48ed-8b05-783b85e61ceb" released by "delete_volume" :: held 0.879s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:06 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-83628c0b-8dfb-4550-9013-2b126a0fdd99 tempest-ProjectMemberTests-293722149 None] Created reservations ['c0315652-1fa7-4ff7-966e-62920da508d1', '120c6f13-86c1-4268-babb-946788c7925e', '5ad6a372-e3d8-4840-93b5-3278b38ebd30', 'a20e1945-670c-4bea-8934-38a5dbaf7f7b'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:17:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-83628c0b-8dfb-4550-9013-2b126a0fdd99 tempest-ProjectMemberTests-293722149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-83628c0b-8dfb-4550-9013-2b126a0fdd99 tempest-ProjectMemberTests-293722149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-83628c0b-8dfb-4550-9013-2b126a0fdd99 tempest-ProjectMemberTests-293722149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-83628c0b-8dfb-4550-9013-2b126a0fdd99 tempest-ProjectMemberTests-293722149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-83628c0b-8dfb-4550-9013-2b126a0fdd99 tempest-ProjectMemberTests-293722149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-83628c0b-8dfb-4550-9013-2b126a0fdd99 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:06 devstack sudo[108749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:17:06 devstack sudo[108749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:07 devstack sudo[108749]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-83628c0b-8dfb-4550-9013-2b126a0fdd99 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.363s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:07 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-83628c0b-8dfb-4550-9013-2b126a0fdd99 tempest-ProjectMemberTests-293722149 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:17:07 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-83628c0b-8dfb-4550-9013-2b126a0fdd99 tempest-ProjectMemberTests-293722149 None] Deleted volume successfully. Sep 28 15:17:07 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-83628c0b-8dfb-4550-9013-2b126a0fdd99 tempest-ProjectMemberTests-293722149 None] Lock "cinder-cdb86ebd-85d6-48ed-8b05-783b85e61ceb-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:07 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9f1c8d4-d44b-4521-b6b7-3ac025f8b68f tempest-ProjectMemberTests-293722149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:17:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e9f1c8d4-d44b-4521-b6b7-3ac025f8b68f tempest-ProjectMemberTests-293722149 None] Flow 'volume_create_manager' (c8e29e05-e518-4b6c-97b8-dfff17a4268e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:17:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e9f1c8d4-d44b-4521-b6b7-3ac025f8b68f tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2edf66bd-8543-4bfc-a946-3a7d402bc4a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e9f1c8d4-d44b-4521-b6b7-3ac025f8b68f tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2edf66bd-8543-4bfc-a946-3a7d402bc4a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1665297097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7702dcbb-cc9d-4b70-a011-8f13629035f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd1cca6dd0284a7c863af0b50e63e06b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:17:07Z,use_quota=True,user_id='f79e6dc0ec9740e0ab12c9a6bf177496',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e9f1c8d4-d44b-4521-b6b7-3ac025f8b68f tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98ffab68-b0ad-42ae-a508-2bc36d94aa62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e9f1c8d4-d44b-4521-b6b7-3ac025f8b68f tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98ffab68-b0ad-42ae-a508-2bc36d94aa62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e9f1c8d4-d44b-4521-b6b7-3ac025f8b68f tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e7015dc-aa08-44fe-a065-80761c909872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e9f1c8d4-d44b-4521-b6b7-3ac025f8b68f tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e7015dc-aa08-44fe-a065-80761c909872) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7702dcbb-cc9d-4b70-a011-8f13629035f9', 'volume_name': 'volume-7702dcbb-cc9d-4b70-a011-8f13629035f9', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e9f1c8d4-d44b-4521-b6b7-3ac025f8b68f tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5a4669c-f0fd-4d51-9df6-9f0d77b498a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e9f1c8d4-d44b-4521-b6b7-3ac025f8b68f tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5a4669c-f0fd-4d51-9df6-9f0d77b498a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e9f1c8d4-d44b-4521-b6b7-3ac025f8b68f tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05b624b5-df61-47cd-a2a4-f362611e0bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:07 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-e9f1c8d4-d44b-4521-b6b7-3ac025f8b68f tempest-ProjectMemberTests-293722149 None] Volume 7702dcbb-cc9d-4b70-a011-8f13629035f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7702dcbb-cc9d-4b70-a011-8f13629035f9', 'volume_size': 1} Sep 28 15:17:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e9f1c8d4-d44b-4521-b6b7-3ac025f8b68f tempest-ProjectMemberTests-293722149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e9f1c8d4-d44b-4521-b6b7-3ac025f8b68f tempest-ProjectMemberTests-293722149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:07 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e9f1c8d4-d44b-4521-b6b7-3ac025f8b68f tempest-ProjectMemberTests-293722149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1665297097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7702dcbb-cc9d-4b70-a011-8f13629035f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd1cca6dd0284a7c863af0b50e63e06b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:17:07Z,use_quota=True,user_id='f79e6dc0ec9740e0ab12c9a6bf177496',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:17:07 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-e9f1c8d4-d44b-4521-b6b7-3ac025f8b68f tempest-ProjectMemberTests-293722149 None] Creating volume 7702dcbb-cc9d-4b70-a011-8f13629035f9 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:17:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e9f1c8d4-d44b-4521-b6b7-3ac025f8b68f tempest-ProjectMemberTests-293722149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e9f1c8d4-d44b-4521-b6b7-3ac025f8b68f tempest-ProjectMemberTests-293722149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:07 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e9f1c8d4-d44b-4521-b6b7-3ac025f8b68f tempest-ProjectMemberTests-293722149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:07 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e9f1c8d4-d44b-4521-b6b7-3ac025f8b68f tempest-ProjectMemberTests-293722149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e9f1c8d4-d44b-4521-b6b7-3ac025f8b68f tempest-ProjectMemberTests-293722149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:07 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e9f1c8d4-d44b-4521-b6b7-3ac025f8b68f tempest-ProjectMemberTests-293722149 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:17:07 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-e9f1c8d4-d44b-4521-b6b7-3ac025f8b68f tempest-ProjectMemberTests-293722149 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:17:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e9f1c8d4-d44b-4521-b6b7-3ac025f8b68f tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7702dcbb-cc9d-4b70-a011-8f13629035f9 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:07 devstack sudo[108752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7702dcbb-cc9d-4b70-a011-8f13629035f9 1073741824 Sep 28 15:17:07 devstack sudo[108752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:08 devstack sudo[108752]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e9f1c8d4-d44b-4521-b6b7-3ac025f8b68f tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7702dcbb-cc9d-4b70-a011-8f13629035f9 1073741824" returned: 0 in 0.605s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e9f1c8d4-d44b-4521-b6b7-3ac025f8b68f tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7702dcbb-cc9d-4b70-a011-8f13629035f9 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:08 devstack sudo[108759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7702dcbb-cc9d-4b70-a011-8f13629035f9 Sep 28 15:17:08 devstack sudo[108759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:08 devstack sudo[108759]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e9f1c8d4-d44b-4521-b6b7-3ac025f8b68f tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7702dcbb-cc9d-4b70-a011-8f13629035f9" returned: 0 in 0.386s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:08 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e9f1c8d4-d44b-4521-b6b7-3ac025f8b68f tempest-ProjectMemberTests-293722149 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:17:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e9f1c8d4-d44b-4521-b6b7-3ac025f8b68f tempest-ProjectMemberTests-293722149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:08 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e9f1c8d4-d44b-4521-b6b7-3ac025f8b68f tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05b624b5-df61-47cd-a2a4-f362611e0bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7702dcbb-cc9d-4b70-a011-8f13629035f9', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:08 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e9f1c8d4-d44b-4521-b6b7-3ac025f8b68f tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12890449-0ed7-48ba-98fb-af7498a0273d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:08 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-e9f1c8d4-d44b-4521-b6b7-3ac025f8b68f tempest-ProjectMemberTests-293722149 None] Volume volume-7702dcbb-cc9d-4b70-a011-8f13629035f9 (7702dcbb-cc9d-4b70-a011-8f13629035f9): created successfully Sep 28 15:17:08 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e9f1c8d4-d44b-4521-b6b7-3ac025f8b68f tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12890449-0ed7-48ba-98fb-af7498a0273d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:08 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e9f1c8d4-d44b-4521-b6b7-3ac025f8b68f tempest-ProjectMemberTests-293722149 None] Flow 'volume_create_manager' (c8e29e05-e518-4b6c-97b8-dfff17a4268e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:17:08 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-e9f1c8d4-d44b-4521-b6b7-3ac025f8b68f tempest-ProjectMemberTests-293722149 None] Created volume successfully. Sep 28 15:17:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-154702c5-328b-4040-8071-3bf41caa3fb0 tempest-ProjectMemberTests-293722149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-154702c5-328b-4040-8071-3bf41caa3fb0 tempest-ProjectMemberTests-293722149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:09 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-154702c5-328b-4040-8071-3bf41caa3fb0 tempest-ProjectMemberTests-293722149 None] Creating offline snapshot 15e04129-6097-48c7-bf9b-51e9fc862e76 of volume 7702dcbb-cc9d-4b70-a011-8f13629035f9 {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:17:09 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d8ba56-8cce-45f2-93c7-c90bd000cea0]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-154702c5-328b-4040-8071-3bf41caa3fb0 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7702dcbb-cc9d-4b70-a011-8f13629035f9 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:10 devstack sudo[108762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7702dcbb-cc9d-4b70-a011-8f13629035f9 Sep 28 15:17:10 devstack sudo[108762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:10 devstack sudo[108762]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-154702c5-328b-4040-8071-3bf41caa3fb0 tempest-ProjectMemberTests-293722149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7702dcbb-cc9d-4b70-a011-8f13629035f9" returned: 0 in 0.473s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-154702c5-328b-4040-8071-3bf41caa3fb0 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7702dcbb-cc9d-4b70-a011-8f13629035f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7702dcbb-cc9d-4b70-a011-8f13629035f9.15e04129-6097-48c7-bf9b-51e9fc862e76 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:10 devstack sudo[108767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7702dcbb-cc9d-4b70-a011-8f13629035f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7702dcbb-cc9d-4b70-a011-8f13629035f9.15e04129-6097-48c7-bf9b-51e9fc862e76 1G Sep 28 15:17:10 devstack sudo[108767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:10 devstack sudo[108767]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-154702c5-328b-4040-8071-3bf41caa3fb0 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7702dcbb-cc9d-4b70-a011-8f13629035f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7702dcbb-cc9d-4b70-a011-8f13629035f9.15e04129-6097-48c7-bf9b-51e9fc862e76 1G" returned: 0 in 0.549s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-154702c5-328b-4040-8071-3bf41caa3fb0 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7702dcbb-cc9d-4b70-a011-8f13629035f9 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7702dcbb-cc9d-4b70-a011-8f13629035f9.15e04129-6097-48c7-bf9b-51e9fc862e76 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:10 devstack sudo[108773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7702dcbb-cc9d-4b70-a011-8f13629035f9 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7702dcbb-cc9d-4b70-a011-8f13629035f9.15e04129-6097-48c7-bf9b-51e9fc862e76 Sep 28 15:17:10 devstack sudo[108773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:11 devstack sudo[108773]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-154702c5-328b-4040-8071-3bf41caa3fb0 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7702dcbb-cc9d-4b70-a011-8f13629035f9 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7702dcbb-cc9d-4b70-a011-8f13629035f9.15e04129-6097-48c7-bf9b-51e9fc862e76" returned: 0 in 0.396s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:11 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-154702c5-328b-4040-8071-3bf41caa3fb0 tempest-ProjectMemberTests-293722149 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7702dcbb-cc9d-4b70-a011-8f13629035f9.15e04129-6097-48c7-bf9b-51e9fc862e76 is being set with open permissions: ugo+rw Sep 28 15:17:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-154702c5-328b-4040-8071-3bf41caa3fb0 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7702dcbb-cc9d-4b70-a011-8f13629035f9.15e04129-6097-48c7-bf9b-51e9fc862e76 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:11 devstack sudo[108778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7702dcbb-cc9d-4b70-a011-8f13629035f9.15e04129-6097-48c7-bf9b-51e9fc862e76 Sep 28 15:17:11 devstack sudo[108778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:11 devstack sudo[108778]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-154702c5-328b-4040-8071-3bf41caa3fb0 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7702dcbb-cc9d-4b70-a011-8f13629035f9.15e04129-6097-48c7-bf9b-51e9fc862e76" returned: 0 in 0.364s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-154702c5-328b-4040-8071-3bf41caa3fb0 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7702dcbb-cc9d-4b70-a011-8f13629035f9.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:11 devstack sudo[108782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7702dcbb-cc9d-4b70-a011-8f13629035f9.info Sep 28 15:17:11 devstack sudo[108782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:12 devstack sudo[108782]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-154702c5-328b-4040-8071-3bf41caa3fb0 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7702dcbb-cc9d-4b70-a011-8f13629035f9.info" returned: 0 in 0.344s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:12 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-154702c5-328b-4040-8071-3bf41caa3fb0 tempest-ProjectMemberTests-293722149 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7702dcbb-cc9d-4b70-a011-8f13629035f9.info is being set with open permissions: ugo+rw Sep 28 15:17:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-154702c5-328b-4040-8071-3bf41caa3fb0 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7702dcbb-cc9d-4b70-a011-8f13629035f9.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:12 devstack sudo[108785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7702dcbb-cc9d-4b70-a011-8f13629035f9.info Sep 28 15:17:12 devstack sudo[108785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:12 devstack sudo[108785]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-154702c5-328b-4040-8071-3bf41caa3fb0 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7702dcbb-cc9d-4b70-a011-8f13629035f9.info" returned: 0 in 0.293s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-154702c5-328b-4040-8071-3bf41caa3fb0 tempest-ProjectMemberTests-293722149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.552s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:12 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-154702c5-328b-4040-8071-3bf41caa3fb0 tempest-ProjectMemberTests-293722149 None] Create snapshot completed successfully Sep 28 15:17:13 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7bb7533c-b413-4917-b293-7e684397f2a3 tempest-ProjectMemberTests-293722149 None] Acquiring lock "cinder-15e04129-6097-48c7-bf9b-51e9fc862e76-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:13 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7bb7533c-b413-4917-b293-7e684397f2a3 tempest-ProjectMemberTests-293722149 None] Lock "cinder-15e04129-6097-48c7-bf9b-51e9fc862e76-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:13 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7bb7533c-b413-4917-b293-7e684397f2a3 tempest-ProjectMemberTests-293722149 None] Acquiring lock "cinder-quobyte-7702dcbb-cc9d-4b70-a011-8f13629035f9" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:13 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7bb7533c-b413-4917-b293-7e684397f2a3 tempest-ProjectMemberTests-293722149 None] Lock "cinder-quobyte-7702dcbb-cc9d-4b70-a011-8f13629035f9" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:13 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7bb7533c-b413-4917-b293-7e684397f2a3 tempest-ProjectMemberTests-293722149 None] Acquiring lock "cinder-quobyte-15e04129-6097-48c7-bf9b-51e9fc862e76" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:13 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7bb7533c-b413-4917-b293-7e684397f2a3 tempest-ProjectMemberTests-293722149 None] Lock "cinder-quobyte-15e04129-6097-48c7-bf9b-51e9fc862e76" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:13 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-7bb7533c-b413-4917-b293-7e684397f2a3 tempest-ProjectMemberTests-293722149 None] Deleting offline snapshot 15e04129-6097-48c7-bf9b-51e9fc862e76 of volume 7702dcbb-cc9d-4b70-a011-8f13629035f9 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:17:13 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-7bb7533c-b413-4917-b293-7e684397f2a3 tempest-ProjectMemberTests-293722149 None] snapshot_file for this snap is: volume-7702dcbb-cc9d-4b70-a011-8f13629035f9.15e04129-6097-48c7-bf9b-51e9fc862e76 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:17:13 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[666439a6-36e0-4454-8405-b7bbdfbf2dc7]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7bb7533c-b413-4917-b293-7e684397f2a3 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7702dcbb-cc9d-4b70-a011-8f13629035f9.15e04129-6097-48c7-bf9b-51e9fc862e76 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:13 devstack sudo[108788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7702dcbb-cc9d-4b70-a011-8f13629035f9.15e04129-6097-48c7-bf9b-51e9fc862e76 Sep 28 15:17:13 devstack sudo[108788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:13 devstack sudo[108788]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7bb7533c-b413-4917-b293-7e684397f2a3 tempest-ProjectMemberTests-293722149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7702dcbb-cc9d-4b70-a011-8f13629035f9.15e04129-6097-48c7-bf9b-51e9fc862e76" returned: 0 in 0.441s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:13 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-7bb7533c-b413-4917-b293-7e684397f2a3 tempest-ProjectMemberTests-293722149 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7702dcbb-cc9d-4b70-a011-8f13629035f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:17:13 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[608fe3b5-55e0-4f5e-ba8d-16fda71f00d4]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7bb7533c-b413-4917-b293-7e684397f2a3 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7702dcbb-cc9d-4b70-a011-8f13629035f9 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:13 devstack sudo[108793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7702dcbb-cc9d-4b70-a011-8f13629035f9 Sep 28 15:17:13 devstack sudo[108793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:14 devstack sudo[108793]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7bb7533c-b413-4917-b293-7e684397f2a3 tempest-ProjectMemberTests-293722149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7702dcbb-cc9d-4b70-a011-8f13629035f9" returned: 0 in 0.433s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7bb7533c-b413-4917-b293-7e684397f2a3 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7702dcbb-cc9d-4b70-a011-8f13629035f9.15e04129-6097-48c7-bf9b-51e9fc862e76 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:14 devstack sudo[108798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7702dcbb-cc9d-4b70-a011-8f13629035f9.15e04129-6097-48c7-bf9b-51e9fc862e76 Sep 28 15:17:14 devstack sudo[108798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:14 devstack sudo[108798]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7bb7533c-b413-4917-b293-7e684397f2a3 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7702dcbb-cc9d-4b70-a011-8f13629035f9.15e04129-6097-48c7-bf9b-51e9fc862e76" returned: 0 in 0.472s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7bb7533c-b413-4917-b293-7e684397f2a3 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7702dcbb-cc9d-4b70-a011-8f13629035f9.15e04129-6097-48c7-bf9b-51e9fc862e76 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:14 devstack sudo[108803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7702dcbb-cc9d-4b70-a011-8f13629035f9.15e04129-6097-48c7-bf9b-51e9fc862e76 Sep 28 15:17:14 devstack sudo[108803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:14 devstack sudo[108803]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7bb7533c-b413-4917-b293-7e684397f2a3 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7702dcbb-cc9d-4b70-a011-8f13629035f9.15e04129-6097-48c7-bf9b-51e9fc862e76" returned: 0 in 0.331s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7bb7533c-b413-4917-b293-7e684397f2a3 tempest-ProjectMemberTests-293722149 None] Lock "cinder-quobyte-15e04129-6097-48c7-bf9b-51e9fc862e76" released by "_delete_snapshot" :: held 1.808s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7bb7533c-b413-4917-b293-7e684397f2a3 tempest-ProjectMemberTests-293722149 None] Lock "cinder-quobyte-7702dcbb-cc9d-4b70-a011-8f13629035f9" released by "delete_snapshot" :: held 1.839s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:15 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-7bb7533c-b413-4917-b293-7e684397f2a3 tempest-ProjectMemberTests-293722149 None] Created reservations ['1c8af51c-9d40-4ef2-b55a-b5c92efca73d', 'cee1b339-90c1-4b14-993c-b2733e595b22', '8ac925f2-3d37-4472-b594-43296479eb70', '3f649a3d-c9c4-4337-aa80-a4861d44aa08'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:17:15 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-7bb7533c-b413-4917-b293-7e684397f2a3 tempest-ProjectMemberTests-293722149 None] Delete snapshot completed successfully. Sep 28 15:17:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7bb7533c-b413-4917-b293-7e684397f2a3 tempest-ProjectMemberTests-293722149 None] Lock "cinder-15e04129-6097-48c7-bf9b-51e9fc862e76-delete_snapshot" released by "delete_snapshot" :: held 2.035s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-220d9711-845d-46cf-a4db-2b64e3c07671 tempest-ProjectMemberTests-293722149 None] Acquiring lock "cinder-7702dcbb-cc9d-4b70-a011-8f13629035f9-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-220d9711-845d-46cf-a4db-2b64e3c07671 tempest-ProjectMemberTests-293722149 None] Lock "cinder-7702dcbb-cc9d-4b70-a011-8f13629035f9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-220d9711-845d-46cf-a4db-2b64e3c07671 tempest-ProjectMemberTests-293722149 None] Acquiring lock "cinder-quobyte-7702dcbb-cc9d-4b70-a011-8f13629035f9" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-220d9711-845d-46cf-a4db-2b64e3c07671 tempest-ProjectMemberTests-293722149 None] Lock "cinder-quobyte-7702dcbb-cc9d-4b70-a011-8f13629035f9" acquired by "delete_volume" :: waited 0.022s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:15 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[7974d9ab-8d22-4cc3-8209-488a37dc198a]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-220d9711-845d-46cf-a4db-2b64e3c07671 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7702dcbb-cc9d-4b70-a011-8f13629035f9 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:15 devstack sudo[108806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7702dcbb-cc9d-4b70-a011-8f13629035f9 Sep 28 15:17:15 devstack sudo[108806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:15 devstack sudo[108806]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-220d9711-845d-46cf-a4db-2b64e3c07671 tempest-ProjectMemberTests-293722149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7702dcbb-cc9d-4b70-a011-8f13629035f9" returned: 0 in 0.462s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-220d9711-845d-46cf-a4db-2b64e3c07671 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7702dcbb-cc9d-4b70-a011-8f13629035f9 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:16 devstack sudo[108811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7702dcbb-cc9d-4b70-a011-8f13629035f9 Sep 28 15:17:16 devstack sudo[108811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:16 devstack sudo[108811]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-220d9711-845d-46cf-a4db-2b64e3c07671 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-7702dcbb-cc9d-4b70-a011-8f13629035f9" returned: 0 in 0.346s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:16 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-220d9711-845d-46cf-a4db-2b64e3c07671 tempest-ProjectMemberTests-293722149 None] Lock "cinder-quobyte-7702dcbb-cc9d-4b70-a011-8f13629035f9" released by "delete_volume" :: held 0.903s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:16 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-220d9711-845d-46cf-a4db-2b64e3c07671 tempest-ProjectMemberTests-293722149 None] Created reservations ['7d0314e5-9ea9-40af-96a6-dfb7e15ad8a0', '2127b427-f4c4-47be-bf95-e273af153ab2', 'fd52bfe4-7a7b-4ab6-a707-552836773f7a', '41248d45-d602-4665-b624-924e7beb8462'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:17:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-220d9711-845d-46cf-a4db-2b64e3c07671 tempest-ProjectMemberTests-293722149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-220d9711-845d-46cf-a4db-2b64e3c07671 tempest-ProjectMemberTests-293722149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:16 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-220d9711-845d-46cf-a4db-2b64e3c07671 tempest-ProjectMemberTests-293722149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:16 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-220d9711-845d-46cf-a4db-2b64e3c07671 tempest-ProjectMemberTests-293722149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-220d9711-845d-46cf-a4db-2b64e3c07671 tempest-ProjectMemberTests-293722149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-220d9711-845d-46cf-a4db-2b64e3c07671 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:16 devstack sudo[108814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:17:16 devstack sudo[108814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:16 devstack sudo[108814]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-220d9711-845d-46cf-a4db-2b64e3c07671 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.336s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:16 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-220d9711-845d-46cf-a4db-2b64e3c07671 tempest-ProjectMemberTests-293722149 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:17:16 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-220d9711-845d-46cf-a4db-2b64e3c07671 tempest-ProjectMemberTests-293722149 None] Deleted volume successfully. Sep 28 15:17:16 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-220d9711-845d-46cf-a4db-2b64e3c07671 tempest-ProjectMemberTests-293722149 None] Lock "cinder-7702dcbb-cc9d-4b70-a011-8f13629035f9-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:17 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:17:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:17 devstack sudo[108817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:17:17 devstack sudo[108817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:17 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-55a52db8-c4c9-4f8f-8d2b-7459292a3ca9 tempest-ProjectMemberTests-293722149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:17:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-55a52db8-c4c9-4f8f-8d2b-7459292a3ca9 tempest-ProjectMemberTests-293722149 None] Flow 'volume_create_manager' (a5926916-e01b-496d-ad43-c1552d6eb8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:17:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-55a52db8-c4c9-4f8f-8d2b-7459292a3ca9 tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0697e96-5a81-4064-8ea5-52f94b1f45ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-55a52db8-c4c9-4f8f-8d2b-7459292a3ca9 tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0697e96-5a81-4064-8ea5-52f94b1f45ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:17:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1117425916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c1dd4ce-88c2-4758-ba3c-d8effc602a68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd1cca6dd0284a7c863af0b50e63e06b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:17:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:17:17Z,use_quota=True,user_id='f79e6dc0ec9740e0ab12c9a6bf177496',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-55a52db8-c4c9-4f8f-8d2b-7459292a3ca9 tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a369f20d-fbc5-4402-aef7-8260e4868b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-55a52db8-c4c9-4f8f-8d2b-7459292a3ca9 tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a369f20d-fbc5-4402-aef7-8260e4868b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-55a52db8-c4c9-4f8f-8d2b-7459292a3ca9 tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a9c8721-bb2d-47d3-8924-40bea8e90c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-55a52db8-c4c9-4f8f-8d2b-7459292a3ca9 tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a9c8721-bb2d-47d3-8924-40bea8e90c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c1dd4ce-88c2-4758-ba3c-d8effc602a68', 'volume_name': 'volume-9c1dd4ce-88c2-4758-ba3c-d8effc602a68', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-55a52db8-c4c9-4f8f-8d2b-7459292a3ca9 tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e85c54f-d763-4a15-9b16-e7cda0c7969d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-55a52db8-c4c9-4f8f-8d2b-7459292a3ca9 tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e85c54f-d763-4a15-9b16-e7cda0c7969d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-55a52db8-c4c9-4f8f-8d2b-7459292a3ca9 tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (017b1d1f-ce41-4ab2-9e1c-400879ac8887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:17 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-55a52db8-c4c9-4f8f-8d2b-7459292a3ca9 tempest-ProjectMemberTests-293722149 None] Volume 9c1dd4ce-88c2-4758-ba3c-d8effc602a68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c1dd4ce-88c2-4758-ba3c-d8effc602a68', 'volume_size': 1} Sep 28 15:17:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-55a52db8-c4c9-4f8f-8d2b-7459292a3ca9 tempest-ProjectMemberTests-293722149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-55a52db8-c4c9-4f8f-8d2b-7459292a3ca9 tempest-ProjectMemberTests-293722149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-55a52db8-c4c9-4f8f-8d2b-7459292a3ca9 tempest-ProjectMemberTests-293722149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:17:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1117425916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c1dd4ce-88c2-4758-ba3c-d8effc602a68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd1cca6dd0284a7c863af0b50e63e06b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:17:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:17:17Z,use_quota=True,user_id='f79e6dc0ec9740e0ab12c9a6bf177496',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:17:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-55a52db8-c4c9-4f8f-8d2b-7459292a3ca9 tempest-ProjectMemberTests-293722149 None] Creating volume 9c1dd4ce-88c2-4758-ba3c-d8effc602a68 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:17:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-55a52db8-c4c9-4f8f-8d2b-7459292a3ca9 tempest-ProjectMemberTests-293722149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-55a52db8-c4c9-4f8f-8d2b-7459292a3ca9 tempest-ProjectMemberTests-293722149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-55a52db8-c4c9-4f8f-8d2b-7459292a3ca9 tempest-ProjectMemberTests-293722149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-55a52db8-c4c9-4f8f-8d2b-7459292a3ca9 tempest-ProjectMemberTests-293722149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-55a52db8-c4c9-4f8f-8d2b-7459292a3ca9 tempest-ProjectMemberTests-293722149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-55a52db8-c4c9-4f8f-8d2b-7459292a3ca9 tempest-ProjectMemberTests-293722149 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:17:17 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-55a52db8-c4c9-4f8f-8d2b-7459292a3ca9 tempest-ProjectMemberTests-293722149 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:17:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-55a52db8-c4c9-4f8f-8d2b-7459292a3ca9 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c1dd4ce-88c2-4758-ba3c-d8effc602a68 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:17 devstack sudo[108817]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.319s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:17 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:17:17 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running periodic task VolumeManager._thread_info {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:17:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] thread count: 28 {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:17:17 devstack sudo[108820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c1dd4ce-88c2-4758-ba3c-d8effc602a68 1073741824 Sep 28 15:17:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] thread info: [<_MainThread(MainThread, started 135146735652992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:17:17 devstack sudo[108820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:17 devstack sudo[108820]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-55a52db8-c4c9-4f8f-8d2b-7459292a3ca9 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c1dd4ce-88c2-4758-ba3c-d8effc602a68 1073741824" returned: 0 in 0.570s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-55a52db8-c4c9-4f8f-8d2b-7459292a3ca9 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c1dd4ce-88c2-4758-ba3c-d8effc602a68 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:18 devstack sudo[108826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c1dd4ce-88c2-4758-ba3c-d8effc602a68 Sep 28 15:17:18 devstack sudo[108826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:18 devstack sudo[108826]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-55a52db8-c4c9-4f8f-8d2b-7459292a3ca9 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c1dd4ce-88c2-4758-ba3c-d8effc602a68" returned: 0 in 0.303s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-55a52db8-c4c9-4f8f-8d2b-7459292a3ca9 tempest-ProjectMemberTests-293722149 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:17:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-55a52db8-c4c9-4f8f-8d2b-7459292a3ca9 tempest-ProjectMemberTests-293722149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-55a52db8-c4c9-4f8f-8d2b-7459292a3ca9 tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (017b1d1f-ce41-4ab2-9e1c-400879ac8887) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c1dd4ce-88c2-4758-ba3c-d8effc602a68', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-55a52db8-c4c9-4f8f-8d2b-7459292a3ca9 tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cfdb837-366a-49ed-a36f-85b44ee6819d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:18 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-55a52db8-c4c9-4f8f-8d2b-7459292a3ca9 tempest-ProjectMemberTests-293722149 None] Volume volume-9c1dd4ce-88c2-4758-ba3c-d8effc602a68 (9c1dd4ce-88c2-4758-ba3c-d8effc602a68): created successfully Sep 28 15:17:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-55a52db8-c4c9-4f8f-8d2b-7459292a3ca9 tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cfdb837-366a-49ed-a36f-85b44ee6819d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-55a52db8-c4c9-4f8f-8d2b-7459292a3ca9 tempest-ProjectMemberTests-293722149 None] Flow 'volume_create_manager' (a5926916-e01b-496d-ad43-c1552d6eb8ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:17:18 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-55a52db8-c4c9-4f8f-8d2b-7459292a3ca9 tempest-ProjectMemberTests-293722149 None] Created volume successfully. Sep 28 15:17:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-020d1437-34ff-45f9-bdbe-2f15f4424d94 tempest-ProjectMemberTests-293722149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-020d1437-34ff-45f9-bdbe-2f15f4424d94 tempest-ProjectMemberTests-293722149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-020d1437-34ff-45f9-bdbe-2f15f4424d94 tempest-ProjectMemberTests-293722149 None] Creating offline snapshot ee74b9b2-cba2-4c09-848b-affac2b44ea3 of volume 9c1dd4ce-88c2-4758-ba3c-d8effc602a68 {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:17:19 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[617014d2-406d-430a-a3ea-12d0063f0ec2]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-020d1437-34ff-45f9-bdbe-2f15f4424d94 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c1dd4ce-88c2-4758-ba3c-d8effc602a68 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:19 devstack sudo[108829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c1dd4ce-88c2-4758-ba3c-d8effc602a68 Sep 28 15:17:19 devstack sudo[108829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:20 devstack sudo[108829]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-020d1437-34ff-45f9-bdbe-2f15f4424d94 tempest-ProjectMemberTests-293722149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c1dd4ce-88c2-4758-ba3c-d8effc602a68" returned: 0 in 0.424s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-020d1437-34ff-45f9-bdbe-2f15f4424d94 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c1dd4ce-88c2-4758-ba3c-d8effc602a68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c1dd4ce-88c2-4758-ba3c-d8effc602a68.ee74b9b2-cba2-4c09-848b-affac2b44ea3 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:20 devstack sudo[108834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c1dd4ce-88c2-4758-ba3c-d8effc602a68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c1dd4ce-88c2-4758-ba3c-d8effc602a68.ee74b9b2-cba2-4c09-848b-affac2b44ea3 1G Sep 28 15:17:20 devstack sudo[108834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:20 devstack sudo[108834]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-020d1437-34ff-45f9-bdbe-2f15f4424d94 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c1dd4ce-88c2-4758-ba3c-d8effc602a68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c1dd4ce-88c2-4758-ba3c-d8effc602a68.ee74b9b2-cba2-4c09-848b-affac2b44ea3 1G" returned: 0 in 0.478s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-020d1437-34ff-45f9-bdbe-2f15f4424d94 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c1dd4ce-88c2-4758-ba3c-d8effc602a68 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c1dd4ce-88c2-4758-ba3c-d8effc602a68.ee74b9b2-cba2-4c09-848b-affac2b44ea3 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:20 devstack sudo[108840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c1dd4ce-88c2-4758-ba3c-d8effc602a68 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c1dd4ce-88c2-4758-ba3c-d8effc602a68.ee74b9b2-cba2-4c09-848b-affac2b44ea3 Sep 28 15:17:20 devstack sudo[108840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:20 devstack sudo[108840]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-020d1437-34ff-45f9-bdbe-2f15f4424d94 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c1dd4ce-88c2-4758-ba3c-d8effc602a68 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c1dd4ce-88c2-4758-ba3c-d8effc602a68.ee74b9b2-cba2-4c09-848b-affac2b44ea3" returned: 0 in 0.378s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:20 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-020d1437-34ff-45f9-bdbe-2f15f4424d94 tempest-ProjectMemberTests-293722149 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c1dd4ce-88c2-4758-ba3c-d8effc602a68.ee74b9b2-cba2-4c09-848b-affac2b44ea3 is being set with open permissions: ugo+rw Sep 28 15:17:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-020d1437-34ff-45f9-bdbe-2f15f4424d94 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c1dd4ce-88c2-4758-ba3c-d8effc602a68.ee74b9b2-cba2-4c09-848b-affac2b44ea3 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:20 devstack sudo[108846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c1dd4ce-88c2-4758-ba3c-d8effc602a68.ee74b9b2-cba2-4c09-848b-affac2b44ea3 Sep 28 15:17:20 devstack sudo[108846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:21 devstack sudo[108846]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-020d1437-34ff-45f9-bdbe-2f15f4424d94 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c1dd4ce-88c2-4758-ba3c-d8effc602a68.ee74b9b2-cba2-4c09-848b-affac2b44ea3" returned: 0 in 0.321s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-020d1437-34ff-45f9-bdbe-2f15f4424d94 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c1dd4ce-88c2-4758-ba3c-d8effc602a68.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:21 devstack sudo[108849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c1dd4ce-88c2-4758-ba3c-d8effc602a68.info Sep 28 15:17:21 devstack sudo[108849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:21 devstack sudo[108849]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-020d1437-34ff-45f9-bdbe-2f15f4424d94 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c1dd4ce-88c2-4758-ba3c-d8effc602a68.info" returned: 0 in 0.320s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:21 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-020d1437-34ff-45f9-bdbe-2f15f4424d94 tempest-ProjectMemberTests-293722149 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c1dd4ce-88c2-4758-ba3c-d8effc602a68.info is being set with open permissions: ugo+rw Sep 28 15:17:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-020d1437-34ff-45f9-bdbe-2f15f4424d94 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c1dd4ce-88c2-4758-ba3c-d8effc602a68.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:21 devstack sudo[108853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c1dd4ce-88c2-4758-ba3c-d8effc602a68.info Sep 28 15:17:21 devstack sudo[108853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:21 devstack sudo[108853]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-020d1437-34ff-45f9-bdbe-2f15f4424d94 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c1dd4ce-88c2-4758-ba3c-d8effc602a68.info" returned: 0 in 0.299s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-020d1437-34ff-45f9-bdbe-2f15f4424d94 tempest-ProjectMemberTests-293722149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.347s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:21 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-020d1437-34ff-45f9-bdbe-2f15f4424d94 tempest-ProjectMemberTests-293722149 None] Create snapshot completed successfully Sep 28 15:17:22 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-48522c43-7ae1-433e-af8a-28c567e6696b tempest-ProjectMemberTests-293722149 None] Acquiring lock "cinder-ee74b9b2-cba2-4c09-848b-affac2b44ea3-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:22 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-48522c43-7ae1-433e-af8a-28c567e6696b tempest-ProjectMemberTests-293722149 None] Lock "cinder-ee74b9b2-cba2-4c09-848b-affac2b44ea3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:22 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-48522c43-7ae1-433e-af8a-28c567e6696b tempest-ProjectMemberTests-293722149 None] Acquiring lock "cinder-quobyte-9c1dd4ce-88c2-4758-ba3c-d8effc602a68" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:22 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-48522c43-7ae1-433e-af8a-28c567e6696b tempest-ProjectMemberTests-293722149 None] Lock "cinder-quobyte-9c1dd4ce-88c2-4758-ba3c-d8effc602a68" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:22 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-48522c43-7ae1-433e-af8a-28c567e6696b tempest-ProjectMemberTests-293722149 None] Acquiring lock "cinder-quobyte-ee74b9b2-cba2-4c09-848b-affac2b44ea3" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:22 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-48522c43-7ae1-433e-af8a-28c567e6696b tempest-ProjectMemberTests-293722149 None] Lock "cinder-quobyte-ee74b9b2-cba2-4c09-848b-affac2b44ea3" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:22 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-48522c43-7ae1-433e-af8a-28c567e6696b tempest-ProjectMemberTests-293722149 None] Deleting offline snapshot ee74b9b2-cba2-4c09-848b-affac2b44ea3 of volume 9c1dd4ce-88c2-4758-ba3c-d8effc602a68 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:17:22 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-48522c43-7ae1-433e-af8a-28c567e6696b tempest-ProjectMemberTests-293722149 None] snapshot_file for this snap is: volume-9c1dd4ce-88c2-4758-ba3c-d8effc602a68.ee74b9b2-cba2-4c09-848b-affac2b44ea3 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:17:22 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[029bc98c-09ce-40fd-9a1d-1c2139e51ff3]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-48522c43-7ae1-433e-af8a-28c567e6696b tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c1dd4ce-88c2-4758-ba3c-d8effc602a68.ee74b9b2-cba2-4c09-848b-affac2b44ea3 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:23 devstack sudo[108856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c1dd4ce-88c2-4758-ba3c-d8effc602a68.ee74b9b2-cba2-4c09-848b-affac2b44ea3 Sep 28 15:17:23 devstack sudo[108856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:23 devstack sudo[108856]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-48522c43-7ae1-433e-af8a-28c567e6696b tempest-ProjectMemberTests-293722149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c1dd4ce-88c2-4758-ba3c-d8effc602a68.ee74b9b2-cba2-4c09-848b-affac2b44ea3" returned: 0 in 0.485s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:23 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-48522c43-7ae1-433e-af8a-28c567e6696b tempest-ProjectMemberTests-293722149 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c1dd4ce-88c2-4758-ba3c-d8effc602a68(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:17:23 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[1420705a-e9c7-4170-9044-49bb99c07887]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-48522c43-7ae1-433e-af8a-28c567e6696b tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c1dd4ce-88c2-4758-ba3c-d8effc602a68 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:23 devstack sudo[108861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c1dd4ce-88c2-4758-ba3c-d8effc602a68 Sep 28 15:17:23 devstack sudo[108861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:23 devstack sudo[108861]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-48522c43-7ae1-433e-af8a-28c567e6696b tempest-ProjectMemberTests-293722149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c1dd4ce-88c2-4758-ba3c-d8effc602a68" returned: 0 in 0.474s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-48522c43-7ae1-433e-af8a-28c567e6696b tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c1dd4ce-88c2-4758-ba3c-d8effc602a68.ee74b9b2-cba2-4c09-848b-affac2b44ea3 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:23 devstack sudo[108866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c1dd4ce-88c2-4758-ba3c-d8effc602a68.ee74b9b2-cba2-4c09-848b-affac2b44ea3 Sep 28 15:17:23 devstack sudo[108866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:24 devstack sudo[108866]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-48522c43-7ae1-433e-af8a-28c567e6696b tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c1dd4ce-88c2-4758-ba3c-d8effc602a68.ee74b9b2-cba2-4c09-848b-affac2b44ea3" returned: 0 in 0.397s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-48522c43-7ae1-433e-af8a-28c567e6696b tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c1dd4ce-88c2-4758-ba3c-d8effc602a68.ee74b9b2-cba2-4c09-848b-affac2b44ea3 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:24 devstack sudo[108872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c1dd4ce-88c2-4758-ba3c-d8effc602a68.ee74b9b2-cba2-4c09-848b-affac2b44ea3 Sep 28 15:17:24 devstack sudo[108872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:24 devstack sudo[108872]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-48522c43-7ae1-433e-af8a-28c567e6696b tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c1dd4ce-88c2-4758-ba3c-d8effc602a68.ee74b9b2-cba2-4c09-848b-affac2b44ea3" returned: 0 in 0.328s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:24 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-48522c43-7ae1-433e-af8a-28c567e6696b tempest-ProjectMemberTests-293722149 None] Lock "cinder-quobyte-ee74b9b2-cba2-4c09-848b-affac2b44ea3" released by "_delete_snapshot" :: held 1.922s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:24 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-48522c43-7ae1-433e-af8a-28c567e6696b tempest-ProjectMemberTests-293722149 None] Lock "cinder-quobyte-9c1dd4ce-88c2-4758-ba3c-d8effc602a68" released by "delete_snapshot" :: held 1.951s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:24 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-48522c43-7ae1-433e-af8a-28c567e6696b tempest-ProjectMemberTests-293722149 None] Created reservations ['3025cfec-084a-449c-bc0e-fed91c2a7b9b', '0b22ac77-9886-4296-8d68-ddc91443f547', 'cd63d7d0-0302-4d45-b85d-df0425741771', '457e460f-b389-4747-ab03-53dc5aa2dbca'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:17:24 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-48522c43-7ae1-433e-af8a-28c567e6696b tempest-ProjectMemberTests-293722149 None] Delete snapshot completed successfully. Sep 28 15:17:24 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-48522c43-7ae1-433e-af8a-28c567e6696b tempest-ProjectMemberTests-293722149 None] Lock "cinder-ee74b9b2-cba2-4c09-848b-affac2b44ea3-delete_snapshot" released by "delete_snapshot" :: held 2.164s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:25 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0f146291-65b2-40dd-9d95-817543f0793a tempest-ProjectMemberTests-293722149 None] Acquiring lock "cinder-9c1dd4ce-88c2-4758-ba3c-d8effc602a68-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0f146291-65b2-40dd-9d95-817543f0793a tempest-ProjectMemberTests-293722149 None] Lock "cinder-9c1dd4ce-88c2-4758-ba3c-d8effc602a68-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0f146291-65b2-40dd-9d95-817543f0793a tempest-ProjectMemberTests-293722149 None] Acquiring lock "cinder-quobyte-9c1dd4ce-88c2-4758-ba3c-d8effc602a68" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0f146291-65b2-40dd-9d95-817543f0793a tempest-ProjectMemberTests-293722149 None] Lock "cinder-quobyte-9c1dd4ce-88c2-4758-ba3c-d8effc602a68" acquired by "delete_volume" :: waited 0.019s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:26 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e918db4-1d9c-4ec6-8a3d-de603857a4e0]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0f146291-65b2-40dd-9d95-817543f0793a tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c1dd4ce-88c2-4758-ba3c-d8effc602a68 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:26 devstack sudo[108876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c1dd4ce-88c2-4758-ba3c-d8effc602a68 Sep 28 15:17:26 devstack sudo[108876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:26 devstack sudo[108876]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0f146291-65b2-40dd-9d95-817543f0793a tempest-ProjectMemberTests-293722149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c1dd4ce-88c2-4758-ba3c-d8effc602a68" returned: 0 in 0.393s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0f146291-65b2-40dd-9d95-817543f0793a tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c1dd4ce-88c2-4758-ba3c-d8effc602a68 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:26 devstack sudo[108881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c1dd4ce-88c2-4758-ba3c-d8effc602a68 Sep 28 15:17:26 devstack sudo[108881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:26 devstack sudo[108881]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0f146291-65b2-40dd-9d95-817543f0793a tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c1dd4ce-88c2-4758-ba3c-d8effc602a68" returned: 0 in 0.309s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0f146291-65b2-40dd-9d95-817543f0793a tempest-ProjectMemberTests-293722149 None] Lock "cinder-quobyte-9c1dd4ce-88c2-4758-ba3c-d8effc602a68" released by "delete_volume" :: held 0.783s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:26 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-0f146291-65b2-40dd-9d95-817543f0793a tempest-ProjectMemberTests-293722149 None] Created reservations ['34de353f-f6c9-4f08-87b2-7f85217294bc', 'eb66cd8d-ea03-4091-8dc9-ea662b98b8f2', 'd9aabed9-7720-4c45-84a0-51ce898d72ca', '6dfbd7a3-592d-4923-aead-52a8da4d6b7e'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:17:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0f146291-65b2-40dd-9d95-817543f0793a tempest-ProjectMemberTests-293722149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0f146291-65b2-40dd-9d95-817543f0793a tempest-ProjectMemberTests-293722149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0f146291-65b2-40dd-9d95-817543f0793a tempest-ProjectMemberTests-293722149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0f146291-65b2-40dd-9d95-817543f0793a tempest-ProjectMemberTests-293722149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0f146291-65b2-40dd-9d95-817543f0793a tempest-ProjectMemberTests-293722149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0f146291-65b2-40dd-9d95-817543f0793a tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:27 devstack sudo[108884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:17:27 devstack sudo[108884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:27 devstack sudo[108884]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0f146291-65b2-40dd-9d95-817543f0793a tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.361s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:27 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-0f146291-65b2-40dd-9d95-817543f0793a tempest-ProjectMemberTests-293722149 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:17:27 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-0f146291-65b2-40dd-9d95-817543f0793a tempest-ProjectMemberTests-293722149 None] Deleted volume successfully. Sep 28 15:17:27 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0f146291-65b2-40dd-9d95-817543f0793a tempest-ProjectMemberTests-293722149 None] Lock "cinder-9c1dd4ce-88c2-4758-ba3c-d8effc602a68-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:27 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-8228b421-d36f-4fd7-85f3-739286b90ada tempest-ProjectMemberTests-293722149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:17:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8228b421-d36f-4fd7-85f3-739286b90ada tempest-ProjectMemberTests-293722149 None] Flow 'volume_create_manager' (f34f5e48-93a1-41d0-be1c-114833ec4b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:17:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8228b421-d36f-4fd7-85f3-739286b90ada tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25e57de9-4353-43c4-a983-f12b95d66a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8228b421-d36f-4fd7-85f3-739286b90ada tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25e57de9-4353-43c4-a983-f12b95d66a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:17:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-285464613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c771484-ce48-4602-b796-b642ba88bcd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd1cca6dd0284a7c863af0b50e63e06b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:17:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:17:28Z,use_quota=True,user_id='f79e6dc0ec9740e0ab12c9a6bf177496',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8228b421-d36f-4fd7-85f3-739286b90ada tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeab7104-2efa-475e-a476-b372d5e86d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8228b421-d36f-4fd7-85f3-739286b90ada tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeab7104-2efa-475e-a476-b372d5e86d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8228b421-d36f-4fd7-85f3-739286b90ada tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a642b6e5-3755-49ea-a062-fedd860450e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8228b421-d36f-4fd7-85f3-739286b90ada tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a642b6e5-3755-49ea-a062-fedd860450e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c771484-ce48-4602-b796-b642ba88bcd0', 'volume_name': 'volume-9c771484-ce48-4602-b796-b642ba88bcd0', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8228b421-d36f-4fd7-85f3-739286b90ada tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74dfedad-be48-4e89-bead-30e73701c66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8228b421-d36f-4fd7-85f3-739286b90ada tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74dfedad-be48-4e89-bead-30e73701c66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8228b421-d36f-4fd7-85f3-739286b90ada tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ce3ccf9-1be7-4ee7-8562-596df873cbc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:27 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-8228b421-d36f-4fd7-85f3-739286b90ada tempest-ProjectMemberTests-293722149 None] Volume 9c771484-ce48-4602-b796-b642ba88bcd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c771484-ce48-4602-b796-b642ba88bcd0', 'volume_size': 1} Sep 28 15:17:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8228b421-d36f-4fd7-85f3-739286b90ada tempest-ProjectMemberTests-293722149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8228b421-d36f-4fd7-85f3-739286b90ada tempest-ProjectMemberTests-293722149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8228b421-d36f-4fd7-85f3-739286b90ada tempest-ProjectMemberTests-293722149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:17:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-285464613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c771484-ce48-4602-b796-b642ba88bcd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd1cca6dd0284a7c863af0b50e63e06b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:17:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:17:28Z,use_quota=True,user_id='f79e6dc0ec9740e0ab12c9a6bf177496',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:17:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-8228b421-d36f-4fd7-85f3-739286b90ada tempest-ProjectMemberTests-293722149 None] Creating volume 9c771484-ce48-4602-b796-b642ba88bcd0 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:17:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8228b421-d36f-4fd7-85f3-739286b90ada tempest-ProjectMemberTests-293722149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8228b421-d36f-4fd7-85f3-739286b90ada tempest-ProjectMemberTests-293722149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8228b421-d36f-4fd7-85f3-739286b90ada tempest-ProjectMemberTests-293722149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8228b421-d36f-4fd7-85f3-739286b90ada tempest-ProjectMemberTests-293722149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8228b421-d36f-4fd7-85f3-739286b90ada tempest-ProjectMemberTests-293722149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8228b421-d36f-4fd7-85f3-739286b90ada tempest-ProjectMemberTests-293722149 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:17:27 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-8228b421-d36f-4fd7-85f3-739286b90ada tempest-ProjectMemberTests-293722149 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:17:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8228b421-d36f-4fd7-85f3-739286b90ada tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c771484-ce48-4602-b796-b642ba88bcd0 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:27 devstack sudo[108887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c771484-ce48-4602-b796-b642ba88bcd0 1073741824 Sep 28 15:17:27 devstack sudo[108887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:28 devstack sudo[108887]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8228b421-d36f-4fd7-85f3-739286b90ada tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c771484-ce48-4602-b796-b642ba88bcd0 1073741824" returned: 0 in 0.472s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8228b421-d36f-4fd7-85f3-739286b90ada tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c771484-ce48-4602-b796-b642ba88bcd0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:28 devstack sudo[108894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c771484-ce48-4602-b796-b642ba88bcd0 Sep 28 15:17:28 devstack sudo[108894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:28 devstack sudo[108894]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8228b421-d36f-4fd7-85f3-739286b90ada tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c771484-ce48-4602-b796-b642ba88bcd0" returned: 0 in 0.324s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:28 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8228b421-d36f-4fd7-85f3-739286b90ada tempest-ProjectMemberTests-293722149 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:17:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8228b421-d36f-4fd7-85f3-739286b90ada tempest-ProjectMemberTests-293722149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8228b421-d36f-4fd7-85f3-739286b90ada tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ce3ccf9-1be7-4ee7-8562-596df873cbc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c771484-ce48-4602-b796-b642ba88bcd0', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8228b421-d36f-4fd7-85f3-739286b90ada tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80d154ce-6ad6-4c9d-b510-1cc885b522c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:28 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-8228b421-d36f-4fd7-85f3-739286b90ada tempest-ProjectMemberTests-293722149 None] Volume volume-9c771484-ce48-4602-b796-b642ba88bcd0 (9c771484-ce48-4602-b796-b642ba88bcd0): created successfully Sep 28 15:17:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8228b421-d36f-4fd7-85f3-739286b90ada tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80d154ce-6ad6-4c9d-b510-1cc885b522c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8228b421-d36f-4fd7-85f3-739286b90ada tempest-ProjectMemberTests-293722149 None] Flow 'volume_create_manager' (f34f5e48-93a1-41d0-be1c-114833ec4b4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:17:28 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-8228b421-d36f-4fd7-85f3-739286b90ada tempest-ProjectMemberTests-293722149 None] Created volume successfully. Sep 28 15:17:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9f30d365-f5ce-4696-b79d-9b3be334fc29 tempest-ProjectMemberTests-293722149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9f30d365-f5ce-4696-b79d-9b3be334fc29 tempest-ProjectMemberTests-293722149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-9f30d365-f5ce-4696-b79d-9b3be334fc29 tempest-ProjectMemberTests-293722149 None] Creating offline snapshot 3d644583-9d14-414f-b200-b9f48b260904 of volume 9c771484-ce48-4602-b796-b642ba88bcd0 {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:17:30 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac88bb0-c4a0-4a72-a0a8-48daea5f7303]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9f30d365-f5ce-4696-b79d-9b3be334fc29 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c771484-ce48-4602-b796-b642ba88bcd0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:30 devstack sudo[108897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c771484-ce48-4602-b796-b642ba88bcd0 Sep 28 15:17:30 devstack sudo[108897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:30 devstack sudo[108897]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9f30d365-f5ce-4696-b79d-9b3be334fc29 tempest-ProjectMemberTests-293722149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c771484-ce48-4602-b796-b642ba88bcd0" returned: 0 in 0.436s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9f30d365-f5ce-4696-b79d-9b3be334fc29 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c771484-ce48-4602-b796-b642ba88bcd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c771484-ce48-4602-b796-b642ba88bcd0.3d644583-9d14-414f-b200-b9f48b260904 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:30 devstack sudo[108902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c771484-ce48-4602-b796-b642ba88bcd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c771484-ce48-4602-b796-b642ba88bcd0.3d644583-9d14-414f-b200-b9f48b260904 1G Sep 28 15:17:30 devstack sudo[108902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:31 devstack sudo[108902]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9f30d365-f5ce-4696-b79d-9b3be334fc29 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c771484-ce48-4602-b796-b642ba88bcd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c771484-ce48-4602-b796-b642ba88bcd0.3d644583-9d14-414f-b200-b9f48b260904 1G" returned: 0 in 0.513s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9f30d365-f5ce-4696-b79d-9b3be334fc29 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c771484-ce48-4602-b796-b642ba88bcd0 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c771484-ce48-4602-b796-b642ba88bcd0.3d644583-9d14-414f-b200-b9f48b260904 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:31 devstack sudo[108910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c771484-ce48-4602-b796-b642ba88bcd0 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c771484-ce48-4602-b796-b642ba88bcd0.3d644583-9d14-414f-b200-b9f48b260904 Sep 28 15:17:31 devstack sudo[108910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:31 devstack sudo[108910]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9f30d365-f5ce-4696-b79d-9b3be334fc29 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c771484-ce48-4602-b796-b642ba88bcd0 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c771484-ce48-4602-b796-b642ba88bcd0.3d644583-9d14-414f-b200-b9f48b260904" returned: 0 in 0.329s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:31 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-9f30d365-f5ce-4696-b79d-9b3be334fc29 tempest-ProjectMemberTests-293722149 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c771484-ce48-4602-b796-b642ba88bcd0.3d644583-9d14-414f-b200-b9f48b260904 is being set with open permissions: ugo+rw Sep 28 15:17:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9f30d365-f5ce-4696-b79d-9b3be334fc29 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c771484-ce48-4602-b796-b642ba88bcd0.3d644583-9d14-414f-b200-b9f48b260904 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:31 devstack sudo[108916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c771484-ce48-4602-b796-b642ba88bcd0.3d644583-9d14-414f-b200-b9f48b260904 Sep 28 15:17:31 devstack sudo[108916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:31 devstack sudo[108916]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9f30d365-f5ce-4696-b79d-9b3be334fc29 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c771484-ce48-4602-b796-b642ba88bcd0.3d644583-9d14-414f-b200-b9f48b260904" returned: 0 in 0.268s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9f30d365-f5ce-4696-b79d-9b3be334fc29 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c771484-ce48-4602-b796-b642ba88bcd0.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:31 devstack sudo[108919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c771484-ce48-4602-b796-b642ba88bcd0.info Sep 28 15:17:31 devstack sudo[108919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:32 devstack sudo[108919]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9f30d365-f5ce-4696-b79d-9b3be334fc29 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c771484-ce48-4602-b796-b642ba88bcd0.info" returned: 0 in 0.307s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:32 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-9f30d365-f5ce-4696-b79d-9b3be334fc29 tempest-ProjectMemberTests-293722149 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c771484-ce48-4602-b796-b642ba88bcd0.info is being set with open permissions: ugo+rw Sep 28 15:17:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9f30d365-f5ce-4696-b79d-9b3be334fc29 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c771484-ce48-4602-b796-b642ba88bcd0.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:32 devstack sudo[108922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c771484-ce48-4602-b796-b642ba88bcd0.info Sep 28 15:17:32 devstack sudo[108922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:32 devstack sudo[108922]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9f30d365-f5ce-4696-b79d-9b3be334fc29 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c771484-ce48-4602-b796-b642ba88bcd0.info" returned: 0 in 0.298s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9f30d365-f5ce-4696-b79d-9b3be334fc29 tempest-ProjectMemberTests-293722149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.271s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:32 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-9f30d365-f5ce-4696-b79d-9b3be334fc29 tempest-ProjectMemberTests-293722149 None] Create snapshot completed successfully Sep 28 15:17:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c41ba544-c207-4e19-9ab6-369e37f58b6a tempest-ProjectMemberTests-293722149 None] Acquiring lock "cinder-3d644583-9d14-414f-b200-b9f48b260904-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c41ba544-c207-4e19-9ab6-369e37f58b6a tempest-ProjectMemberTests-293722149 None] Lock "cinder-3d644583-9d14-414f-b200-b9f48b260904-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c41ba544-c207-4e19-9ab6-369e37f58b6a tempest-ProjectMemberTests-293722149 None] Acquiring lock "cinder-quobyte-9c771484-ce48-4602-b796-b642ba88bcd0" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c41ba544-c207-4e19-9ab6-369e37f58b6a tempest-ProjectMemberTests-293722149 None] Lock "cinder-quobyte-9c771484-ce48-4602-b796-b642ba88bcd0" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c41ba544-c207-4e19-9ab6-369e37f58b6a tempest-ProjectMemberTests-293722149 None] Acquiring lock "cinder-quobyte-3d644583-9d14-414f-b200-b9f48b260904" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c41ba544-c207-4e19-9ab6-369e37f58b6a tempest-ProjectMemberTests-293722149 None] Lock "cinder-quobyte-3d644583-9d14-414f-b200-b9f48b260904" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:33 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-c41ba544-c207-4e19-9ab6-369e37f58b6a tempest-ProjectMemberTests-293722149 None] Deleting offline snapshot 3d644583-9d14-414f-b200-b9f48b260904 of volume 9c771484-ce48-4602-b796-b642ba88bcd0 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:17:33 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-c41ba544-c207-4e19-9ab6-369e37f58b6a tempest-ProjectMemberTests-293722149 None] snapshot_file for this snap is: volume-9c771484-ce48-4602-b796-b642ba88bcd0.3d644583-9d14-414f-b200-b9f48b260904 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:17:33 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[373c348c-ad6b-4dd6-b96e-046945ae26e4]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c41ba544-c207-4e19-9ab6-369e37f58b6a tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c771484-ce48-4602-b796-b642ba88bcd0.3d644583-9d14-414f-b200-b9f48b260904 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:33 devstack sudo[108925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c771484-ce48-4602-b796-b642ba88bcd0.3d644583-9d14-414f-b200-b9f48b260904 Sep 28 15:17:33 devstack sudo[108925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:34 devstack sudo[108925]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c41ba544-c207-4e19-9ab6-369e37f58b6a tempest-ProjectMemberTests-293722149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c771484-ce48-4602-b796-b642ba88bcd0.3d644583-9d14-414f-b200-b9f48b260904" returned: 0 in 0.511s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:34 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-c41ba544-c207-4e19-9ab6-369e37f58b6a tempest-ProjectMemberTests-293722149 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c771484-ce48-4602-b796-b642ba88bcd0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:17:34 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[22651380-de60-40d7-bdca-baa29c29967a]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c41ba544-c207-4e19-9ab6-369e37f58b6a tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c771484-ce48-4602-b796-b642ba88bcd0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:34 devstack sudo[108937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c771484-ce48-4602-b796-b642ba88bcd0 Sep 28 15:17:34 devstack sudo[108937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:34 devstack sudo[108937]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c41ba544-c207-4e19-9ab6-369e37f58b6a tempest-ProjectMemberTests-293722149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c771484-ce48-4602-b796-b642ba88bcd0" returned: 0 in 0.486s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c41ba544-c207-4e19-9ab6-369e37f58b6a tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c771484-ce48-4602-b796-b642ba88bcd0.3d644583-9d14-414f-b200-b9f48b260904 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:34 devstack sudo[108942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c771484-ce48-4602-b796-b642ba88bcd0.3d644583-9d14-414f-b200-b9f48b260904 Sep 28 15:17:34 devstack sudo[108942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:35 devstack sudo[108942]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c41ba544-c207-4e19-9ab6-369e37f58b6a tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c771484-ce48-4602-b796-b642ba88bcd0.3d644583-9d14-414f-b200-b9f48b260904" returned: 0 in 0.449s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c41ba544-c207-4e19-9ab6-369e37f58b6a tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c771484-ce48-4602-b796-b642ba88bcd0.3d644583-9d14-414f-b200-b9f48b260904 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:35 devstack sudo[108947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c771484-ce48-4602-b796-b642ba88bcd0.3d644583-9d14-414f-b200-b9f48b260904 Sep 28 15:17:35 devstack sudo[108947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:35 devstack sudo[108947]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c41ba544-c207-4e19-9ab6-369e37f58b6a tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c771484-ce48-4602-b796-b642ba88bcd0.3d644583-9d14-414f-b200-b9f48b260904" returned: 0 in 0.303s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:35 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c41ba544-c207-4e19-9ab6-369e37f58b6a tempest-ProjectMemberTests-293722149 None] Lock "cinder-quobyte-3d644583-9d14-414f-b200-b9f48b260904" released by "_delete_snapshot" :: held 1.897s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:35 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c41ba544-c207-4e19-9ab6-369e37f58b6a tempest-ProjectMemberTests-293722149 None] Lock "cinder-quobyte-9c771484-ce48-4602-b796-b642ba88bcd0" released by "delete_snapshot" :: held 1.928s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:35 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-c41ba544-c207-4e19-9ab6-369e37f58b6a tempest-ProjectMemberTests-293722149 None] Created reservations ['276cdd0b-a2fc-45c4-a4c8-0409d6ca64e1', 'f3dc8c84-df52-46ef-8b28-4d9b4aed2073', 'c0203263-09ad-4870-b5e9-ea384683a618', '724ef23c-6bbb-4c0d-bc84-0a652d082d79'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:17:35 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-c41ba544-c207-4e19-9ab6-369e37f58b6a tempest-ProjectMemberTests-293722149 None] Delete snapshot completed successfully. Sep 28 15:17:35 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c41ba544-c207-4e19-9ab6-369e37f58b6a tempest-ProjectMemberTests-293722149 None] Lock "cinder-3d644583-9d14-414f-b200-b9f48b260904-delete_snapshot" released by "delete_snapshot" :: held 2.151s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:36 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3108d6c2-27b2-4fbb-b2e1-ef69b193e877 tempest-ProjectMemberTests-293722149 None] Acquiring lock "cinder-9c771484-ce48-4602-b796-b642ba88bcd0-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:36 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3108d6c2-27b2-4fbb-b2e1-ef69b193e877 tempest-ProjectMemberTests-293722149 None] Lock "cinder-9c771484-ce48-4602-b796-b642ba88bcd0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:36 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3108d6c2-27b2-4fbb-b2e1-ef69b193e877 tempest-ProjectMemberTests-293722149 None] Acquiring lock "cinder-quobyte-9c771484-ce48-4602-b796-b642ba88bcd0" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:36 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3108d6c2-27b2-4fbb-b2e1-ef69b193e877 tempest-ProjectMemberTests-293722149 None] Lock "cinder-quobyte-9c771484-ce48-4602-b796-b642ba88bcd0" acquired by "delete_volume" :: waited 0.022s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:36 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1c4c79-0311-4309-9b0f-ce8f02625c15]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3108d6c2-27b2-4fbb-b2e1-ef69b193e877 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c771484-ce48-4602-b796-b642ba88bcd0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:36 devstack sudo[108950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c771484-ce48-4602-b796-b642ba88bcd0 Sep 28 15:17:36 devstack sudo[108950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:37 devstack sudo[108950]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3108d6c2-27b2-4fbb-b2e1-ef69b193e877 tempest-ProjectMemberTests-293722149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c771484-ce48-4602-b796-b642ba88bcd0" returned: 0 in 0.469s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3108d6c2-27b2-4fbb-b2e1-ef69b193e877 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c771484-ce48-4602-b796-b642ba88bcd0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:37 devstack sudo[108955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c771484-ce48-4602-b796-b642ba88bcd0 Sep 28 15:17:37 devstack sudo[108955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:37 devstack sudo[108955]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3108d6c2-27b2-4fbb-b2e1-ef69b193e877 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9c771484-ce48-4602-b796-b642ba88bcd0" returned: 0 in 0.373s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:37 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3108d6c2-27b2-4fbb-b2e1-ef69b193e877 tempest-ProjectMemberTests-293722149 None] Lock "cinder-quobyte-9c771484-ce48-4602-b796-b642ba88bcd0" released by "delete_volume" :: held 0.931s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:37 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a600509-3162-4058-9bbb-1bcec7d8bec4 tempest-SnapshotDependencyTests-1849452807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:17:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0a600509-3162-4058-9bbb-1bcec7d8bec4 tempest-SnapshotDependencyTests-1849452807 None] Flow 'volume_create_manager' (bd9086a6-e344-430f-8c8d-5eea04b2dbec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:17:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0a600509-3162-4058-9bbb-1bcec7d8bec4 tempest-SnapshotDependencyTests-1849452807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af25d1e2-4398-49cf-b6f4-8c6a24d565bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0a600509-3162-4058-9bbb-1bcec7d8bec4 tempest-SnapshotDependencyTests-1849452807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af25d1e2-4398-49cf-b6f4-8c6a24d565bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:17:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2112217166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=475fbd20-6b45-4efb-902f-07d39d69bb27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1635b5ad9bb439082d6cabba5c24760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:17:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:17:38Z,use_quota=True,user_id='5ccddf8448cb4254a21c6adcf60284e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0a600509-3162-4058-9bbb-1bcec7d8bec4 tempest-SnapshotDependencyTests-1849452807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5200468c-1731-43fc-82ae-ae644248cd1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0a600509-3162-4058-9bbb-1bcec7d8bec4 tempest-SnapshotDependencyTests-1849452807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5200468c-1731-43fc-82ae-ae644248cd1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0a600509-3162-4058-9bbb-1bcec7d8bec4 tempest-SnapshotDependencyTests-1849452807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a56db3c-6354-4d66-954f-87d7cc180839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0a600509-3162-4058-9bbb-1bcec7d8bec4 tempest-SnapshotDependencyTests-1849452807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a56db3c-6354-4d66-954f-87d7cc180839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '475fbd20-6b45-4efb-902f-07d39d69bb27', 'volume_name': 'volume-475fbd20-6b45-4efb-902f-07d39d69bb27', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0a600509-3162-4058-9bbb-1bcec7d8bec4 tempest-SnapshotDependencyTests-1849452807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b16e171-77b6-47f6-9c9c-ed6337ca72e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0a600509-3162-4058-9bbb-1bcec7d8bec4 tempest-SnapshotDependencyTests-1849452807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b16e171-77b6-47f6-9c9c-ed6337ca72e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0a600509-3162-4058-9bbb-1bcec7d8bec4 tempest-SnapshotDependencyTests-1849452807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a66dd85a-311b-4128-a01a-f21ecfe8df31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:37 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-0a600509-3162-4058-9bbb-1bcec7d8bec4 tempest-SnapshotDependencyTests-1849452807 None] Volume 475fbd20-6b45-4efb-902f-07d39d69bb27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-475fbd20-6b45-4efb-902f-07d39d69bb27', 'volume_size': 1} Sep 28 15:17:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0a600509-3162-4058-9bbb-1bcec7d8bec4 tempest-SnapshotDependencyTests-1849452807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0a600509-3162-4058-9bbb-1bcec7d8bec4 tempest-SnapshotDependencyTests-1849452807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:37 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0a600509-3162-4058-9bbb-1bcec7d8bec4 tempest-SnapshotDependencyTests-1849452807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:17:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2112217166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=475fbd20-6b45-4efb-902f-07d39d69bb27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1635b5ad9bb439082d6cabba5c24760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:17:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:17:38Z,use_quota=True,user_id='5ccddf8448cb4254a21c6adcf60284e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:17:37 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-0a600509-3162-4058-9bbb-1bcec7d8bec4 tempest-SnapshotDependencyTests-1849452807 None] Creating volume 475fbd20-6b45-4efb-902f-07d39d69bb27 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:17:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0a600509-3162-4058-9bbb-1bcec7d8bec4 tempest-SnapshotDependencyTests-1849452807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0a600509-3162-4058-9bbb-1bcec7d8bec4 tempest-SnapshotDependencyTests-1849452807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:37 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0a600509-3162-4058-9bbb-1bcec7d8bec4 tempest-SnapshotDependencyTests-1849452807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:37 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0a600509-3162-4058-9bbb-1bcec7d8bec4 tempest-SnapshotDependencyTests-1849452807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0a600509-3162-4058-9bbb-1bcec7d8bec4 tempest-SnapshotDependencyTests-1849452807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:37 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0a600509-3162-4058-9bbb-1bcec7d8bec4 tempest-SnapshotDependencyTests-1849452807 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:17:37 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-0a600509-3162-4058-9bbb-1bcec7d8bec4 tempest-SnapshotDependencyTests-1849452807 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:17:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0a600509-3162-4058-9bbb-1bcec7d8bec4 tempest-SnapshotDependencyTests-1849452807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-475fbd20-6b45-4efb-902f-07d39d69bb27 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:37 devstack sudo[108958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-475fbd20-6b45-4efb-902f-07d39d69bb27 1073741824 Sep 28 15:17:37 devstack sudo[108958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:37 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-3108d6c2-27b2-4fbb-b2e1-ef69b193e877 tempest-ProjectMemberTests-293722149 None] Created reservations ['c12498f5-f4b8-4bba-b8eb-0fb80656d817', 'a17ef989-5710-46d2-9902-9d4a363b7b9e', '5d0488f3-adca-4084-888b-a95752d7083c', '72dffeb1-eb24-4341-91ed-f0cf663e1225'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:17:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3108d6c2-27b2-4fbb-b2e1-ef69b193e877 tempest-ProjectMemberTests-293722149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3108d6c2-27b2-4fbb-b2e1-ef69b193e877 tempest-ProjectMemberTests-293722149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:37 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3108d6c2-27b2-4fbb-b2e1-ef69b193e877 tempest-ProjectMemberTests-293722149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:37 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3108d6c2-27b2-4fbb-b2e1-ef69b193e877 tempest-ProjectMemberTests-293722149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3108d6c2-27b2-4fbb-b2e1-ef69b193e877 tempest-ProjectMemberTests-293722149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3108d6c2-27b2-4fbb-b2e1-ef69b193e877 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:37 devstack sudo[108960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:17:37 devstack sudo[108960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:38 devstack sudo[108960]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3108d6c2-27b2-4fbb-b2e1-ef69b193e877 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.340s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:38 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-3108d6c2-27b2-4fbb-b2e1-ef69b193e877 tempest-ProjectMemberTests-293722149 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:17:38 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-3108d6c2-27b2-4fbb-b2e1-ef69b193e877 tempest-ProjectMemberTests-293722149 None] Deleted volume successfully. Sep 28 15:17:38 devstack sudo[108958]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0a600509-3162-4058-9bbb-1bcec7d8bec4 tempest-SnapshotDependencyTests-1849452807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-475fbd20-6b45-4efb-902f-07d39d69bb27 1073741824" returned: 0 in 0.538s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3108d6c2-27b2-4fbb-b2e1-ef69b193e877 tempest-ProjectMemberTests-293722149 None] Lock "cinder-9c771484-ce48-4602-b796-b642ba88bcd0-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0a600509-3162-4058-9bbb-1bcec7d8bec4 tempest-SnapshotDependencyTests-1849452807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-475fbd20-6b45-4efb-902f-07d39d69bb27 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:38 devstack sudo[108967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-475fbd20-6b45-4efb-902f-07d39d69bb27 Sep 28 15:17:38 devstack sudo[108967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:38 devstack sudo[108967]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0a600509-3162-4058-9bbb-1bcec7d8bec4 tempest-SnapshotDependencyTests-1849452807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-475fbd20-6b45-4efb-902f-07d39d69bb27" returned: 0 in 0.278s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:38 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0a600509-3162-4058-9bbb-1bcec7d8bec4 tempest-SnapshotDependencyTests-1849452807 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:17:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0a600509-3162-4058-9bbb-1bcec7d8bec4 tempest-SnapshotDependencyTests-1849452807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0a600509-3162-4058-9bbb-1bcec7d8bec4 tempest-SnapshotDependencyTests-1849452807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a66dd85a-311b-4128-a01a-f21ecfe8df31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-475fbd20-6b45-4efb-902f-07d39d69bb27', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0a600509-3162-4058-9bbb-1bcec7d8bec4 tempest-SnapshotDependencyTests-1849452807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea5f1f18-edf1-41f5-afdc-c280d2f5cd6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:38 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-0a600509-3162-4058-9bbb-1bcec7d8bec4 tempest-SnapshotDependencyTests-1849452807 None] Volume volume-475fbd20-6b45-4efb-902f-07d39d69bb27 (475fbd20-6b45-4efb-902f-07d39d69bb27): created successfully Sep 28 15:17:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0a600509-3162-4058-9bbb-1bcec7d8bec4 tempest-SnapshotDependencyTests-1849452807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea5f1f18-edf1-41f5-afdc-c280d2f5cd6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0a600509-3162-4058-9bbb-1bcec7d8bec4 tempest-SnapshotDependencyTests-1849452807 None] Flow 'volume_create_manager' (bd9086a6-e344-430f-8c8d-5eea04b2dbec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:17:38 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-0a600509-3162-4058-9bbb-1bcec7d8bec4 tempest-SnapshotDependencyTests-1849452807 None] Created volume successfully. Sep 28 15:17:39 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-e92b41b4-e4d9-46db-883d-09e2dc3028ec tempest-ProjectMemberTests-293722149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:17:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e92b41b4-e4d9-46db-883d-09e2dc3028ec tempest-ProjectMemberTests-293722149 None] Flow 'volume_create_manager' (3f2a1d8c-e8a4-4216-a8f6-5dfd6142d9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:17:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e92b41b4-e4d9-46db-883d-09e2dc3028ec tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29b94bab-b7ce-4782-92fa-12b054d7d0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e92b41b4-e4d9-46db-883d-09e2dc3028ec tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29b94bab-b7ce-4782-92fa-12b054d7d0e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:17:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-178749299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4b53593-4d5e-43eb-8e38-faca5988fb72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd1cca6dd0284a7c863af0b50e63e06b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:17:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:17:39Z,use_quota=True,user_id='f79e6dc0ec9740e0ab12c9a6bf177496',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e92b41b4-e4d9-46db-883d-09e2dc3028ec tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34803bcd-da28-469e-b3f7-af2ad2d25398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e92b41b4-e4d9-46db-883d-09e2dc3028ec tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34803bcd-da28-469e-b3f7-af2ad2d25398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e92b41b4-e4d9-46db-883d-09e2dc3028ec tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (238cd56a-6091-4f53-a7ad-691113566542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e92b41b4-e4d9-46db-883d-09e2dc3028ec tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (238cd56a-6091-4f53-a7ad-691113566542) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4b53593-4d5e-43eb-8e38-faca5988fb72', 'volume_name': 'volume-f4b53593-4d5e-43eb-8e38-faca5988fb72', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e92b41b4-e4d9-46db-883d-09e2dc3028ec tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3d11291-79eb-4662-a135-77a617f7b44f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e92b41b4-e4d9-46db-883d-09e2dc3028ec tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3d11291-79eb-4662-a135-77a617f7b44f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e92b41b4-e4d9-46db-883d-09e2dc3028ec tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e6f3db9-d6bd-4666-b4c4-a91835440255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:39 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-e92b41b4-e4d9-46db-883d-09e2dc3028ec tempest-ProjectMemberTests-293722149 None] Volume f4b53593-4d5e-43eb-8e38-faca5988fb72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4b53593-4d5e-43eb-8e38-faca5988fb72', 'volume_size': 1} Sep 28 15:17:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e92b41b4-e4d9-46db-883d-09e2dc3028ec tempest-ProjectMemberTests-293722149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e92b41b4-e4d9-46db-883d-09e2dc3028ec tempest-ProjectMemberTests-293722149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e92b41b4-e4d9-46db-883d-09e2dc3028ec tempest-ProjectMemberTests-293722149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:17:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-178749299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4b53593-4d5e-43eb-8e38-faca5988fb72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd1cca6dd0284a7c863af0b50e63e06b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:17:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:17:39Z,use_quota=True,user_id='f79e6dc0ec9740e0ab12c9a6bf177496',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:17:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-e92b41b4-e4d9-46db-883d-09e2dc3028ec tempest-ProjectMemberTests-293722149 None] Creating volume f4b53593-4d5e-43eb-8e38-faca5988fb72 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:17:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e92b41b4-e4d9-46db-883d-09e2dc3028ec tempest-ProjectMemberTests-293722149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e92b41b4-e4d9-46db-883d-09e2dc3028ec tempest-ProjectMemberTests-293722149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e92b41b4-e4d9-46db-883d-09e2dc3028ec tempest-ProjectMemberTests-293722149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e92b41b4-e4d9-46db-883d-09e2dc3028ec tempest-ProjectMemberTests-293722149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e92b41b4-e4d9-46db-883d-09e2dc3028ec tempest-ProjectMemberTests-293722149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e92b41b4-e4d9-46db-883d-09e2dc3028ec tempest-ProjectMemberTests-293722149 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:17:39 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-e92b41b4-e4d9-46db-883d-09e2dc3028ec tempest-ProjectMemberTests-293722149 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:17:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e92b41b4-e4d9-46db-883d-09e2dc3028ec tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f4b53593-4d5e-43eb-8e38-faca5988fb72 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:39 devstack sudo[108970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f4b53593-4d5e-43eb-8e38-faca5988fb72 1073741824 Sep 28 15:17:39 devstack sudo[108970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1b9a78eb-9171-4f56-aada-45a4671fbde1 tempest-SnapshotDependencyTests-1849452807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:40 devstack sudo[108970]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e92b41b4-e4d9-46db-883d-09e2dc3028ec tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f4b53593-4d5e-43eb-8e38-faca5988fb72 1073741824" returned: 0 in 0.564s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e92b41b4-e4d9-46db-883d-09e2dc3028ec tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f4b53593-4d5e-43eb-8e38-faca5988fb72 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:40 devstack sudo[108976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f4b53593-4d5e-43eb-8e38-faca5988fb72 Sep 28 15:17:40 devstack sudo[108976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:40 devstack sudo[108976]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e92b41b4-e4d9-46db-883d-09e2dc3028ec tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f4b53593-4d5e-43eb-8e38-faca5988fb72" returned: 0 in 0.244s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:40 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e92b41b4-e4d9-46db-883d-09e2dc3028ec tempest-ProjectMemberTests-293722149 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:17:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e92b41b4-e4d9-46db-883d-09e2dc3028ec tempest-ProjectMemberTests-293722149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1b9a78eb-9171-4f56-aada-45a4671fbde1 tempest-SnapshotDependencyTests-1849452807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.300s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:40 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-1b9a78eb-9171-4f56-aada-45a4671fbde1 tempest-SnapshotDependencyTests-1849452807 None] Creating offline snapshot e3e74f70-50ce-4720-9370-d68cdfbe38ce of volume 475fbd20-6b45-4efb-902f-07d39d69bb27 {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:17:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e92b41b4-e4d9-46db-883d-09e2dc3028ec tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e6f3db9-d6bd-4666-b4c4-a91835440255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4b53593-4d5e-43eb-8e38-faca5988fb72', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e92b41b4-e4d9-46db-883d-09e2dc3028ec tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2821a9f-8b3b-4de9-934e-c3f9bfd13b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:40 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[592c5662-b2e1-49f9-b0e5-51a2c475cfd3]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1b9a78eb-9171-4f56-aada-45a4671fbde1 tempest-SnapshotDependencyTests-1849452807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-475fbd20-6b45-4efb-902f-07d39d69bb27 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:40 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-e92b41b4-e4d9-46db-883d-09e2dc3028ec tempest-ProjectMemberTests-293722149 None] Volume volume-f4b53593-4d5e-43eb-8e38-faca5988fb72 (f4b53593-4d5e-43eb-8e38-faca5988fb72): created successfully Sep 28 15:17:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e92b41b4-e4d9-46db-883d-09e2dc3028ec tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2821a9f-8b3b-4de9-934e-c3f9bfd13b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e92b41b4-e4d9-46db-883d-09e2dc3028ec tempest-ProjectMemberTests-293722149 None] Flow 'volume_create_manager' (3f2a1d8c-e8a4-4216-a8f6-5dfd6142d9ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:17:40 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-e92b41b4-e4d9-46db-883d-09e2dc3028ec tempest-ProjectMemberTests-293722149 None] Created volume successfully. Sep 28 15:17:40 devstack sudo[108979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-475fbd20-6b45-4efb-902f-07d39d69bb27 Sep 28 15:17:40 devstack sudo[108979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:40 devstack sudo[108979]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1b9a78eb-9171-4f56-aada-45a4671fbde1 tempest-SnapshotDependencyTests-1849452807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-475fbd20-6b45-4efb-902f-07d39d69bb27" returned: 0 in 0.376s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1b9a78eb-9171-4f56-aada-45a4671fbde1 tempest-SnapshotDependencyTests-1849452807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-475fbd20-6b45-4efb-902f-07d39d69bb27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-475fbd20-6b45-4efb-902f-07d39d69bb27.e3e74f70-50ce-4720-9370-d68cdfbe38ce 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:40 devstack sudo[108984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-475fbd20-6b45-4efb-902f-07d39d69bb27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-475fbd20-6b45-4efb-902f-07d39d69bb27.e3e74f70-50ce-4720-9370-d68cdfbe38ce 1G Sep 28 15:17:40 devstack sudo[108984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:41 devstack sudo[108984]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1b9a78eb-9171-4f56-aada-45a4671fbde1 tempest-SnapshotDependencyTests-1849452807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-475fbd20-6b45-4efb-902f-07d39d69bb27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-475fbd20-6b45-4efb-902f-07d39d69bb27.e3e74f70-50ce-4720-9370-d68cdfbe38ce 1G" returned: 0 in 0.474s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1b9a78eb-9171-4f56-aada-45a4671fbde1 tempest-SnapshotDependencyTests-1849452807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-475fbd20-6b45-4efb-902f-07d39d69bb27 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-475fbd20-6b45-4efb-902f-07d39d69bb27.e3e74f70-50ce-4720-9370-d68cdfbe38ce {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:41 devstack sudo[108989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-475fbd20-6b45-4efb-902f-07d39d69bb27 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-475fbd20-6b45-4efb-902f-07d39d69bb27.e3e74f70-50ce-4720-9370-d68cdfbe38ce Sep 28 15:17:41 devstack sudo[108989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:41 devstack sudo[108989]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1b9a78eb-9171-4f56-aada-45a4671fbde1 tempest-SnapshotDependencyTests-1849452807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-475fbd20-6b45-4efb-902f-07d39d69bb27 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-475fbd20-6b45-4efb-902f-07d39d69bb27.e3e74f70-50ce-4720-9370-d68cdfbe38ce" returned: 0 in 0.385s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:41 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-1b9a78eb-9171-4f56-aada-45a4671fbde1 tempest-SnapshotDependencyTests-1849452807 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-475fbd20-6b45-4efb-902f-07d39d69bb27.e3e74f70-50ce-4720-9370-d68cdfbe38ce is being set with open permissions: ugo+rw Sep 28 15:17:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1b9a78eb-9171-4f56-aada-45a4671fbde1 tempest-SnapshotDependencyTests-1849452807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-475fbd20-6b45-4efb-902f-07d39d69bb27.e3e74f70-50ce-4720-9370-d68cdfbe38ce {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:41 devstack sudo[108995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-475fbd20-6b45-4efb-902f-07d39d69bb27.e3e74f70-50ce-4720-9370-d68cdfbe38ce Sep 28 15:17:41 devstack sudo[108995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-63403c63-6db6-45c1-84af-df9017b8f857 tempest-ProjectMemberTests-293722149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:42 devstack sudo[108995]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1b9a78eb-9171-4f56-aada-45a4671fbde1 tempest-SnapshotDependencyTests-1849452807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-475fbd20-6b45-4efb-902f-07d39d69bb27.e3e74f70-50ce-4720-9370-d68cdfbe38ce" returned: 0 in 0.290s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1b9a78eb-9171-4f56-aada-45a4671fbde1 tempest-SnapshotDependencyTests-1849452807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-475fbd20-6b45-4efb-902f-07d39d69bb27.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:42 devstack sudo[108998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-475fbd20-6b45-4efb-902f-07d39d69bb27.info Sep 28 15:17:42 devstack sudo[108998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:42 devstack sudo[108998]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1b9a78eb-9171-4f56-aada-45a4671fbde1 tempest-SnapshotDependencyTests-1849452807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-475fbd20-6b45-4efb-902f-07d39d69bb27.info" returned: 0 in 0.290s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:42 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-1b9a78eb-9171-4f56-aada-45a4671fbde1 tempest-SnapshotDependencyTests-1849452807 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-475fbd20-6b45-4efb-902f-07d39d69bb27.info is being set with open permissions: ugo+rw Sep 28 15:17:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1b9a78eb-9171-4f56-aada-45a4671fbde1 tempest-SnapshotDependencyTests-1849452807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-475fbd20-6b45-4efb-902f-07d39d69bb27.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:42 devstack sudo[109001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-475fbd20-6b45-4efb-902f-07d39d69bb27.info Sep 28 15:17:42 devstack sudo[109001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:42 devstack sudo[109001]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1b9a78eb-9171-4f56-aada-45a4671fbde1 tempest-SnapshotDependencyTests-1849452807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-475fbd20-6b45-4efb-902f-07d39d69bb27.info" returned: 0 in 0.239s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1b9a78eb-9171-4f56-aada-45a4671fbde1 tempest-SnapshotDependencyTests-1849452807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.160s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-63403c63-6db6-45c1-84af-df9017b8f857 tempest-ProjectMemberTests-293722149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.850s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:42 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-63403c63-6db6-45c1-84af-df9017b8f857 tempest-ProjectMemberTests-293722149 None] Creating offline snapshot d2886f58-a713-428e-9a12-6b40d97e6ba0 of volume f4b53593-4d5e-43eb-8e38-faca5988fb72 {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:17:42 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-1b9a78eb-9171-4f56-aada-45a4671fbde1 tempest-SnapshotDependencyTests-1849452807 None] Create snapshot completed successfully Sep 28 15:17:42 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[343db987-05b0-449c-b5c0-abc5df07e76b]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-63403c63-6db6-45c1-84af-df9017b8f857 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f4b53593-4d5e-43eb-8e38-faca5988fb72 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:42 devstack sudo[109004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f4b53593-4d5e-43eb-8e38-faca5988fb72 Sep 28 15:17:42 devstack sudo[109004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:43 devstack sudo[109004]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-63403c63-6db6-45c1-84af-df9017b8f857 tempest-ProjectMemberTests-293722149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f4b53593-4d5e-43eb-8e38-faca5988fb72" returned: 0 in 0.370s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-63403c63-6db6-45c1-84af-df9017b8f857 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f4b53593-4d5e-43eb-8e38-faca5988fb72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f4b53593-4d5e-43eb-8e38-faca5988fb72.d2886f58-a713-428e-9a12-6b40d97e6ba0 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:43 devstack sudo[109009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f4b53593-4d5e-43eb-8e38-faca5988fb72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f4b53593-4d5e-43eb-8e38-faca5988fb72.d2886f58-a713-428e-9a12-6b40d97e6ba0 1G Sep 28 15:17:43 devstack sudo[109009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:43 devstack sudo[109009]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-63403c63-6db6-45c1-84af-df9017b8f857 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f4b53593-4d5e-43eb-8e38-faca5988fb72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f4b53593-4d5e-43eb-8e38-faca5988fb72.d2886f58-a713-428e-9a12-6b40d97e6ba0 1G" returned: 0 in 0.571s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-63403c63-6db6-45c1-84af-df9017b8f857 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4b53593-4d5e-43eb-8e38-faca5988fb72 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f4b53593-4d5e-43eb-8e38-faca5988fb72.d2886f58-a713-428e-9a12-6b40d97e6ba0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:43 devstack sudo[109049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4b53593-4d5e-43eb-8e38-faca5988fb72 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f4b53593-4d5e-43eb-8e38-faca5988fb72.d2886f58-a713-428e-9a12-6b40d97e6ba0 Sep 28 15:17:43 devstack sudo[109049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:43 devstack sudo[109049]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-63403c63-6db6-45c1-84af-df9017b8f857 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4b53593-4d5e-43eb-8e38-faca5988fb72 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f4b53593-4d5e-43eb-8e38-faca5988fb72.d2886f58-a713-428e-9a12-6b40d97e6ba0" returned: 0 in 0.382s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:43 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-63403c63-6db6-45c1-84af-df9017b8f857 tempest-ProjectMemberTests-293722149 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f4b53593-4d5e-43eb-8e38-faca5988fb72.d2886f58-a713-428e-9a12-6b40d97e6ba0 is being set with open permissions: ugo+rw Sep 28 15:17:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-63403c63-6db6-45c1-84af-df9017b8f857 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f4b53593-4d5e-43eb-8e38-faca5988fb72.d2886f58-a713-428e-9a12-6b40d97e6ba0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:44 devstack sudo[109056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f4b53593-4d5e-43eb-8e38-faca5988fb72.d2886f58-a713-428e-9a12-6b40d97e6ba0 Sep 28 15:17:44 devstack sudo[109056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:44 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-85af2016-a8ea-4448-857e-16f49fac4ca6 tempest-SnapshotDependencyTests-1849452807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:17:44 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-85af2016-a8ea-4448-857e-16f49fac4ca6 tempest-SnapshotDependencyTests-1849452807 None] Flow 'volume_create_manager' (16bd1042-4645-48dd-b2c9-ff10afc5c6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:17:44 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-85af2016-a8ea-4448-857e-16f49fac4ca6 tempest-SnapshotDependencyTests-1849452807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6695f35-84bb-4149-a58d-8c894a402017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:44 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-85af2016-a8ea-4448-857e-16f49fac4ca6 tempest-SnapshotDependencyTests-1849452807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6695f35-84bb-4149-a58d-8c894a402017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:17:44Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59b72f53-feea-406f-a819-139003aea2cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1635b5ad9bb439082d6cabba5c24760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:17:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e3e74f70-50ce-4720-9370-d68cdfbe38ce,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:17:44Z,use_quota=True,user_id='5ccddf8448cb4254a21c6adcf60284e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:44 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-85af2016-a8ea-4448-857e-16f49fac4ca6 tempest-SnapshotDependencyTests-1849452807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39cdf491-b44d-4578-9122-88dce05e5fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:44 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-85af2016-a8ea-4448-857e-16f49fac4ca6 tempest-SnapshotDependencyTests-1849452807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39cdf491-b44d-4578-9122-88dce05e5fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:44 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-85af2016-a8ea-4448-857e-16f49fac4ca6 tempest-SnapshotDependencyTests-1849452807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69a2cf8e-bdec-4562-ba46-8ef319e94839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:44 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-85af2016-a8ea-4448-857e-16f49fac4ca6 tempest-SnapshotDependencyTests-1849452807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69a2cf8e-bdec-4562-ba46-8ef319e94839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '59b72f53-feea-406f-a819-139003aea2cb', 'volume_name': 'volume-59b72f53-feea-406f-a819-139003aea2cb', 'volume_size': 1, 'snapshot_id': 'e3e74f70-50ce-4720-9370-d68cdfbe38ce'}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:44 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-85af2016-a8ea-4448-857e-16f49fac4ca6 tempest-SnapshotDependencyTests-1849452807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4cbd6d6-6ef6-4579-ad76-fde5e1e2c9f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:44 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-85af2016-a8ea-4448-857e-16f49fac4ca6 tempest-SnapshotDependencyTests-1849452807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4cbd6d6-6ef6-4579-ad76-fde5e1e2c9f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:44 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-85af2016-a8ea-4448-857e-16f49fac4ca6 tempest-SnapshotDependencyTests-1849452807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9255d34-62d7-46cb-b68f-49cc9b07f546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:44 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-85af2016-a8ea-4448-857e-16f49fac4ca6 tempest-SnapshotDependencyTests-1849452807 None] Volume 59b72f53-feea-406f-a819-139003aea2cb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-59b72f53-feea-406f-a819-139003aea2cb', 'volume_size': 1, 'snapshot_id': 'e3e74f70-50ce-4720-9370-d68cdfbe38ce'} Sep 28 15:17:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-85af2016-a8ea-4448-857e-16f49fac4ca6 tempest-SnapshotDependencyTests-1849452807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:44 devstack sudo[109056]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-63403c63-6db6-45c1-84af-df9017b8f857 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f4b53593-4d5e-43eb-8e38-faca5988fb72.d2886f58-a713-428e-9a12-6b40d97e6ba0" returned: 0 in 0.268s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-63403c63-6db6-45c1-84af-df9017b8f857 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f4b53593-4d5e-43eb-8e38-faca5988fb72.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:44 devstack sudo[109059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f4b53593-4d5e-43eb-8e38-faca5988fb72.info Sep 28 15:17:44 devstack sudo[109059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:44 devstack sudo[109059]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-63403c63-6db6-45c1-84af-df9017b8f857 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f4b53593-4d5e-43eb-8e38-faca5988fb72.info" returned: 0 in 0.250s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:44 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-63403c63-6db6-45c1-84af-df9017b8f857 tempest-ProjectMemberTests-293722149 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f4b53593-4d5e-43eb-8e38-faca5988fb72.info is being set with open permissions: ugo+rw Sep 28 15:17:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-63403c63-6db6-45c1-84af-df9017b8f857 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f4b53593-4d5e-43eb-8e38-faca5988fb72.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:44 devstack sudo[109062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f4b53593-4d5e-43eb-8e38-faca5988fb72.info Sep 28 15:17:44 devstack sudo[109062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:44 devstack sudo[109062]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-63403c63-6db6-45c1-84af-df9017b8f857 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f4b53593-4d5e-43eb-8e38-faca5988fb72.info" returned: 0 in 0.244s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-63403c63-6db6-45c1-84af-df9017b8f857 tempest-ProjectMemberTests-293722149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.177s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-85af2016-a8ea-4448-857e-16f49fac4ca6 tempest-SnapshotDependencyTests-1849452807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.603s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:44 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-85af2016-a8ea-4448-857e-16f49fac4ca6 tempest-SnapshotDependencyTests-1849452807 None] Acquiring lock "cinder-quobyte-e3e74f70-50ce-4720-9370-d68cdfbe38ce-59b72f53-feea-406f-a819-139003aea2cb" by "_create_volume_from_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:44 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=84,cinder:UPDATE=103,cinder:INSERT=38,cinder:DELETE=6 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:17:44 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-85af2016-a8ea-4448-857e-16f49fac4ca6 tempest-SnapshotDependencyTests-1849452807 None] Lock "cinder-quobyte-e3e74f70-50ce-4720-9370-d68cdfbe38ce-59b72f53-feea-406f-a819-139003aea2cb" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:44 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-85af2016-a8ea-4448-857e-16f49fac4ca6 tempest-SnapshotDependencyTests-1849452807 None] Creating volume 59b72f53-feea-406f-a819-139003aea2cb from snapshot e3e74f70-50ce-4720-9370-d68cdfbe38ce {{(pid=87116) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 15:17:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-85af2016-a8ea-4448-857e-16f49fac4ca6 tempest-SnapshotDependencyTests-1849452807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-85af2016-a8ea-4448-857e-16f49fac4ca6 tempest-SnapshotDependencyTests-1849452807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:44 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-85af2016-a8ea-4448-857e-16f49fac4ca6 tempest-SnapshotDependencyTests-1849452807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:44 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-85af2016-a8ea-4448-857e-16f49fac4ca6 tempest-SnapshotDependencyTests-1849452807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-85af2016-a8ea-4448-857e-16f49fac4ca6 tempest-SnapshotDependencyTests-1849452807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:44 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-85af2016-a8ea-4448-857e-16f49fac4ca6 tempest-SnapshotDependencyTests-1849452807 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:17:44 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-85af2016-a8ea-4448-857e-16f49fac4ca6 tempest-SnapshotDependencyTests-1849452807 None] Acquiring lock "cinder-quobyte-59b72f53-feea-406f-a819-139003aea2cb" by "_copy_volume_from_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:44 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-63403c63-6db6-45c1-84af-df9017b8f857 tempest-ProjectMemberTests-293722149 None] Create snapshot completed successfully Sep 28 15:17:44 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-85af2016-a8ea-4448-857e-16f49fac4ca6 tempest-SnapshotDependencyTests-1849452807 None] Lock "cinder-quobyte-59b72f53-feea-406f-a819-139003aea2cb" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:44 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-85af2016-a8ea-4448-857e-16f49fac4ca6 tempest-SnapshotDependencyTests-1849452807 None] snapshot: e3e74f70-50ce-4720-9370-d68cdfbe38ce, volume: 59b72f53-feea-406f-a819-139003aea2cb, {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 15:17:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-85af2016-a8ea-4448-857e-16f49fac4ca6 tempest-SnapshotDependencyTests-1849452807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-85af2016-a8ea-4448-857e-16f49fac4ca6 tempest-SnapshotDependencyTests-1849452807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:44 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-85af2016-a8ea-4448-857e-16f49fac4ca6 tempest-SnapshotDependencyTests-1849452807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:44 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-85af2016-a8ea-4448-857e-16f49fac4ca6 tempest-SnapshotDependencyTests-1849452807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-85af2016-a8ea-4448-857e-16f49fac4ca6 tempest-SnapshotDependencyTests-1849452807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:44 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[742fc7a1-c224-4aca-99be-3d7f1206a567]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-85af2016-a8ea-4448-857e-16f49fac4ca6 tempest-SnapshotDependencyTests-1849452807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-475fbd20-6b45-4efb-902f-07d39d69bb27.e3e74f70-50ce-4720-9370-d68cdfbe38ce {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:44 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f00b1220-a84e-4a30-b2e5-29b91f6e0e82 tempest-ProjectMemberTests-293722149 None] Acquiring lock "cinder-d2886f58-a713-428e-9a12-6b40d97e6ba0-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f00b1220-a84e-4a30-b2e5-29b91f6e0e82 tempest-ProjectMemberTests-293722149 None] Lock "cinder-d2886f58-a713-428e-9a12-6b40d97e6ba0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f00b1220-a84e-4a30-b2e5-29b91f6e0e82 tempest-ProjectMemberTests-293722149 None] Acquiring lock "cinder-quobyte-f4b53593-4d5e-43eb-8e38-faca5988fb72" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f00b1220-a84e-4a30-b2e5-29b91f6e0e82 tempest-ProjectMemberTests-293722149 None] Lock "cinder-quobyte-f4b53593-4d5e-43eb-8e38-faca5988fb72" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f00b1220-a84e-4a30-b2e5-29b91f6e0e82 tempest-ProjectMemberTests-293722149 None] Acquiring lock "cinder-quobyte-d2886f58-a713-428e-9a12-6b40d97e6ba0" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f00b1220-a84e-4a30-b2e5-29b91f6e0e82 tempest-ProjectMemberTests-293722149 None] Lock "cinder-quobyte-d2886f58-a713-428e-9a12-6b40d97e6ba0" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:45 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-f00b1220-a84e-4a30-b2e5-29b91f6e0e82 tempest-ProjectMemberTests-293722149 None] Deleting offline snapshot d2886f58-a713-428e-9a12-6b40d97e6ba0 of volume f4b53593-4d5e-43eb-8e38-faca5988fb72 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:17:45 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-f00b1220-a84e-4a30-b2e5-29b91f6e0e82 tempest-ProjectMemberTests-293722149 None] snapshot_file for this snap is: volume-f4b53593-4d5e-43eb-8e38-faca5988fb72.d2886f58-a713-428e-9a12-6b40d97e6ba0 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:17:45 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[116dcdfc-fbe0-4401-87e9-68479340756e]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f00b1220-a84e-4a30-b2e5-29b91f6e0e82 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f4b53593-4d5e-43eb-8e38-faca5988fb72.d2886f58-a713-428e-9a12-6b40d97e6ba0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:45 devstack sudo[109065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-475fbd20-6b45-4efb-902f-07d39d69bb27.e3e74f70-50ce-4720-9370-d68cdfbe38ce Sep 28 15:17:45 devstack sudo[109065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:45 devstack sudo[109066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f4b53593-4d5e-43eb-8e38-faca5988fb72.d2886f58-a713-428e-9a12-6b40d97e6ba0 Sep 28 15:17:45 devstack sudo[109066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:45 devstack sudo[109065]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-85af2016-a8ea-4448-857e-16f49fac4ca6 tempest-SnapshotDependencyTests-1849452807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-475fbd20-6b45-4efb-902f-07d39d69bb27.e3e74f70-50ce-4720-9370-d68cdfbe38ce" returned: 0 in 0.420s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:45 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-85af2016-a8ea-4448-857e-16f49fac4ca6 tempest-SnapshotDependencyTests-1849452807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-475fbd20-6b45-4efb-902f-07d39d69bb27(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:17:45 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[3efd9dd4-23c0-4a92-840f-3948af42f9ca]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-85af2016-a8ea-4448-857e-16f49fac4ca6 tempest-SnapshotDependencyTests-1849452807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-475fbd20-6b45-4efb-902f-07d39d69bb27 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:45 devstack sudo[109066]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f00b1220-a84e-4a30-b2e5-29b91f6e0e82 tempest-ProjectMemberTests-293722149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f4b53593-4d5e-43eb-8e38-faca5988fb72.d2886f58-a713-428e-9a12-6b40d97e6ba0" returned: 0 in 0.420s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:45 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-f00b1220-a84e-4a30-b2e5-29b91f6e0e82 tempest-ProjectMemberTests-293722149 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4b53593-4d5e-43eb-8e38-faca5988fb72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:17:45 devstack sudo[109072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-475fbd20-6b45-4efb-902f-07d39d69bb27 Sep 28 15:17:45 devstack sudo[109072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:45 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a4898a-b314-477e-822b-5e4e6aa0e685]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f00b1220-a84e-4a30-b2e5-29b91f6e0e82 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f4b53593-4d5e-43eb-8e38-faca5988fb72 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:45 devstack sudo[109077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f4b53593-4d5e-43eb-8e38-faca5988fb72 Sep 28 15:17:45 devstack sudo[109077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:45 devstack sudo[109072]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-85af2016-a8ea-4448-857e-16f49fac4ca6 tempest-SnapshotDependencyTests-1849452807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-475fbd20-6b45-4efb-902f-07d39d69bb27" returned: 0 in 0.418s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:45 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-85af2016-a8ea-4448-857e-16f49fac4ca6 tempest-SnapshotDependencyTests-1849452807 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-475fbd20-6b45-4efb-902f-07d39d69bb27 {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 15:17:45 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-85af2016-a8ea-4448-857e-16f49fac4ca6 tempest-SnapshotDependencyTests-1849452807 None] Creating direct copy from snapshot {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 15:17:45 devstack cinder-volume[87116]: DEBUG cinder.utils [None req-85af2016-a8ea-4448-857e-16f49fac4ca6 tempest-SnapshotDependencyTests-1849452807 None] Path /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-59b72f53-feea-406f-a819-139003aea2cb not found in is_blk_device check {{(pid=87116) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 15:17:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-85af2016-a8ea-4448-857e-16f49fac4ca6 tempest-SnapshotDependencyTests-1849452807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-475fbd20-6b45-4efb-902f-07d39d69bb27 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-59b72f53-feea-406f-a819-139003aea2cb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:45 devstack sudo[109082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-475fbd20-6b45-4efb-902f-07d39d69bb27 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-59b72f53-feea-406f-a819-139003aea2cb Sep 28 15:17:45 devstack sudo[109082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:45 devstack sudo[109077]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f00b1220-a84e-4a30-b2e5-29b91f6e0e82 tempest-ProjectMemberTests-293722149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f4b53593-4d5e-43eb-8e38-faca5988fb72" returned: 0 in 0.397s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f00b1220-a84e-4a30-b2e5-29b91f6e0e82 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f4b53593-4d5e-43eb-8e38-faca5988fb72.d2886f58-a713-428e-9a12-6b40d97e6ba0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:45 devstack sudo[109087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f4b53593-4d5e-43eb-8e38-faca5988fb72.d2886f58-a713-428e-9a12-6b40d97e6ba0 Sep 28 15:17:45 devstack sudo[109087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:46 devstack sudo[109087]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f00b1220-a84e-4a30-b2e5-29b91f6e0e82 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f4b53593-4d5e-43eb-8e38-faca5988fb72.d2886f58-a713-428e-9a12-6b40d97e6ba0" returned: 0 in 0.388s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f00b1220-a84e-4a30-b2e5-29b91f6e0e82 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f4b53593-4d5e-43eb-8e38-faca5988fb72.d2886f58-a713-428e-9a12-6b40d97e6ba0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:46 devstack sudo[109101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f4b53593-4d5e-43eb-8e38-faca5988fb72.d2886f58-a713-428e-9a12-6b40d97e6ba0 Sep 28 15:17:46 devstack sudo[109101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:46 devstack sudo[109101]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f00b1220-a84e-4a30-b2e5-29b91f6e0e82 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f4b53593-4d5e-43eb-8e38-faca5988fb72.d2886f58-a713-428e-9a12-6b40d97e6ba0" returned: 0 in 0.383s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f00b1220-a84e-4a30-b2e5-29b91f6e0e82 tempest-ProjectMemberTests-293722149 None] Lock "cinder-quobyte-d2886f58-a713-428e-9a12-6b40d97e6ba0" released by "_delete_snapshot" :: held 1.732s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f00b1220-a84e-4a30-b2e5-29b91f6e0e82 tempest-ProjectMemberTests-293722149 None] Lock "cinder-quobyte-f4b53593-4d5e-43eb-8e38-faca5988fb72" released by "delete_snapshot" :: held 1.762s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:46 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-f00b1220-a84e-4a30-b2e5-29b91f6e0e82 tempest-ProjectMemberTests-293722149 None] Created reservations ['f595e5b5-d5f6-4113-abfa-c3aecb3678ec', 'bd161af2-5bf8-4d0e-8f5f-39d64c882cd6', 'd6e406c2-2fbc-4f85-864a-95b4e430bbaa', '995d7874-1b1e-4a33-b787-af53bfee51d3'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:17:47 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-f00b1220-a84e-4a30-b2e5-29b91f6e0e82 tempest-ProjectMemberTests-293722149 None] Delete snapshot completed successfully. Sep 28 15:17:47 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f00b1220-a84e-4a30-b2e5-29b91f6e0e82 tempest-ProjectMemberTests-293722149 None] Lock "cinder-d2886f58-a713-428e-9a12-6b40d97e6ba0-delete_snapshot" released by "delete_snapshot" :: held 2.085s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:47 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-63c6f0d0-b973-4563-ae3f-57064633a200 tempest-ProjectMemberTests-293722149 None] Acquiring lock "cinder-f4b53593-4d5e-43eb-8e38-faca5988fb72-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:47 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-63c6f0d0-b973-4563-ae3f-57064633a200 tempest-ProjectMemberTests-293722149 None] Lock "cinder-f4b53593-4d5e-43eb-8e38-faca5988fb72-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:47 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-63c6f0d0-b973-4563-ae3f-57064633a200 tempest-ProjectMemberTests-293722149 None] Acquiring lock "cinder-quobyte-f4b53593-4d5e-43eb-8e38-faca5988fb72" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:47 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-63c6f0d0-b973-4563-ae3f-57064633a200 tempest-ProjectMemberTests-293722149 None] Lock "cinder-quobyte-f4b53593-4d5e-43eb-8e38-faca5988fb72" acquired by "delete_volume" :: waited 0.024s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:47 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[6270d94e-cfa8-42d8-999c-949467fc69fb]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-63c6f0d0-b973-4563-ae3f-57064633a200 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f4b53593-4d5e-43eb-8e38-faca5988fb72 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:47 devstack sudo[109106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f4b53593-4d5e-43eb-8e38-faca5988fb72 Sep 28 15:17:47 devstack sudo[109106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:48 devstack sudo[109106]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-63c6f0d0-b973-4563-ae3f-57064633a200 tempest-ProjectMemberTests-293722149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f4b53593-4d5e-43eb-8e38-faca5988fb72" returned: 0 in 0.677s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-63c6f0d0-b973-4563-ae3f-57064633a200 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f4b53593-4d5e-43eb-8e38-faca5988fb72 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:48 devstack sudo[109111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f4b53593-4d5e-43eb-8e38-faca5988fb72 Sep 28 15:17:48 devstack sudo[109111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:48 devstack sudo[109111]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-63c6f0d0-b973-4563-ae3f-57064633a200 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-f4b53593-4d5e-43eb-8e38-faca5988fb72" returned: 0 in 0.590s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:48 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-63c6f0d0-b973-4563-ae3f-57064633a200 tempest-ProjectMemberTests-293722149 None] Lock "cinder-quobyte-f4b53593-4d5e-43eb-8e38-faca5988fb72" released by "delete_volume" :: held 1.417s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:49 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-63c6f0d0-b973-4563-ae3f-57064633a200 tempest-ProjectMemberTests-293722149 None] Created reservations ['f434e6c3-ff1b-43b4-9b20-e4ef538ec06e', 'cc5d2872-abf6-43d0-bc30-10f9764ce308', '3581c92d-e38b-41d6-a337-3396938ae6ac', '7bb320d8-b1ae-4a54-93c0-ba8d61834342'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:17:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-63c6f0d0-b973-4563-ae3f-57064633a200 tempest-ProjectMemberTests-293722149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-63c6f0d0-b973-4563-ae3f-57064633a200 tempest-ProjectMemberTests-293722149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-63c6f0d0-b973-4563-ae3f-57064633a200 tempest-ProjectMemberTests-293722149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-63c6f0d0-b973-4563-ae3f-57064633a200 tempest-ProjectMemberTests-293722149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-63c6f0d0-b973-4563-ae3f-57064633a200 tempest-ProjectMemberTests-293722149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-63c6f0d0-b973-4563-ae3f-57064633a200 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:49 devstack sudo[109114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:17:49 devstack sudo[109114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:49 devstack sudo[109114]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-63c6f0d0-b973-4563-ae3f-57064633a200 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.475s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:49 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-63c6f0d0-b973-4563-ae3f-57064633a200 tempest-ProjectMemberTests-293722149 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:17:49 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-63c6f0d0-b973-4563-ae3f-57064633a200 tempest-ProjectMemberTests-293722149 None] Deleted volume successfully. Sep 28 15:17:49 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-63c6f0d0-b973-4563-ae3f-57064633a200 tempest-ProjectMemberTests-293722149 None] Lock "cinder-f4b53593-4d5e-43eb-8e38-faca5988fb72-delete_volume" released by "delete_volume" :: held 2.527s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:50 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-d23bf50b-70ff-4dac-8969-698cfc736f1e tempest-ProjectMemberTests-293722149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:17:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d23bf50b-70ff-4dac-8969-698cfc736f1e tempest-ProjectMemberTests-293722149 None] Flow 'volume_create_manager' (541e4b9e-1194-46f7-9172-3644fa78edbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:17:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d23bf50b-70ff-4dac-8969-698cfc736f1e tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e83d524c-dcee-44ea-9040-8db24be30e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d23bf50b-70ff-4dac-8969-698cfc736f1e tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e83d524c-dcee-44ea-9040-8db24be30e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1387169475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ee4f036-90f2-42e8-8bb6-80d6d235ba06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd1cca6dd0284a7c863af0b50e63e06b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:17:51Z,use_quota=True,user_id='f79e6dc0ec9740e0ab12c9a6bf177496',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d23bf50b-70ff-4dac-8969-698cfc736f1e tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baab1c22-74cf-42a7-a983-8701acf86542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d23bf50b-70ff-4dac-8969-698cfc736f1e tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baab1c22-74cf-42a7-a983-8701acf86542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d23bf50b-70ff-4dac-8969-698cfc736f1e tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c19b562d-e00d-4da9-b5a0-2d578b11c96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d23bf50b-70ff-4dac-8969-698cfc736f1e tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c19b562d-e00d-4da9-b5a0-2d578b11c96c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ee4f036-90f2-42e8-8bb6-80d6d235ba06', 'volume_name': 'volume-2ee4f036-90f2-42e8-8bb6-80d6d235ba06', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d23bf50b-70ff-4dac-8969-698cfc736f1e tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7385803-ccd9-436c-9ad7-9a930e18c4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d23bf50b-70ff-4dac-8969-698cfc736f1e tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7385803-ccd9-436c-9ad7-9a930e18c4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d23bf50b-70ff-4dac-8969-698cfc736f1e tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40b09211-e86d-432d-96fd-8fbbc7287125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:50 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-d23bf50b-70ff-4dac-8969-698cfc736f1e tempest-ProjectMemberTests-293722149 None] Volume 2ee4f036-90f2-42e8-8bb6-80d6d235ba06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ee4f036-90f2-42e8-8bb6-80d6d235ba06', 'volume_size': 1} Sep 28 15:17:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d23bf50b-70ff-4dac-8969-698cfc736f1e tempest-ProjectMemberTests-293722149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:52 devstack sudo[109082]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-85af2016-a8ea-4448-857e-16f49fac4ca6 tempest-SnapshotDependencyTests-1849452807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-475fbd20-6b45-4efb-902f-07d39d69bb27 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-59b72f53-feea-406f-a819-139003aea2cb" returned: 0 in 6.692s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:52 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-85af2016-a8ea-4448-857e-16f49fac4ca6 tempest-SnapshotDependencyTests-1849452807 None] Image conversion details: src /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-475fbd20-6b45-4efb-902f-07d39d69bb27, size 1024.00 MB, duration 6.69 sec, destination /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-59b72f53-feea-406f-a819-139003aea2cb {{(pid=87116) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:17:52 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-85af2016-a8ea-4448-857e-16f49fac4ca6 tempest-SnapshotDependencyTests-1849452807 None] Converted 1024.00 MB image at 153.00 MB/s Sep 28 15:17:52 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-85af2016-a8ea-4448-857e-16f49fac4ca6 tempest-SnapshotDependencyTests-1849452807 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-59b72f53-feea-406f-a819-139003aea2cb is being set with open permissions: ugo+rw Sep 28 15:17:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-85af2016-a8ea-4448-857e-16f49fac4ca6 tempest-SnapshotDependencyTests-1849452807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-59b72f53-feea-406f-a819-139003aea2cb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:52 devstack sudo[109118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-59b72f53-feea-406f-a819-139003aea2cb Sep 28 15:17:52 devstack sudo[109118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:52 devstack sudo[109118]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-85af2016-a8ea-4448-857e-16f49fac4ca6 tempest-SnapshotDependencyTests-1849452807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-59b72f53-feea-406f-a819-139003aea2cb" returned: 0 in 0.249s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:52 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-85af2016-a8ea-4448-857e-16f49fac4ca6 tempest-SnapshotDependencyTests-1849452807 None] Lock "cinder-quobyte-59b72f53-feea-406f-a819-139003aea2cb" released by "_copy_volume_from_snapshot" :: held 7.897s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:52 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-85af2016-a8ea-4448-857e-16f49fac4ca6 tempest-SnapshotDependencyTests-1849452807 None] Lock "cinder-quobyte-e3e74f70-50ce-4720-9370-d68cdfbe38ce-59b72f53-feea-406f-a819-139003aea2cb" released by "_create_volume_from_snapshot" :: held 7.978s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-85af2016-a8ea-4448-857e-16f49fac4ca6 tempest-SnapshotDependencyTests-1849452807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.017s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d23bf50b-70ff-4dac-8969-698cfc736f1e tempest-ProjectMemberTests-293722149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.922s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d23bf50b-70ff-4dac-8969-698cfc736f1e tempest-ProjectMemberTests-293722149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1387169475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ee4f036-90f2-42e8-8bb6-80d6d235ba06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd1cca6dd0284a7c863af0b50e63e06b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:17:51Z,use_quota=True,user_id='f79e6dc0ec9740e0ab12c9a6bf177496',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:17:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-d23bf50b-70ff-4dac-8969-698cfc736f1e tempest-ProjectMemberTests-293722149 None] Creating volume 2ee4f036-90f2-42e8-8bb6-80d6d235ba06 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:17:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d23bf50b-70ff-4dac-8969-698cfc736f1e tempest-ProjectMemberTests-293722149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d23bf50b-70ff-4dac-8969-698cfc736f1e tempest-ProjectMemberTests-293722149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d23bf50b-70ff-4dac-8969-698cfc736f1e tempest-ProjectMemberTests-293722149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d23bf50b-70ff-4dac-8969-698cfc736f1e tempest-ProjectMemberTests-293722149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d23bf50b-70ff-4dac-8969-698cfc736f1e tempest-ProjectMemberTests-293722149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d23bf50b-70ff-4dac-8969-698cfc736f1e tempest-ProjectMemberTests-293722149 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:17:52 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-d23bf50b-70ff-4dac-8969-698cfc736f1e tempest-ProjectMemberTests-293722149 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:17:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d23bf50b-70ff-4dac-8969-698cfc736f1e tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2ee4f036-90f2-42e8-8bb6-80d6d235ba06 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:52 devstack sudo[109121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2ee4f036-90f2-42e8-8bb6-80d6d235ba06 1073741824 Sep 28 15:17:52 devstack sudo[109121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-85af2016-a8ea-4448-857e-16f49fac4ca6 tempest-SnapshotDependencyTests-1849452807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9255d34-62d7-46cb-b68f-49cc9b07f546) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59b72f53-feea-406f-a819-139003aea2cb', 'volume_size': 1, 'snapshot_id': 'e3e74f70-50ce-4720-9370-d68cdfbe38ce'}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-85af2016-a8ea-4448-857e-16f49fac4ca6 tempest-SnapshotDependencyTests-1849452807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fb202ad-3049-4627-a6df-53f07a7ea096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:52 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-85af2016-a8ea-4448-857e-16f49fac4ca6 tempest-SnapshotDependencyTests-1849452807 None] Volume volume-59b72f53-feea-406f-a819-139003aea2cb (59b72f53-feea-406f-a819-139003aea2cb): created successfully Sep 28 15:17:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-85af2016-a8ea-4448-857e-16f49fac4ca6 tempest-SnapshotDependencyTests-1849452807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fb202ad-3049-4627-a6df-53f07a7ea096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-85af2016-a8ea-4448-857e-16f49fac4ca6 tempest-SnapshotDependencyTests-1849452807 None] Flow 'volume_create_manager' (16bd1042-4645-48dd-b2c9-ff10afc5c6e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:17:52 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-85af2016-a8ea-4448-857e-16f49fac4ca6 tempest-SnapshotDependencyTests-1849452807 None] Created volume successfully. Sep 28 15:17:53 devstack sudo[109121]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d23bf50b-70ff-4dac-8969-698cfc736f1e tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2ee4f036-90f2-42e8-8bb6-80d6d235ba06 1073741824" returned: 0 in 0.473s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d23bf50b-70ff-4dac-8969-698cfc736f1e tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2ee4f036-90f2-42e8-8bb6-80d6d235ba06 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:53 devstack sudo[109126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2ee4f036-90f2-42e8-8bb6-80d6d235ba06 Sep 28 15:17:53 devstack sudo[109126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:53 devstack sudo[109126]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d23bf50b-70ff-4dac-8969-698cfc736f1e tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2ee4f036-90f2-42e8-8bb6-80d6d235ba06" returned: 0 in 0.231s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:53 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d23bf50b-70ff-4dac-8969-698cfc736f1e tempest-ProjectMemberTests-293722149 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:17:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d23bf50b-70ff-4dac-8969-698cfc736f1e tempest-ProjectMemberTests-293722149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:53 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d23bf50b-70ff-4dac-8969-698cfc736f1e tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40b09211-e86d-432d-96fd-8fbbc7287125) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ee4f036-90f2-42e8-8bb6-80d6d235ba06', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:53 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d23bf50b-70ff-4dac-8969-698cfc736f1e tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6989104-e760-439e-a47a-2e720f9eef6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:53 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-d23bf50b-70ff-4dac-8969-698cfc736f1e tempest-ProjectMemberTests-293722149 None] Volume volume-2ee4f036-90f2-42e8-8bb6-80d6d235ba06 (2ee4f036-90f2-42e8-8bb6-80d6d235ba06): created successfully Sep 28 15:17:53 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d23bf50b-70ff-4dac-8969-698cfc736f1e tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6989104-e760-439e-a47a-2e720f9eef6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:53 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d23bf50b-70ff-4dac-8969-698cfc736f1e tempest-ProjectMemberTests-293722149 None] Flow 'volume_create_manager' (541e4b9e-1194-46f7-9172-3644fa78edbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:17:53 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-d23bf50b-70ff-4dac-8969-698cfc736f1e tempest-ProjectMemberTests-293722149 None] Created volume successfully. Sep 28 15:17:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-67bff190-eb49-4d68-a553-db06e3882b56 tempest-ProjectMemberTests-293722149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-67bff190-eb49-4d68-a553-db06e3882b56 tempest-ProjectMemberTests-293722149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:53 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-67bff190-eb49-4d68-a553-db06e3882b56 tempest-ProjectMemberTests-293722149 None] Creating offline snapshot 60003b68-3a55-4702-b870-e3a23a2f1399 of volume 2ee4f036-90f2-42e8-8bb6-80d6d235ba06 {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:17:53 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8771dd-f153-4eb3-9b43-801ce4fc7a32]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-67bff190-eb49-4d68-a553-db06e3882b56 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2ee4f036-90f2-42e8-8bb6-80d6d235ba06 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:54 devstack sudo[109129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2ee4f036-90f2-42e8-8bb6-80d6d235ba06 Sep 28 15:17:54 devstack sudo[109129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:54 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1bbda9bd-4168-4ac9-8d0d-a8d59d1ec7fb tempest-SnapshotDependencyTests-1849452807 None] Acquiring lock "cinder-e3e74f70-50ce-4720-9370-d68cdfbe38ce-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:54 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1bbda9bd-4168-4ac9-8d0d-a8d59d1ec7fb tempest-SnapshotDependencyTests-1849452807 None] Lock "cinder-e3e74f70-50ce-4720-9370-d68cdfbe38ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:54 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1bbda9bd-4168-4ac9-8d0d-a8d59d1ec7fb tempest-SnapshotDependencyTests-1849452807 None] Acquiring lock "cinder-quobyte-475fbd20-6b45-4efb-902f-07d39d69bb27" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:54 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1bbda9bd-4168-4ac9-8d0d-a8d59d1ec7fb tempest-SnapshotDependencyTests-1849452807 None] Lock "cinder-quobyte-475fbd20-6b45-4efb-902f-07d39d69bb27" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:54 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1bbda9bd-4168-4ac9-8d0d-a8d59d1ec7fb tempest-SnapshotDependencyTests-1849452807 None] Acquiring lock "cinder-quobyte-e3e74f70-50ce-4720-9370-d68cdfbe38ce" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:54 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1bbda9bd-4168-4ac9-8d0d-a8d59d1ec7fb tempest-SnapshotDependencyTests-1849452807 None] Lock "cinder-quobyte-e3e74f70-50ce-4720-9370-d68cdfbe38ce" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:54 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-1bbda9bd-4168-4ac9-8d0d-a8d59d1ec7fb tempest-SnapshotDependencyTests-1849452807 None] Deleting offline snapshot e3e74f70-50ce-4720-9370-d68cdfbe38ce of volume 475fbd20-6b45-4efb-902f-07d39d69bb27 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:17:54 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-1bbda9bd-4168-4ac9-8d0d-a8d59d1ec7fb tempest-SnapshotDependencyTests-1849452807 None] snapshot_file for this snap is: volume-475fbd20-6b45-4efb-902f-07d39d69bb27.e3e74f70-50ce-4720-9370-d68cdfbe38ce {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:17:54 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa01c591-c5a5-43db-a0ce-c9f13d671bcd]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1bbda9bd-4168-4ac9-8d0d-a8d59d1ec7fb tempest-SnapshotDependencyTests-1849452807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-475fbd20-6b45-4efb-902f-07d39d69bb27.e3e74f70-50ce-4720-9370-d68cdfbe38ce {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:54 devstack sudo[109131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-475fbd20-6b45-4efb-902f-07d39d69bb27.e3e74f70-50ce-4720-9370-d68cdfbe38ce Sep 28 15:17:54 devstack sudo[109131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:54 devstack sudo[109129]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-67bff190-eb49-4d68-a553-db06e3882b56 tempest-ProjectMemberTests-293722149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2ee4f036-90f2-42e8-8bb6-80d6d235ba06" returned: 0 in 0.398s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-67bff190-eb49-4d68-a553-db06e3882b56 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2ee4f036-90f2-42e8-8bb6-80d6d235ba06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2ee4f036-90f2-42e8-8bb6-80d6d235ba06.60003b68-3a55-4702-b870-e3a23a2f1399 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:54 devstack sudo[109136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2ee4f036-90f2-42e8-8bb6-80d6d235ba06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2ee4f036-90f2-42e8-8bb6-80d6d235ba06.60003b68-3a55-4702-b870-e3a23a2f1399 1G Sep 28 15:17:54 devstack sudo[109136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:54 devstack sudo[109131]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1bbda9bd-4168-4ac9-8d0d-a8d59d1ec7fb tempest-SnapshotDependencyTests-1849452807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-475fbd20-6b45-4efb-902f-07d39d69bb27.e3e74f70-50ce-4720-9370-d68cdfbe38ce" returned: 0 in 0.433s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:54 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-1bbda9bd-4168-4ac9-8d0d-a8d59d1ec7fb tempest-SnapshotDependencyTests-1849452807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-475fbd20-6b45-4efb-902f-07d39d69bb27(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:17:54 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b802581-8b9b-4bfb-bbef-c5fd688b2806]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1bbda9bd-4168-4ac9-8d0d-a8d59d1ec7fb tempest-SnapshotDependencyTests-1849452807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-475fbd20-6b45-4efb-902f-07d39d69bb27 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:54 devstack sudo[109136]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-67bff190-eb49-4d68-a553-db06e3882b56 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2ee4f036-90f2-42e8-8bb6-80d6d235ba06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2ee4f036-90f2-42e8-8bb6-80d6d235ba06.60003b68-3a55-4702-b870-e3a23a2f1399 1G" returned: 0 in 0.435s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-67bff190-eb49-4d68-a553-db06e3882b56 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ee4f036-90f2-42e8-8bb6-80d6d235ba06 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2ee4f036-90f2-42e8-8bb6-80d6d235ba06.60003b68-3a55-4702-b870-e3a23a2f1399 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:54 devstack sudo[109144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-475fbd20-6b45-4efb-902f-07d39d69bb27 Sep 28 15:17:54 devstack sudo[109144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:54 devstack sudo[109147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ee4f036-90f2-42e8-8bb6-80d6d235ba06 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2ee4f036-90f2-42e8-8bb6-80d6d235ba06.60003b68-3a55-4702-b870-e3a23a2f1399 Sep 28 15:17:54 devstack sudo[109147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:55 devstack sudo[109147]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-67bff190-eb49-4d68-a553-db06e3882b56 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ee4f036-90f2-42e8-8bb6-80d6d235ba06 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2ee4f036-90f2-42e8-8bb6-80d6d235ba06.60003b68-3a55-4702-b870-e3a23a2f1399" returned: 0 in 0.325s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:55 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-67bff190-eb49-4d68-a553-db06e3882b56 tempest-ProjectMemberTests-293722149 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2ee4f036-90f2-42e8-8bb6-80d6d235ba06.60003b68-3a55-4702-b870-e3a23a2f1399 is being set with open permissions: ugo+rw Sep 28 15:17:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-67bff190-eb49-4d68-a553-db06e3882b56 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2ee4f036-90f2-42e8-8bb6-80d6d235ba06.60003b68-3a55-4702-b870-e3a23a2f1399 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:55 devstack sudo[109154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2ee4f036-90f2-42e8-8bb6-80d6d235ba06.60003b68-3a55-4702-b870-e3a23a2f1399 Sep 28 15:17:55 devstack sudo[109154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:55 devstack sudo[109144]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1bbda9bd-4168-4ac9-8d0d-a8d59d1ec7fb tempest-SnapshotDependencyTests-1849452807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-475fbd20-6b45-4efb-902f-07d39d69bb27" returned: 0 in 0.565s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1bbda9bd-4168-4ac9-8d0d-a8d59d1ec7fb tempest-SnapshotDependencyTests-1849452807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-475fbd20-6b45-4efb-902f-07d39d69bb27.e3e74f70-50ce-4720-9370-d68cdfbe38ce {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:55 devstack sudo[109157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-475fbd20-6b45-4efb-902f-07d39d69bb27.e3e74f70-50ce-4720-9370-d68cdfbe38ce Sep 28 15:17:55 devstack sudo[109157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:55 devstack sudo[109154]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-67bff190-eb49-4d68-a553-db06e3882b56 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2ee4f036-90f2-42e8-8bb6-80d6d235ba06.60003b68-3a55-4702-b870-e3a23a2f1399" returned: 0 in 0.257s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-67bff190-eb49-4d68-a553-db06e3882b56 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2ee4f036-90f2-42e8-8bb6-80d6d235ba06.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:55 devstack sudo[109160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2ee4f036-90f2-42e8-8bb6-80d6d235ba06.info Sep 28 15:17:55 devstack sudo[109160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:55 devstack sudo[109157]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1bbda9bd-4168-4ac9-8d0d-a8d59d1ec7fb tempest-SnapshotDependencyTests-1849452807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-475fbd20-6b45-4efb-902f-07d39d69bb27.e3e74f70-50ce-4720-9370-d68cdfbe38ce" returned: 0 in 0.368s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1bbda9bd-4168-4ac9-8d0d-a8d59d1ec7fb tempest-SnapshotDependencyTests-1849452807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-475fbd20-6b45-4efb-902f-07d39d69bb27.e3e74f70-50ce-4720-9370-d68cdfbe38ce {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:55 devstack sudo[109165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-475fbd20-6b45-4efb-902f-07d39d69bb27.e3e74f70-50ce-4720-9370-d68cdfbe38ce Sep 28 15:17:55 devstack sudo[109165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:55 devstack sudo[109160]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-67bff190-eb49-4d68-a553-db06e3882b56 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2ee4f036-90f2-42e8-8bb6-80d6d235ba06.info" returned: 0 in 0.294s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:55 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-67bff190-eb49-4d68-a553-db06e3882b56 tempest-ProjectMemberTests-293722149 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2ee4f036-90f2-42e8-8bb6-80d6d235ba06.info is being set with open permissions: ugo+rw Sep 28 15:17:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-67bff190-eb49-4d68-a553-db06e3882b56 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2ee4f036-90f2-42e8-8bb6-80d6d235ba06.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:55 devstack sudo[109168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2ee4f036-90f2-42e8-8bb6-80d6d235ba06.info Sep 28 15:17:55 devstack sudo[109168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:55 devstack sudo[109165]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1bbda9bd-4168-4ac9-8d0d-a8d59d1ec7fb tempest-SnapshotDependencyTests-1849452807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-475fbd20-6b45-4efb-902f-07d39d69bb27.e3e74f70-50ce-4720-9370-d68cdfbe38ce" returned: 0 in 0.256s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:55 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1bbda9bd-4168-4ac9-8d0d-a8d59d1ec7fb tempest-SnapshotDependencyTests-1849452807 None] Lock "cinder-quobyte-e3e74f70-50ce-4720-9370-d68cdfbe38ce" released by "_delete_snapshot" :: held 1.752s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:55 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1bbda9bd-4168-4ac9-8d0d-a8d59d1ec7fb tempest-SnapshotDependencyTests-1849452807 None] Lock "cinder-quobyte-475fbd20-6b45-4efb-902f-07d39d69bb27" released by "delete_snapshot" :: held 1.778s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:56 devstack sudo[109168]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-67bff190-eb49-4d68-a553-db06e3882b56 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2ee4f036-90f2-42e8-8bb6-80d6d235ba06.info" returned: 0 in 0.299s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-67bff190-eb49-4d68-a553-db06e3882b56 tempest-ProjectMemberTests-293722149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.114s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:56 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-1bbda9bd-4168-4ac9-8d0d-a8d59d1ec7fb tempest-SnapshotDependencyTests-1849452807 None] Created reservations ['34f294df-0152-4343-9634-9d3f97fb38c3', 'b1f4cad0-28bd-4be4-ad14-9dfae1edaf62', '5d1a3acc-d4f1-4432-abd7-81b75bcd17f0', '515e44c8-eb4b-45a9-a1b9-ff15717f8817'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:17:56 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-67bff190-eb49-4d68-a553-db06e3882b56 tempest-ProjectMemberTests-293722149 None] Create snapshot completed successfully Sep 28 15:17:56 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-1bbda9bd-4168-4ac9-8d0d-a8d59d1ec7fb tempest-SnapshotDependencyTests-1849452807 None] Delete snapshot completed successfully. Sep 28 15:17:56 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1bbda9bd-4168-4ac9-8d0d-a8d59d1ec7fb tempest-SnapshotDependencyTests-1849452807 None] Lock "cinder-e3e74f70-50ce-4720-9370-d68cdfbe38ce-delete_snapshot" released by "delete_snapshot" :: held 2.038s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:56 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-24cc20ca-e27a-4567-8abf-ac3a2c0c13aa tempest-SnapshotDependencyTests-1849452807 None] Acquiring lock "cinder-475fbd20-6b45-4efb-902f-07d39d69bb27-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:56 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-24cc20ca-e27a-4567-8abf-ac3a2c0c13aa tempest-SnapshotDependencyTests-1849452807 None] Lock "cinder-475fbd20-6b45-4efb-902f-07d39d69bb27-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:56 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-24cc20ca-e27a-4567-8abf-ac3a2c0c13aa tempest-SnapshotDependencyTests-1849452807 None] Acquiring lock "cinder-quobyte-475fbd20-6b45-4efb-902f-07d39d69bb27" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:56 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-24cc20ca-e27a-4567-8abf-ac3a2c0c13aa tempest-SnapshotDependencyTests-1849452807 None] Lock "cinder-quobyte-475fbd20-6b45-4efb-902f-07d39d69bb27" acquired by "delete_volume" :: waited 0.023s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:56 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60b0931-944c-4530-b851-b08e947baab8]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-24cc20ca-e27a-4567-8abf-ac3a2c0c13aa tempest-SnapshotDependencyTests-1849452807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-475fbd20-6b45-4efb-902f-07d39d69bb27 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:56 devstack sudo[109172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-475fbd20-6b45-4efb-902f-07d39d69bb27 Sep 28 15:17:56 devstack sudo[109172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:56 devstack sudo[109172]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-24cc20ca-e27a-4567-8abf-ac3a2c0c13aa tempest-SnapshotDependencyTests-1849452807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-475fbd20-6b45-4efb-902f-07d39d69bb27" returned: 0 in 0.395s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-24cc20ca-e27a-4567-8abf-ac3a2c0c13aa tempest-SnapshotDependencyTests-1849452807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-475fbd20-6b45-4efb-902f-07d39d69bb27 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:56 devstack sudo[109177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-475fbd20-6b45-4efb-902f-07d39d69bb27 Sep 28 15:17:56 devstack sudo[109177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:57 devstack sudo[109177]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:57 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-619b46e6-ede2-4374-b7b2-e9337cbafbe6 tempest-ProjectMemberTests-293722149 None] Acquiring lock "cinder-60003b68-3a55-4702-b870-e3a23a2f1399-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-24cc20ca-e27a-4567-8abf-ac3a2c0c13aa tempest-SnapshotDependencyTests-1849452807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-475fbd20-6b45-4efb-902f-07d39d69bb27" returned: 0 in 0.303s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:57 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-24cc20ca-e27a-4567-8abf-ac3a2c0c13aa tempest-SnapshotDependencyTests-1849452807 None] Lock "cinder-quobyte-475fbd20-6b45-4efb-902f-07d39d69bb27" released by "delete_volume" :: held 0.777s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:57 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-619b46e6-ede2-4374-b7b2-e9337cbafbe6 tempest-ProjectMemberTests-293722149 None] Lock "cinder-60003b68-3a55-4702-b870-e3a23a2f1399-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:57 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-619b46e6-ede2-4374-b7b2-e9337cbafbe6 tempest-ProjectMemberTests-293722149 None] Acquiring lock "cinder-quobyte-2ee4f036-90f2-42e8-8bb6-80d6d235ba06" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:57 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-619b46e6-ede2-4374-b7b2-e9337cbafbe6 tempest-ProjectMemberTests-293722149 None] Lock "cinder-quobyte-2ee4f036-90f2-42e8-8bb6-80d6d235ba06" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:57 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-619b46e6-ede2-4374-b7b2-e9337cbafbe6 tempest-ProjectMemberTests-293722149 None] Acquiring lock "cinder-quobyte-60003b68-3a55-4702-b870-e3a23a2f1399" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:57 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-619b46e6-ede2-4374-b7b2-e9337cbafbe6 tempest-ProjectMemberTests-293722149 None] Lock "cinder-quobyte-60003b68-3a55-4702-b870-e3a23a2f1399" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-619b46e6-ede2-4374-b7b2-e9337cbafbe6 tempest-ProjectMemberTests-293722149 None] Deleting offline snapshot 60003b68-3a55-4702-b870-e3a23a2f1399 of volume 2ee4f036-90f2-42e8-8bb6-80d6d235ba06 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:17:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-619b46e6-ede2-4374-b7b2-e9337cbafbe6 tempest-ProjectMemberTests-293722149 None] snapshot_file for this snap is: volume-2ee4f036-90f2-42e8-8bb6-80d6d235ba06.60003b68-3a55-4702-b870-e3a23a2f1399 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:17:57 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[19da8f52-58fe-491c-a05e-2b8344ef86fe]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-619b46e6-ede2-4374-b7b2-e9337cbafbe6 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2ee4f036-90f2-42e8-8bb6-80d6d235ba06.60003b68-3a55-4702-b870-e3a23a2f1399 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:57 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-24cc20ca-e27a-4567-8abf-ac3a2c0c13aa tempest-SnapshotDependencyTests-1849452807 None] Created reservations ['a10fb47d-b1a8-46bd-81b4-f2f96c9a2e92', '4ab2c453-aa1b-4372-99b6-7dfa769c38c0', 'dd92218e-38b2-4478-b7b9-f3a9b0342033', 'ea07bc06-2f31-46a3-bfe9-90dcdbd55b9b'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:17:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-24cc20ca-e27a-4567-8abf-ac3a2c0c13aa tempest-SnapshotDependencyTests-1849452807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-24cc20ca-e27a-4567-8abf-ac3a2c0c13aa tempest-SnapshotDependencyTests-1849452807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-24cc20ca-e27a-4567-8abf-ac3a2c0c13aa tempest-SnapshotDependencyTests-1849452807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-24cc20ca-e27a-4567-8abf-ac3a2c0c13aa tempest-SnapshotDependencyTests-1849452807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-24cc20ca-e27a-4567-8abf-ac3a2c0c13aa tempest-SnapshotDependencyTests-1849452807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-24cc20ca-e27a-4567-8abf-ac3a2c0c13aa tempest-SnapshotDependencyTests-1849452807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:57 devstack sudo[109181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2ee4f036-90f2-42e8-8bb6-80d6d235ba06.60003b68-3a55-4702-b870-e3a23a2f1399 Sep 28 15:17:57 devstack sudo[109181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:57 devstack sudo[109182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:17:57 devstack sudo[109182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:57 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a40526f1-405b-4730-a038-9e5588e54954 tempest-SnapshotDependencyTests-1849452807 None] Acquiring lock "cinder-59b72f53-feea-406f-a819-139003aea2cb-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:57 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a40526f1-405b-4730-a038-9e5588e54954 tempest-SnapshotDependencyTests-1849452807 None] Lock "cinder-59b72f53-feea-406f-a819-139003aea2cb-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:57 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a40526f1-405b-4730-a038-9e5588e54954 tempest-SnapshotDependencyTests-1849452807 None] Acquiring lock "cinder-quobyte-59b72f53-feea-406f-a819-139003aea2cb" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:57 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a40526f1-405b-4730-a038-9e5588e54954 tempest-SnapshotDependencyTests-1849452807 None] Lock "cinder-quobyte-59b72f53-feea-406f-a819-139003aea2cb" acquired by "delete_volume" :: waited 0.031s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:57 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[df21c14c-64d8-44f3-a0d3-565844f2302e]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a40526f1-405b-4730-a038-9e5588e54954 tempest-SnapshotDependencyTests-1849452807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-59b72f53-feea-406f-a819-139003aea2cb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:57 devstack sudo[109182]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-24cc20ca-e27a-4567-8abf-ac3a2c0c13aa tempest-SnapshotDependencyTests-1849452807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.324s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:57 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-24cc20ca-e27a-4567-8abf-ac3a2c0c13aa tempest-SnapshotDependencyTests-1849452807 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:17:57 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-24cc20ca-e27a-4567-8abf-ac3a2c0c13aa tempest-SnapshotDependencyTests-1849452807 None] Deleted volume successfully. Sep 28 15:17:57 devstack sudo[109181]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-619b46e6-ede2-4374-b7b2-e9337cbafbe6 tempest-ProjectMemberTests-293722149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2ee4f036-90f2-42e8-8bb6-80d6d235ba06.60003b68-3a55-4702-b870-e3a23a2f1399" returned: 0 in 0.473s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-619b46e6-ede2-4374-b7b2-e9337cbafbe6 tempest-ProjectMemberTests-293722149 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ee4f036-90f2-42e8-8bb6-80d6d235ba06(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:17:57 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-24cc20ca-e27a-4567-8abf-ac3a2c0c13aa tempest-SnapshotDependencyTests-1849452807 None] Lock "cinder-475fbd20-6b45-4efb-902f-07d39d69bb27-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:57 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c6268d-e5d7-44d2-af26-904bb33db73f]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-619b46e6-ede2-4374-b7b2-e9337cbafbe6 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2ee4f036-90f2-42e8-8bb6-80d6d235ba06 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:57 devstack sudo[109189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-59b72f53-feea-406f-a819-139003aea2cb Sep 28 15:17:57 devstack sudo[109189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:57 devstack sudo[109190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2ee4f036-90f2-42e8-8bb6-80d6d235ba06 Sep 28 15:17:57 devstack sudo[109190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:58 devstack sudo[109189]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a40526f1-405b-4730-a038-9e5588e54954 tempest-SnapshotDependencyTests-1849452807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-59b72f53-feea-406f-a819-139003aea2cb" returned: 0 in 0.386s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a40526f1-405b-4730-a038-9e5588e54954 tempest-SnapshotDependencyTests-1849452807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-59b72f53-feea-406f-a819-139003aea2cb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:58 devstack sudo[109196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-59b72f53-feea-406f-a819-139003aea2cb Sep 28 15:17:58 devstack sudo[109196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:58 devstack sudo[109190]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-619b46e6-ede2-4374-b7b2-e9337cbafbe6 tempest-ProjectMemberTests-293722149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2ee4f036-90f2-42e8-8bb6-80d6d235ba06" returned: 0 in 0.371s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-619b46e6-ede2-4374-b7b2-e9337cbafbe6 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2ee4f036-90f2-42e8-8bb6-80d6d235ba06.60003b68-3a55-4702-b870-e3a23a2f1399 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:58 devstack sudo[109201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2ee4f036-90f2-42e8-8bb6-80d6d235ba06.60003b68-3a55-4702-b870-e3a23a2f1399 Sep 28 15:17:58 devstack sudo[109201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:58 devstack sudo[109196]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a40526f1-405b-4730-a038-9e5588e54954 tempest-SnapshotDependencyTests-1849452807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-59b72f53-feea-406f-a819-139003aea2cb" returned: 0 in 0.293s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:58 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a40526f1-405b-4730-a038-9e5588e54954 tempest-SnapshotDependencyTests-1849452807 None] Lock "cinder-quobyte-59b72f53-feea-406f-a819-139003aea2cb" released by "delete_volume" :: held 0.742s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:58 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-a40526f1-405b-4730-a038-9e5588e54954 tempest-SnapshotDependencyTests-1849452807 None] Created reservations ['5eea19f5-87c3-4819-b584-a496eff7b880', '7a5482b2-812e-494f-b998-15c94509e864', '4d18887f-c50c-46fb-8072-651c7d227f3e', '814af8b7-9b69-4f29-84ea-e3324c9e4dbe'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:17:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a40526f1-405b-4730-a038-9e5588e54954 tempest-SnapshotDependencyTests-1849452807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a40526f1-405b-4730-a038-9e5588e54954 tempest-SnapshotDependencyTests-1849452807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a40526f1-405b-4730-a038-9e5588e54954 tempest-SnapshotDependencyTests-1849452807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a40526f1-405b-4730-a038-9e5588e54954 tempest-SnapshotDependencyTests-1849452807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a40526f1-405b-4730-a038-9e5588e54954 tempest-SnapshotDependencyTests-1849452807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a40526f1-405b-4730-a038-9e5588e54954 tempest-SnapshotDependencyTests-1849452807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:58 devstack sudo[109207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:17:58 devstack sudo[109207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:58 devstack sudo[109201]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-619b46e6-ede2-4374-b7b2-e9337cbafbe6 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2ee4f036-90f2-42e8-8bb6-80d6d235ba06.60003b68-3a55-4702-b870-e3a23a2f1399" returned: 0 in 0.400s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-619b46e6-ede2-4374-b7b2-e9337cbafbe6 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2ee4f036-90f2-42e8-8bb6-80d6d235ba06.60003b68-3a55-4702-b870-e3a23a2f1399 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:58 devstack sudo[109209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2ee4f036-90f2-42e8-8bb6-80d6d235ba06.60003b68-3a55-4702-b870-e3a23a2f1399 Sep 28 15:17:58 devstack sudo[109209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:58 devstack sudo[109207]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a40526f1-405b-4730-a038-9e5588e54954 tempest-SnapshotDependencyTests-1849452807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.288s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:58 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-a40526f1-405b-4730-a038-9e5588e54954 tempest-SnapshotDependencyTests-1849452807 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:17:58 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-a40526f1-405b-4730-a038-9e5588e54954 tempest-SnapshotDependencyTests-1849452807 None] Deleted volume successfully. Sep 28 15:17:58 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:UPDATE=149,cinder:SELECT=117,cinder:DELETE=15,cinder:INSERT=32 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:17:58 devstack sudo[109209]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-619b46e6-ede2-4374-b7b2-e9337cbafbe6 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2ee4f036-90f2-42e8-8bb6-80d6d235ba06.60003b68-3a55-4702-b870-e3a23a2f1399" returned: 0 in 0.290s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:58 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-619b46e6-ede2-4374-b7b2-e9337cbafbe6 tempest-ProjectMemberTests-293722149 None] Lock "cinder-quobyte-60003b68-3a55-4702-b870-e3a23a2f1399" released by "_delete_snapshot" :: held 1.654s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:58 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-619b46e6-ede2-4374-b7b2-e9337cbafbe6 tempest-ProjectMemberTests-293722149 None] Lock "cinder-quobyte-2ee4f036-90f2-42e8-8bb6-80d6d235ba06" released by "delete_snapshot" :: held 1.686s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:58 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a40526f1-405b-4730-a038-9e5588e54954 tempest-SnapshotDependencyTests-1849452807 None] Lock "cinder-59b72f53-feea-406f-a819-139003aea2cb-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:59 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-619b46e6-ede2-4374-b7b2-e9337cbafbe6 tempest-ProjectMemberTests-293722149 None] Created reservations ['28650323-ec86-40f3-aedf-51b812385c7b', '9dacd9c0-ca6d-4dca-8f00-d447fa9f438e', 'a832239d-2b88-465c-8b9e-0c07eb1eadf9', '7acf20dc-a1f0-4418-9a40-6c4c345e0ccf'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:17:59 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-619b46e6-ede2-4374-b7b2-e9337cbafbe6 tempest-ProjectMemberTests-293722149 None] Delete snapshot completed successfully. Sep 28 15:17:59 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-619b46e6-ede2-4374-b7b2-e9337cbafbe6 tempest-ProjectMemberTests-293722149 None] Lock "cinder-60003b68-3a55-4702-b870-e3a23a2f1399-delete_snapshot" released by "delete_snapshot" :: held 2.004s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:59 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-712c6331-709d-4c56-8d2a-75bd68ea4798 tempest-ProjectMemberTests-293722149 None] Acquiring lock "cinder-2ee4f036-90f2-42e8-8bb6-80d6d235ba06-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:59 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-712c6331-709d-4c56-8d2a-75bd68ea4798 tempest-ProjectMemberTests-293722149 None] Lock "cinder-2ee4f036-90f2-42e8-8bb6-80d6d235ba06-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:59 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-712c6331-709d-4c56-8d2a-75bd68ea4798 tempest-ProjectMemberTests-293722149 None] Acquiring lock "cinder-quobyte-2ee4f036-90f2-42e8-8bb6-80d6d235ba06" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:59 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-712c6331-709d-4c56-8d2a-75bd68ea4798 tempest-ProjectMemberTests-293722149 None] Lock "cinder-quobyte-2ee4f036-90f2-42e8-8bb6-80d6d235ba06" acquired by "delete_volume" :: waited 0.018s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:59 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc0bffd-f479-4ffe-b047-b18d99f93347]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-712c6331-709d-4c56-8d2a-75bd68ea4798 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2ee4f036-90f2-42e8-8bb6-80d6d235ba06 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:59 devstack sudo[109213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2ee4f036-90f2-42e8-8bb6-80d6d235ba06 Sep 28 15:17:59 devstack sudo[109213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:59 devstack sudo[109213]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-712c6331-709d-4c56-8d2a-75bd68ea4798 tempest-ProjectMemberTests-293722149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2ee4f036-90f2-42e8-8bb6-80d6d235ba06" returned: 0 in 0.471s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-712c6331-709d-4c56-8d2a-75bd68ea4798 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2ee4f036-90f2-42e8-8bb6-80d6d235ba06 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:59 devstack sudo[109219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2ee4f036-90f2-42e8-8bb6-80d6d235ba06 Sep 28 15:17:59 devstack sudo[109219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:00 devstack sudo[109219]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-712c6331-709d-4c56-8d2a-75bd68ea4798 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-2ee4f036-90f2-42e8-8bb6-80d6d235ba06" returned: 0 in 0.299s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:00 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-712c6331-709d-4c56-8d2a-75bd68ea4798 tempest-ProjectMemberTests-293722149 None] Lock "cinder-quobyte-2ee4f036-90f2-42e8-8bb6-80d6d235ba06" released by "delete_volume" :: held 0.860s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:00 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-712c6331-709d-4c56-8d2a-75bd68ea4798 tempest-ProjectMemberTests-293722149 None] Created reservations ['17c31d6e-776c-43ef-b116-0d747b0defe1', 'ba3b8b36-12a2-4b06-9a34-732485008187', '43038577-2962-491c-b09b-0edeada65d37', '96acef2c-704c-442b-b0c6-5a2035c667ee'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:18:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-712c6331-709d-4c56-8d2a-75bd68ea4798 tempest-ProjectMemberTests-293722149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-712c6331-709d-4c56-8d2a-75bd68ea4798 tempest-ProjectMemberTests-293722149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:00 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-712c6331-709d-4c56-8d2a-75bd68ea4798 tempest-ProjectMemberTests-293722149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:18:00 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-712c6331-709d-4c56-8d2a-75bd68ea4798 tempest-ProjectMemberTests-293722149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:18:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-712c6331-709d-4c56-8d2a-75bd68ea4798 tempest-ProjectMemberTests-293722149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-712c6331-709d-4c56-8d2a-75bd68ea4798 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:00 devstack sudo[109222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:18:00 devstack sudo[109222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:00 devstack sudo[109222]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-712c6331-709d-4c56-8d2a-75bd68ea4798 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.345s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:00 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-712c6331-709d-4c56-8d2a-75bd68ea4798 tempest-ProjectMemberTests-293722149 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:18:00 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-712c6331-709d-4c56-8d2a-75bd68ea4798 tempest-ProjectMemberTests-293722149 None] Deleted volume successfully. Sep 28 15:18:00 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-712c6331-709d-4c56-8d2a-75bd68ea4798 tempest-ProjectMemberTests-293722149 None] Lock "cinder-2ee4f036-90f2-42e8-8bb6-80d6d235ba06-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:01 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddbb6af5-08c0-4f61-a1a1-fb1dcd8e3a35 tempest-ProjectMemberTests-293722149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:18:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ddbb6af5-08c0-4f61-a1a1-fb1dcd8e3a35 tempest-ProjectMemberTests-293722149 None] Flow 'volume_create_manager' (d87e29c3-7c6d-4164-883c-17eb32ff303e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:18:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ddbb6af5-08c0-4f61-a1a1-fb1dcd8e3a35 tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (734c19db-ce35-47ea-938e-c324ac662bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ddbb6af5-08c0-4f61-a1a1-fb1dcd8e3a35 tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (734c19db-ce35-47ea-938e-c324ac662bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:18:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1846901033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30f7e206-5fad-41f8-9e5c-3dbd2f52c62c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd1cca6dd0284a7c863af0b50e63e06b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:18:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:18:01Z,use_quota=True,user_id='f79e6dc0ec9740e0ab12c9a6bf177496',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ddbb6af5-08c0-4f61-a1a1-fb1dcd8e3a35 tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abc69dff-0035-4a94-a98e-51cdd1447b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ddbb6af5-08c0-4f61-a1a1-fb1dcd8e3a35 tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abc69dff-0035-4a94-a98e-51cdd1447b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ddbb6af5-08c0-4f61-a1a1-fb1dcd8e3a35 tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (230257eb-2fb4-4d98-9842-d940582f88b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ddbb6af5-08c0-4f61-a1a1-fb1dcd8e3a35 tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (230257eb-2fb4-4d98-9842-d940582f88b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30f7e206-5fad-41f8-9e5c-3dbd2f52c62c', 'volume_name': 'volume-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ddbb6af5-08c0-4f61-a1a1-fb1dcd8e3a35 tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9c8fe11-6018-4984-8a8e-85b6d8eb337c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ddbb6af5-08c0-4f61-a1a1-fb1dcd8e3a35 tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9c8fe11-6018-4984-8a8e-85b6d8eb337c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ddbb6af5-08c0-4f61-a1a1-fb1dcd8e3a35 tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31a55122-5c15-4388-a5b0-5fbe530898e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:01 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-ddbb6af5-08c0-4f61-a1a1-fb1dcd8e3a35 tempest-ProjectMemberTests-293722149 None] Volume 30f7e206-5fad-41f8-9e5c-3dbd2f52c62c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c', 'volume_size': 1} Sep 28 15:18:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ddbb6af5-08c0-4f61-a1a1-fb1dcd8e3a35 tempest-ProjectMemberTests-293722149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ddbb6af5-08c0-4f61-a1a1-fb1dcd8e3a35 tempest-ProjectMemberTests-293722149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ddbb6af5-08c0-4f61-a1a1-fb1dcd8e3a35 tempest-ProjectMemberTests-293722149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:18:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1846901033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30f7e206-5fad-41f8-9e5c-3dbd2f52c62c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd1cca6dd0284a7c863af0b50e63e06b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:18:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:18:01Z,use_quota=True,user_id='f79e6dc0ec9740e0ab12c9a6bf177496',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:18:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-ddbb6af5-08c0-4f61-a1a1-fb1dcd8e3a35 tempest-ProjectMemberTests-293722149 None] Creating volume 30f7e206-5fad-41f8-9e5c-3dbd2f52c62c {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:18:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ddbb6af5-08c0-4f61-a1a1-fb1dcd8e3a35 tempest-ProjectMemberTests-293722149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ddbb6af5-08c0-4f61-a1a1-fb1dcd8e3a35 tempest-ProjectMemberTests-293722149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ddbb6af5-08c0-4f61-a1a1-fb1dcd8e3a35 tempest-ProjectMemberTests-293722149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:18:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ddbb6af5-08c0-4f61-a1a1-fb1dcd8e3a35 tempest-ProjectMemberTests-293722149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:18:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ddbb6af5-08c0-4f61-a1a1-fb1dcd8e3a35 tempest-ProjectMemberTests-293722149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ddbb6af5-08c0-4f61-a1a1-fb1dcd8e3a35 tempest-ProjectMemberTests-293722149 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:18:01 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-ddbb6af5-08c0-4f61-a1a1-fb1dcd8e3a35 tempest-ProjectMemberTests-293722149 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:18:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ddbb6af5-08c0-4f61-a1a1-fb1dcd8e3a35 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:01 devstack sudo[109226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c 1073741824 Sep 28 15:18:01 devstack sudo[109226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:01 devstack sudo[109226]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ddbb6af5-08c0-4f61-a1a1-fb1dcd8e3a35 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c 1073741824" returned: 0 in 0.548s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ddbb6af5-08c0-4f61-a1a1-fb1dcd8e3a35 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:01 devstack sudo[109233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c Sep 28 15:18:01 devstack sudo[109233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:02 devstack sudo[109233]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ddbb6af5-08c0-4f61-a1a1-fb1dcd8e3a35 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c" returned: 0 in 0.262s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ddbb6af5-08c0-4f61-a1a1-fb1dcd8e3a35 tempest-ProjectMemberTests-293722149 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:18:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ddbb6af5-08c0-4f61-a1a1-fb1dcd8e3a35 tempest-ProjectMemberTests-293722149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ddbb6af5-08c0-4f61-a1a1-fb1dcd8e3a35 tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31a55122-5c15-4388-a5b0-5fbe530898e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ddbb6af5-08c0-4f61-a1a1-fb1dcd8e3a35 tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1e417bc-3dd2-47d6-a61b-607ea1a091bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:02 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-ddbb6af5-08c0-4f61-a1a1-fb1dcd8e3a35 tempest-ProjectMemberTests-293722149 None] Volume volume-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c (30f7e206-5fad-41f8-9e5c-3dbd2f52c62c): created successfully Sep 28 15:18:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ddbb6af5-08c0-4f61-a1a1-fb1dcd8e3a35 tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1e417bc-3dd2-47d6-a61b-607ea1a091bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ddbb6af5-08c0-4f61-a1a1-fb1dcd8e3a35 tempest-ProjectMemberTests-293722149 None] Flow 'volume_create_manager' (d87e29c3-7c6d-4164-883c-17eb32ff303e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:18:02 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-ddbb6af5-08c0-4f61-a1a1-fb1dcd8e3a35 tempest-ProjectMemberTests-293722149 None] Created volume successfully. Sep 28 15:18:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2c2320f8-760b-4aab-8ea3-6803724afa59 tempest-ProjectMemberTests-293722149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2c2320f8-760b-4aab-8ea3-6803724afa59 tempest-ProjectMemberTests-293722149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-2c2320f8-760b-4aab-8ea3-6803724afa59 tempest-ProjectMemberTests-293722149 None] Creating offline snapshot 43a8fc76-8fa2-465c-bcdb-e692348bbc78 of volume 30f7e206-5fad-41f8-9e5c-3dbd2f52c62c {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:18:03 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea87c986-aa90-4bfc-97a9-e3644d181fdf]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2c2320f8-760b-4aab-8ea3-6803724afa59 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:03 devstack sudo[109236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c Sep 28 15:18:03 devstack sudo[109236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:03 devstack sudo[109236]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2c2320f8-760b-4aab-8ea3-6803724afa59 tempest-ProjectMemberTests-293722149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c" returned: 0 in 0.503s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2c2320f8-760b-4aab-8ea3-6803724afa59 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c.43a8fc76-8fa2-465c-bcdb-e692348bbc78 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:04 devstack sudo[109242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c.43a8fc76-8fa2-465c-bcdb-e692348bbc78 1G Sep 28 15:18:04 devstack sudo[109242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:04 devstack sudo[109242]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2c2320f8-760b-4aab-8ea3-6803724afa59 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c.43a8fc76-8fa2-465c-bcdb-e692348bbc78 1G" returned: 0 in 0.561s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2c2320f8-760b-4aab-8ea3-6803724afa59 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c.43a8fc76-8fa2-465c-bcdb-e692348bbc78 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:04 devstack sudo[109247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c.43a8fc76-8fa2-465c-bcdb-e692348bbc78 Sep 28 15:18:04 devstack sudo[109247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:04 devstack sudo[109247]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2c2320f8-760b-4aab-8ea3-6803724afa59 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c.43a8fc76-8fa2-465c-bcdb-e692348bbc78" returned: 0 in 0.338s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:04 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-2c2320f8-760b-4aab-8ea3-6803724afa59 tempest-ProjectMemberTests-293722149 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c.43a8fc76-8fa2-465c-bcdb-e692348bbc78 is being set with open permissions: ugo+rw Sep 28 15:18:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2c2320f8-760b-4aab-8ea3-6803724afa59 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c.43a8fc76-8fa2-465c-bcdb-e692348bbc78 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:04 devstack sudo[109253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c.43a8fc76-8fa2-465c-bcdb-e692348bbc78 Sep 28 15:18:04 devstack sudo[109253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:05 devstack sudo[109253]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2c2320f8-760b-4aab-8ea3-6803724afa59 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c.43a8fc76-8fa2-465c-bcdb-e692348bbc78" returned: 0 in 0.316s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2c2320f8-760b-4aab-8ea3-6803724afa59 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:05 devstack sudo[109256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c.info Sep 28 15:18:05 devstack sudo[109256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:05 devstack sudo[109256]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2c2320f8-760b-4aab-8ea3-6803724afa59 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c.info" returned: 0 in 0.291s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:05 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-2c2320f8-760b-4aab-8ea3-6803724afa59 tempest-ProjectMemberTests-293722149 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c.info is being set with open permissions: ugo+rw Sep 28 15:18:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2c2320f8-760b-4aab-8ea3-6803724afa59 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:05 devstack sudo[109259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c.info Sep 28 15:18:05 devstack sudo[109259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:05 devstack sudo[109259]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2c2320f8-760b-4aab-8ea3-6803724afa59 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c.info" returned: 0 in 0.275s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2c2320f8-760b-4aab-8ea3-6803724afa59 tempest-ProjectMemberTests-293722149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.393s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:05 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-2c2320f8-760b-4aab-8ea3-6803724afa59 tempest-ProjectMemberTests-293722149 None] Create snapshot completed successfully Sep 28 15:18:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8f9048ba-db06-4cbf-8aa4-ca080f0f39d5 tempest-ProjectMemberTests-293722149 None] Acquiring lock "cinder-43a8fc76-8fa2-465c-bcdb-e692348bbc78-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8f9048ba-db06-4cbf-8aa4-ca080f0f39d5 tempest-ProjectMemberTests-293722149 None] Lock "cinder-43a8fc76-8fa2-465c-bcdb-e692348bbc78-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8f9048ba-db06-4cbf-8aa4-ca080f0f39d5 tempest-ProjectMemberTests-293722149 None] Acquiring lock "cinder-quobyte-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8f9048ba-db06-4cbf-8aa4-ca080f0f39d5 tempest-ProjectMemberTests-293722149 None] Lock "cinder-quobyte-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8f9048ba-db06-4cbf-8aa4-ca080f0f39d5 tempest-ProjectMemberTests-293722149 None] Acquiring lock "cinder-quobyte-43a8fc76-8fa2-465c-bcdb-e692348bbc78" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8f9048ba-db06-4cbf-8aa4-ca080f0f39d5 tempest-ProjectMemberTests-293722149 None] Lock "cinder-quobyte-43a8fc76-8fa2-465c-bcdb-e692348bbc78" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-8f9048ba-db06-4cbf-8aa4-ca080f0f39d5 tempest-ProjectMemberTests-293722149 None] Deleting offline snapshot 43a8fc76-8fa2-465c-bcdb-e692348bbc78 of volume 30f7e206-5fad-41f8-9e5c-3dbd2f52c62c {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:18:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-8f9048ba-db06-4cbf-8aa4-ca080f0f39d5 tempest-ProjectMemberTests-293722149 None] snapshot_file for this snap is: volume-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c.43a8fc76-8fa2-465c-bcdb-e692348bbc78 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:18:06 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca3c2e2-ed89-4f6d-8677-12d31271da55]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8f9048ba-db06-4cbf-8aa4-ca080f0f39d5 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c.43a8fc76-8fa2-465c-bcdb-e692348bbc78 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:06 devstack sudo[109263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c.43a8fc76-8fa2-465c-bcdb-e692348bbc78 Sep 28 15:18:06 devstack sudo[109263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:07 devstack sudo[109263]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8f9048ba-db06-4cbf-8aa4-ca080f0f39d5 tempest-ProjectMemberTests-293722149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c.43a8fc76-8fa2-465c-bcdb-e692348bbc78" returned: 0 in 0.418s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:07 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-8f9048ba-db06-4cbf-8aa4-ca080f0f39d5 tempest-ProjectMemberTests-293722149 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:18:07 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f77994-ad5b-4113-8dcb-05719dc86fd1]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8f9048ba-db06-4cbf-8aa4-ca080f0f39d5 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:07 devstack sudo[109268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c Sep 28 15:18:07 devstack sudo[109268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:07 devstack sudo[109268]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8f9048ba-db06-4cbf-8aa4-ca080f0f39d5 tempest-ProjectMemberTests-293722149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c" returned: 0 in 0.456s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8f9048ba-db06-4cbf-8aa4-ca080f0f39d5 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c.43a8fc76-8fa2-465c-bcdb-e692348bbc78 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:07 devstack sudo[109273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c.43a8fc76-8fa2-465c-bcdb-e692348bbc78 Sep 28 15:18:07 devstack sudo[109273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:08 devstack sudo[109273]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8f9048ba-db06-4cbf-8aa4-ca080f0f39d5 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c.43a8fc76-8fa2-465c-bcdb-e692348bbc78" returned: 0 in 0.397s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8f9048ba-db06-4cbf-8aa4-ca080f0f39d5 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c.43a8fc76-8fa2-465c-bcdb-e692348bbc78 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:08 devstack sudo[109278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c.43a8fc76-8fa2-465c-bcdb-e692348bbc78 Sep 28 15:18:08 devstack sudo[109278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:08 devstack sudo[109278]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8f9048ba-db06-4cbf-8aa4-ca080f0f39d5 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c.43a8fc76-8fa2-465c-bcdb-e692348bbc78" returned: 0 in 0.269s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:08 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8f9048ba-db06-4cbf-8aa4-ca080f0f39d5 tempest-ProjectMemberTests-293722149 None] Lock "cinder-quobyte-43a8fc76-8fa2-465c-bcdb-e692348bbc78" released by "_delete_snapshot" :: held 1.658s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:08 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8f9048ba-db06-4cbf-8aa4-ca080f0f39d5 tempest-ProjectMemberTests-293722149 None] Lock "cinder-quobyte-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c" released by "delete_snapshot" :: held 1.684s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:08 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-8f9048ba-db06-4cbf-8aa4-ca080f0f39d5 tempest-ProjectMemberTests-293722149 None] Created reservations ['295d7367-8be7-42f4-9a2e-03f7e70787f7', '37ee08d7-bb55-407b-b0d6-97e52f48ed49', '39c7bb5c-9f5b-4790-a176-ce62e080aa28', '8583955b-b84a-4546-93cd-ab44e368e317'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:18:08 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-8f9048ba-db06-4cbf-8aa4-ca080f0f39d5 tempest-ProjectMemberTests-293722149 None] Delete snapshot completed successfully. Sep 28 15:18:08 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8f9048ba-db06-4cbf-8aa4-ca080f0f39d5 tempest-ProjectMemberTests-293722149 None] Lock "cinder-43a8fc76-8fa2-465c-bcdb-e692348bbc78-delete_snapshot" released by "delete_snapshot" :: held 1.849s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:08 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ab411c15-cbd0-48b3-b8b9-6693d23849b2 tempest-ProjectMemberTests-293722149 None] Acquiring lock "cinder-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:08 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ab411c15-cbd0-48b3-b8b9-6693d23849b2 tempest-ProjectMemberTests-293722149 None] Lock "cinder-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:08 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ab411c15-cbd0-48b3-b8b9-6693d23849b2 tempest-ProjectMemberTests-293722149 None] Acquiring lock "cinder-quobyte-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:08 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ab411c15-cbd0-48b3-b8b9-6693d23849b2 tempest-ProjectMemberTests-293722149 None] Lock "cinder-quobyte-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c" acquired by "delete_volume" :: waited 0.037s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:09 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[284b2423-4b6b-4014-aea7-d8e48f5c0fe5]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ab411c15-cbd0-48b3-b8b9-6693d23849b2 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:09 devstack sudo[109281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c Sep 28 15:18:09 devstack sudo[109281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:09 devstack sudo[109281]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ab411c15-cbd0-48b3-b8b9-6693d23849b2 tempest-ProjectMemberTests-293722149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c" returned: 0 in 0.414s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ab411c15-cbd0-48b3-b8b9-6693d23849b2 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:09 devstack sudo[109287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c Sep 28 15:18:09 devstack sudo[109287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:09 devstack sudo[109287]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ab411c15-cbd0-48b3-b8b9-6693d23849b2 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c" returned: 0 in 0.364s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:09 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ab411c15-cbd0-48b3-b8b9-6693d23849b2 tempest-ProjectMemberTests-293722149 None] Lock "cinder-quobyte-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c" released by "delete_volume" :: held 0.883s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:09 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-ab411c15-cbd0-48b3-b8b9-6693d23849b2 tempest-ProjectMemberTests-293722149 None] Created reservations ['00ff822c-5855-4ee1-a49f-ba3635d41dd8', '9dd3854e-c7e2-4817-9bee-d1fdf98e4252', '9f98fe7d-345d-4286-ad09-90944c3b2bb7', '3a518772-b2c7-479b-b89d-92e00c2546cf'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:18:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ab411c15-cbd0-48b3-b8b9-6693d23849b2 tempest-ProjectMemberTests-293722149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ab411c15-cbd0-48b3-b8b9-6693d23849b2 tempest-ProjectMemberTests-293722149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:10 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ab411c15-cbd0-48b3-b8b9-6693d23849b2 tempest-ProjectMemberTests-293722149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:18:10 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ab411c15-cbd0-48b3-b8b9-6693d23849b2 tempest-ProjectMemberTests-293722149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:18:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ab411c15-cbd0-48b3-b8b9-6693d23849b2 tempest-ProjectMemberTests-293722149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ab411c15-cbd0-48b3-b8b9-6693d23849b2 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:10 devstack sudo[109291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:18:10 devstack sudo[109291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:10 devstack sudo[109291]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ab411c15-cbd0-48b3-b8b9-6693d23849b2 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.375s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:10 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-ab411c15-cbd0-48b3-b8b9-6693d23849b2 tempest-ProjectMemberTests-293722149 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:18:10 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-ab411c15-cbd0-48b3-b8b9-6693d23849b2 tempest-ProjectMemberTests-293722149 None] Deleted volume successfully. Sep 28 15:18:10 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ab411c15-cbd0-48b3-b8b9-6693d23849b2 tempest-ProjectMemberTests-293722149 None] Lock "cinder-30f7e206-5fad-41f8-9e5c-3dbd2f52c62c-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:10 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-41f14454-90ed-40be-b253-f99c1b206853 tempest-ProjectMemberTests-293722149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:18:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-41f14454-90ed-40be-b253-f99c1b206853 tempest-ProjectMemberTests-293722149 None] Flow 'volume_create_manager' (4146955b-eeac-4fd8-afc5-fc4ff37d2baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:18:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-41f14454-90ed-40be-b253-f99c1b206853 tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (080532f0-482b-4265-99e3-27f09280af80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-41f14454-90ed-40be-b253-f99c1b206853 tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (080532f0-482b-4265-99e3-27f09280af80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-317909165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fbf0424-f8eb-4689-a966-ffd58acca50b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd1cca6dd0284a7c863af0b50e63e06b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:18:11Z,use_quota=True,user_id='f79e6dc0ec9740e0ab12c9a6bf177496',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-41f14454-90ed-40be-b253-f99c1b206853 tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95b3b040-cd33-448e-9430-48bf08091230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-41f14454-90ed-40be-b253-f99c1b206853 tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95b3b040-cd33-448e-9430-48bf08091230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-41f14454-90ed-40be-b253-f99c1b206853 tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (012d1866-8eb0-4544-8ea7-3e6f8037e9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-41f14454-90ed-40be-b253-f99c1b206853 tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (012d1866-8eb0-4544-8ea7-3e6f8037e9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fbf0424-f8eb-4689-a966-ffd58acca50b', 'volume_name': 'volume-9fbf0424-f8eb-4689-a966-ffd58acca50b', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-41f14454-90ed-40be-b253-f99c1b206853 tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb11eca9-5281-4346-9e74-0690fe790f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-41f14454-90ed-40be-b253-f99c1b206853 tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb11eca9-5281-4346-9e74-0690fe790f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-41f14454-90ed-40be-b253-f99c1b206853 tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22f6a03a-d406-4fab-b961-2277b917befd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:10 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-41f14454-90ed-40be-b253-f99c1b206853 tempest-ProjectMemberTests-293722149 None] Volume 9fbf0424-f8eb-4689-a966-ffd58acca50b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fbf0424-f8eb-4689-a966-ffd58acca50b', 'volume_size': 1} Sep 28 15:18:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-41f14454-90ed-40be-b253-f99c1b206853 tempest-ProjectMemberTests-293722149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-41f14454-90ed-40be-b253-f99c1b206853 tempest-ProjectMemberTests-293722149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:10 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-41f14454-90ed-40be-b253-f99c1b206853 tempest-ProjectMemberTests-293722149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-317909165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fbf0424-f8eb-4689-a966-ffd58acca50b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd1cca6dd0284a7c863af0b50e63e06b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:18:11Z,use_quota=True,user_id='f79e6dc0ec9740e0ab12c9a6bf177496',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:18:10 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-41f14454-90ed-40be-b253-f99c1b206853 tempest-ProjectMemberTests-293722149 None] Creating volume 9fbf0424-f8eb-4689-a966-ffd58acca50b {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:18:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-41f14454-90ed-40be-b253-f99c1b206853 tempest-ProjectMemberTests-293722149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-41f14454-90ed-40be-b253-f99c1b206853 tempest-ProjectMemberTests-293722149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:10 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-41f14454-90ed-40be-b253-f99c1b206853 tempest-ProjectMemberTests-293722149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:18:10 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-41f14454-90ed-40be-b253-f99c1b206853 tempest-ProjectMemberTests-293722149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:18:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-41f14454-90ed-40be-b253-f99c1b206853 tempest-ProjectMemberTests-293722149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:10 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-41f14454-90ed-40be-b253-f99c1b206853 tempest-ProjectMemberTests-293722149 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:18:10 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-41f14454-90ed-40be-b253-f99c1b206853 tempest-ProjectMemberTests-293722149 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:18:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-41f14454-90ed-40be-b253-f99c1b206853 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9fbf0424-f8eb-4689-a966-ffd58acca50b 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:10 devstack sudo[109294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9fbf0424-f8eb-4689-a966-ffd58acca50b 1073741824 Sep 28 15:18:10 devstack sudo[109294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:11 devstack sudo[109294]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-41f14454-90ed-40be-b253-f99c1b206853 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9fbf0424-f8eb-4689-a966-ffd58acca50b 1073741824" returned: 0 in 0.565s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-41f14454-90ed-40be-b253-f99c1b206853 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9fbf0424-f8eb-4689-a966-ffd58acca50b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:11 devstack sudo[109301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9fbf0424-f8eb-4689-a966-ffd58acca50b Sep 28 15:18:11 devstack sudo[109301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:11 devstack sudo[109301]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-41f14454-90ed-40be-b253-f99c1b206853 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9fbf0424-f8eb-4689-a966-ffd58acca50b" returned: 0 in 0.282s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:11 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-41f14454-90ed-40be-b253-f99c1b206853 tempest-ProjectMemberTests-293722149 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:18:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-41f14454-90ed-40be-b253-f99c1b206853 tempest-ProjectMemberTests-293722149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:11 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-41f14454-90ed-40be-b253-f99c1b206853 tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22f6a03a-d406-4fab-b961-2277b917befd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fbf0424-f8eb-4689-a966-ffd58acca50b', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:11 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-41f14454-90ed-40be-b253-f99c1b206853 tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b22942eb-5b66-4970-89ca-4e85ecb4d776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:11 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-41f14454-90ed-40be-b253-f99c1b206853 tempest-ProjectMemberTests-293722149 None] Volume volume-9fbf0424-f8eb-4689-a966-ffd58acca50b (9fbf0424-f8eb-4689-a966-ffd58acca50b): created successfully Sep 28 15:18:11 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-41f14454-90ed-40be-b253-f99c1b206853 tempest-ProjectMemberTests-293722149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b22942eb-5b66-4970-89ca-4e85ecb4d776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:11 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-41f14454-90ed-40be-b253-f99c1b206853 tempest-ProjectMemberTests-293722149 None] Flow 'volume_create_manager' (4146955b-eeac-4fd8-afc5-fc4ff37d2baa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:18:11 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-41f14454-90ed-40be-b253-f99c1b206853 tempest-ProjectMemberTests-293722149 None] Created volume successfully. Sep 28 15:18:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dcfe8d28-77e6-4d43-9f5b-430fda66ef82 tempest-ProjectMemberTests-293722149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dcfe8d28-77e6-4d43-9f5b-430fda66ef82 tempest-ProjectMemberTests-293722149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:13 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-dcfe8d28-77e6-4d43-9f5b-430fda66ef82 tempest-ProjectMemberTests-293722149 None] Creating offline snapshot d3a0bee6-722b-439c-9277-f1434ed55a1c of volume 9fbf0424-f8eb-4689-a966-ffd58acca50b {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:18:13 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89abbd4-692b-4abe-94cb-61dae3885abd]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dcfe8d28-77e6-4d43-9f5b-430fda66ef82 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9fbf0424-f8eb-4689-a966-ffd58acca50b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:13 devstack sudo[109304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9fbf0424-f8eb-4689-a966-ffd58acca50b Sep 28 15:18:13 devstack sudo[109304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:13 devstack sudo[109304]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dcfe8d28-77e6-4d43-9f5b-430fda66ef82 tempest-ProjectMemberTests-293722149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9fbf0424-f8eb-4689-a966-ffd58acca50b" returned: 0 in 0.418s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dcfe8d28-77e6-4d43-9f5b-430fda66ef82 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9fbf0424-f8eb-4689-a966-ffd58acca50b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9fbf0424-f8eb-4689-a966-ffd58acca50b.d3a0bee6-722b-439c-9277-f1434ed55a1c 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:13 devstack sudo[109309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9fbf0424-f8eb-4689-a966-ffd58acca50b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9fbf0424-f8eb-4689-a966-ffd58acca50b.d3a0bee6-722b-439c-9277-f1434ed55a1c 1G Sep 28 15:18:13 devstack sudo[109309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:13 devstack sudo[109309]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dcfe8d28-77e6-4d43-9f5b-430fda66ef82 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9fbf0424-f8eb-4689-a966-ffd58acca50b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9fbf0424-f8eb-4689-a966-ffd58acca50b.d3a0bee6-722b-439c-9277-f1434ed55a1c 1G" returned: 0 in 0.435s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dcfe8d28-77e6-4d43-9f5b-430fda66ef82 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fbf0424-f8eb-4689-a966-ffd58acca50b -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9fbf0424-f8eb-4689-a966-ffd58acca50b.d3a0bee6-722b-439c-9277-f1434ed55a1c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:13 devstack sudo[109314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fbf0424-f8eb-4689-a966-ffd58acca50b -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9fbf0424-f8eb-4689-a966-ffd58acca50b.d3a0bee6-722b-439c-9277-f1434ed55a1c Sep 28 15:18:13 devstack sudo[109314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:14 devstack sudo[109314]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dcfe8d28-77e6-4d43-9f5b-430fda66ef82 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fbf0424-f8eb-4689-a966-ffd58acca50b -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9fbf0424-f8eb-4689-a966-ffd58acca50b.d3a0bee6-722b-439c-9277-f1434ed55a1c" returned: 0 in 0.310s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:14 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-dcfe8d28-77e6-4d43-9f5b-430fda66ef82 tempest-ProjectMemberTests-293722149 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9fbf0424-f8eb-4689-a966-ffd58acca50b.d3a0bee6-722b-439c-9277-f1434ed55a1c is being set with open permissions: ugo+rw Sep 28 15:18:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dcfe8d28-77e6-4d43-9f5b-430fda66ef82 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9fbf0424-f8eb-4689-a966-ffd58acca50b.d3a0bee6-722b-439c-9277-f1434ed55a1c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:14 devstack sudo[109319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9fbf0424-f8eb-4689-a966-ffd58acca50b.d3a0bee6-722b-439c-9277-f1434ed55a1c Sep 28 15:18:14 devstack sudo[109319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:14 devstack sudo[109319]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dcfe8d28-77e6-4d43-9f5b-430fda66ef82 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9fbf0424-f8eb-4689-a966-ffd58acca50b.d3a0bee6-722b-439c-9277-f1434ed55a1c" returned: 0 in 0.233s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dcfe8d28-77e6-4d43-9f5b-430fda66ef82 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9fbf0424-f8eb-4689-a966-ffd58acca50b.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:14 devstack sudo[109322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9fbf0424-f8eb-4689-a966-ffd58acca50b.info Sep 28 15:18:14 devstack sudo[109322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:14 devstack sudo[109322]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dcfe8d28-77e6-4d43-9f5b-430fda66ef82 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9fbf0424-f8eb-4689-a966-ffd58acca50b.info" returned: 0 in 0.258s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:14 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-dcfe8d28-77e6-4d43-9f5b-430fda66ef82 tempest-ProjectMemberTests-293722149 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9fbf0424-f8eb-4689-a966-ffd58acca50b.info is being set with open permissions: ugo+rw Sep 28 15:18:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dcfe8d28-77e6-4d43-9f5b-430fda66ef82 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9fbf0424-f8eb-4689-a966-ffd58acca50b.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:14 devstack sudo[109325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9fbf0424-f8eb-4689-a966-ffd58acca50b.info Sep 28 15:18:14 devstack sudo[109325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:14 devstack sudo[109325]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dcfe8d28-77e6-4d43-9f5b-430fda66ef82 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9fbf0424-f8eb-4689-a966-ffd58acca50b.info" returned: 0 in 0.243s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dcfe8d28-77e6-4d43-9f5b-430fda66ef82 tempest-ProjectMemberTests-293722149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.989s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:15 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-dcfe8d28-77e6-4d43-9f5b-430fda66ef82 tempest-ProjectMemberTests-293722149 None] Create snapshot completed successfully Sep 28 15:18:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fd2732e6-645e-4d2c-9ad7-d1aac7df7f31 tempest-ProjectMemberTests-293722149 None] Acquiring lock "cinder-d3a0bee6-722b-439c-9277-f1434ed55a1c-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fd2732e6-645e-4d2c-9ad7-d1aac7df7f31 tempest-ProjectMemberTests-293722149 None] Lock "cinder-d3a0bee6-722b-439c-9277-f1434ed55a1c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fd2732e6-645e-4d2c-9ad7-d1aac7df7f31 tempest-ProjectMemberTests-293722149 None] Acquiring lock "cinder-quobyte-9fbf0424-f8eb-4689-a966-ffd58acca50b" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fd2732e6-645e-4d2c-9ad7-d1aac7df7f31 tempest-ProjectMemberTests-293722149 None] Lock "cinder-quobyte-9fbf0424-f8eb-4689-a966-ffd58acca50b" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fd2732e6-645e-4d2c-9ad7-d1aac7df7f31 tempest-ProjectMemberTests-293722149 None] Acquiring lock "cinder-quobyte-d3a0bee6-722b-439c-9277-f1434ed55a1c" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fd2732e6-645e-4d2c-9ad7-d1aac7df7f31 tempest-ProjectMemberTests-293722149 None] Lock "cinder-quobyte-d3a0bee6-722b-439c-9277-f1434ed55a1c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-fd2732e6-645e-4d2c-9ad7-d1aac7df7f31 tempest-ProjectMemberTests-293722149 None] Deleting offline snapshot d3a0bee6-722b-439c-9277-f1434ed55a1c of volume 9fbf0424-f8eb-4689-a966-ffd58acca50b {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:18:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-fd2732e6-645e-4d2c-9ad7-d1aac7df7f31 tempest-ProjectMemberTests-293722149 None] snapshot_file for this snap is: volume-9fbf0424-f8eb-4689-a966-ffd58acca50b.d3a0bee6-722b-439c-9277-f1434ed55a1c {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:18:15 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[40df5d8d-3483-4078-b577-59a60d8cb747]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fd2732e6-645e-4d2c-9ad7-d1aac7df7f31 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9fbf0424-f8eb-4689-a966-ffd58acca50b.d3a0bee6-722b-439c-9277-f1434ed55a1c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:15 devstack sudo[109328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9fbf0424-f8eb-4689-a966-ffd58acca50b.d3a0bee6-722b-439c-9277-f1434ed55a1c Sep 28 15:18:15 devstack sudo[109328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:15 devstack sudo[109328]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fd2732e6-645e-4d2c-9ad7-d1aac7df7f31 tempest-ProjectMemberTests-293722149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9fbf0424-f8eb-4689-a966-ffd58acca50b.d3a0bee6-722b-439c-9277-f1434ed55a1c" returned: 0 in 0.393s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-fd2732e6-645e-4d2c-9ad7-d1aac7df7f31 tempest-ProjectMemberTests-293722149 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9fbf0424-f8eb-4689-a966-ffd58acca50b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:18:15 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a429140-61cf-4d7e-a848-52d918d96b27]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fd2732e6-645e-4d2c-9ad7-d1aac7df7f31 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9fbf0424-f8eb-4689-a966-ffd58acca50b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:15 devstack sudo[109333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9fbf0424-f8eb-4689-a966-ffd58acca50b Sep 28 15:18:15 devstack sudo[109333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:16 devstack sudo[109333]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fd2732e6-645e-4d2c-9ad7-d1aac7df7f31 tempest-ProjectMemberTests-293722149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9fbf0424-f8eb-4689-a966-ffd58acca50b" returned: 0 in 0.462s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fd2732e6-645e-4d2c-9ad7-d1aac7df7f31 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9fbf0424-f8eb-4689-a966-ffd58acca50b.d3a0bee6-722b-439c-9277-f1434ed55a1c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:16 devstack sudo[109338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9fbf0424-f8eb-4689-a966-ffd58acca50b.d3a0bee6-722b-439c-9277-f1434ed55a1c Sep 28 15:18:16 devstack sudo[109338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:16 devstack sudo[109338]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fd2732e6-645e-4d2c-9ad7-d1aac7df7f31 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9fbf0424-f8eb-4689-a966-ffd58acca50b.d3a0bee6-722b-439c-9277-f1434ed55a1c" returned: 0 in 0.372s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fd2732e6-645e-4d2c-9ad7-d1aac7df7f31 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9fbf0424-f8eb-4689-a966-ffd58acca50b.d3a0bee6-722b-439c-9277-f1434ed55a1c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:16 devstack sudo[109343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9fbf0424-f8eb-4689-a966-ffd58acca50b.d3a0bee6-722b-439c-9277-f1434ed55a1c Sep 28 15:18:16 devstack sudo[109343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:16 devstack sudo[109343]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fd2732e6-645e-4d2c-9ad7-d1aac7df7f31 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9fbf0424-f8eb-4689-a966-ffd58acca50b.d3a0bee6-722b-439c-9277-f1434ed55a1c" returned: 0 in 0.280s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:16 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fd2732e6-645e-4d2c-9ad7-d1aac7df7f31 tempest-ProjectMemberTests-293722149 None] Lock "cinder-quobyte-d3a0bee6-722b-439c-9277-f1434ed55a1c" released by "_delete_snapshot" :: held 1.619s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:16 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fd2732e6-645e-4d2c-9ad7-d1aac7df7f31 tempest-ProjectMemberTests-293722149 None] Lock "cinder-quobyte-9fbf0424-f8eb-4689-a966-ffd58acca50b" released by "delete_snapshot" :: held 1.644s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:17 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-fd2732e6-645e-4d2c-9ad7-d1aac7df7f31 tempest-ProjectMemberTests-293722149 None] Created reservations ['3518a5c8-d01e-41df-80d8-50114ce3fb1f', '2a9f1610-fc0f-4a71-8bc7-7b01f8b3b418', 'd414a002-4d8f-492d-9446-ff94c4915d6a', 'b471b172-0db6-4cfa-b5d1-dfcc6726a91f'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:18:17 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:18:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:18:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:18:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:17 devstack sudo[109346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:18:17 devstack sudo[109346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:17 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-fd2732e6-645e-4d2c-9ad7-d1aac7df7f31 tempest-ProjectMemberTests-293722149 None] Delete snapshot completed successfully. Sep 28 15:18:17 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fd2732e6-645e-4d2c-9ad7-d1aac7df7f31 tempest-ProjectMemberTests-293722149 None] Lock "cinder-d3a0bee6-722b-439c-9277-f1434ed55a1c-delete_snapshot" released by "delete_snapshot" :: held 1.854s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:17 devstack sudo[109346]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.279s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:17 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:18:17 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running periodic task VolumeManager._thread_info {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:18:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] thread count: 28 {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:18:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] thread info: [<_MainThread(MainThread, started 135146735652992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:18:17 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-17ac46a7-9cfe-4e03-bb26-ca83f1312286 tempest-ProjectMemberTests-293722149 None] Acquiring lock "cinder-9fbf0424-f8eb-4689-a966-ffd58acca50b-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:17 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-17ac46a7-9cfe-4e03-bb26-ca83f1312286 tempest-ProjectMemberTests-293722149 None] Lock "cinder-9fbf0424-f8eb-4689-a966-ffd58acca50b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:17 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-17ac46a7-9cfe-4e03-bb26-ca83f1312286 tempest-ProjectMemberTests-293722149 None] Acquiring lock "cinder-quobyte-9fbf0424-f8eb-4689-a966-ffd58acca50b" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:17 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-17ac46a7-9cfe-4e03-bb26-ca83f1312286 tempest-ProjectMemberTests-293722149 None] Lock "cinder-quobyte-9fbf0424-f8eb-4689-a966-ffd58acca50b" acquired by "delete_volume" :: waited 0.018s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:17 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e6cb2c-947a-4109-9dbe-e0479ad10dd5]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-17ac46a7-9cfe-4e03-bb26-ca83f1312286 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9fbf0424-f8eb-4689-a966-ffd58acca50b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:17 devstack sudo[109349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9fbf0424-f8eb-4689-a966-ffd58acca50b Sep 28 15:18:17 devstack sudo[109349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:17 devstack sudo[109349]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-17ac46a7-9cfe-4e03-bb26-ca83f1312286 tempest-ProjectMemberTests-293722149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9fbf0424-f8eb-4689-a966-ffd58acca50b" returned: 0 in 0.397s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-17ac46a7-9cfe-4e03-bb26-ca83f1312286 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9fbf0424-f8eb-4689-a966-ffd58acca50b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:18 devstack sudo[109354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9fbf0424-f8eb-4689-a966-ffd58acca50b Sep 28 15:18:18 devstack sudo[109354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:18 devstack sudo[109354]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-17ac46a7-9cfe-4e03-bb26-ca83f1312286 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9fbf0424-f8eb-4689-a966-ffd58acca50b" returned: 0 in 0.267s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:18 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-17ac46a7-9cfe-4e03-bb26-ca83f1312286 tempest-ProjectMemberTests-293722149 None] Lock "cinder-quobyte-9fbf0424-f8eb-4689-a966-ffd58acca50b" released by "delete_volume" :: held 0.741s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:18 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-17ac46a7-9cfe-4e03-bb26-ca83f1312286 tempest-ProjectMemberTests-293722149 None] Created reservations ['ce1fdb85-6047-431a-b39d-f3e068e34505', '2d075241-4987-4e14-9b83-9e8b5b740d8d', 'cd83a736-ce97-44b9-9df5-7cd813a9650d', '7016040c-6186-4833-bfd7-c715ea201337'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:18:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-17ac46a7-9cfe-4e03-bb26-ca83f1312286 tempest-ProjectMemberTests-293722149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-17ac46a7-9cfe-4e03-bb26-ca83f1312286 tempest-ProjectMemberTests-293722149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-17ac46a7-9cfe-4e03-bb26-ca83f1312286 tempest-ProjectMemberTests-293722149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:18:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-17ac46a7-9cfe-4e03-bb26-ca83f1312286 tempest-ProjectMemberTests-293722149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:18:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-17ac46a7-9cfe-4e03-bb26-ca83f1312286 tempest-ProjectMemberTests-293722149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-17ac46a7-9cfe-4e03-bb26-ca83f1312286 tempest-ProjectMemberTests-293722149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:18 devstack sudo[109357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:18:18 devstack sudo[109357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:18 devstack sudo[109357]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-17ac46a7-9cfe-4e03-bb26-ca83f1312286 tempest-ProjectMemberTests-293722149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.292s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:18 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-17ac46a7-9cfe-4e03-bb26-ca83f1312286 tempest-ProjectMemberTests-293722149 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:18:18 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-17ac46a7-9cfe-4e03-bb26-ca83f1312286 tempest-ProjectMemberTests-293722149 None] Deleted volume successfully. Sep 28 15:18:18 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-17ac46a7-9cfe-4e03-bb26-ca83f1312286 tempest-ProjectMemberTests-293722149 None] Lock "cinder-9fbf0424-f8eb-4689-a966-ffd58acca50b-delete_volume" released by "delete_volume" :: held 1.275s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:22 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-5623a5a6-b488-41d1-a6e5-783dba5bcd0f tempest-ProjectReaderTests-1324819150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:18:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5623a5a6-b488-41d1-a6e5-783dba5bcd0f tempest-ProjectReaderTests-1324819150 None] Flow 'volume_create_manager' (cb735670-414b-49cc-8e1b-0952fcc53c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:18:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5623a5a6-b488-41d1-a6e5-783dba5bcd0f tempest-ProjectReaderTests-1324819150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bbe2200-d0c6-41af-b25c-1fd056f5278f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5623a5a6-b488-41d1-a6e5-783dba5bcd0f tempest-ProjectReaderTests-1324819150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bbe2200-d0c6-41af-b25c-1fd056f5278f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:18:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-378068016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='273c7ce63e9f4726b9a7f2413530bab9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:18:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:18:22Z,use_quota=True,user_id='ba52a6a8ee5c4884b4752c9851e71d85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5623a5a6-b488-41d1-a6e5-783dba5bcd0f tempest-ProjectReaderTests-1324819150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c5d58e8-4ed9-40e0-a021-a5d1d7da2865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5623a5a6-b488-41d1-a6e5-783dba5bcd0f tempest-ProjectReaderTests-1324819150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c5d58e8-4ed9-40e0-a021-a5d1d7da2865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5623a5a6-b488-41d1-a6e5-783dba5bcd0f tempest-ProjectReaderTests-1324819150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64989220-70ec-411b-8ad3-05811424aada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5623a5a6-b488-41d1-a6e5-783dba5bcd0f tempest-ProjectReaderTests-1324819150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64989220-70ec-411b-8ad3-05811424aada) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2', 'volume_name': 'volume-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5623a5a6-b488-41d1-a6e5-783dba5bcd0f tempest-ProjectReaderTests-1324819150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b804350-839b-4345-9bb5-6befada7f0c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5623a5a6-b488-41d1-a6e5-783dba5bcd0f tempest-ProjectReaderTests-1324819150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b804350-839b-4345-9bb5-6befada7f0c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5623a5a6-b488-41d1-a6e5-783dba5bcd0f tempest-ProjectReaderTests-1324819150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (999a71c6-f9b6-496c-a12b-4a0c53200315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:22 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-5623a5a6-b488-41d1-a6e5-783dba5bcd0f tempest-ProjectReaderTests-1324819150 None] Volume 1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2', 'volume_size': 1} Sep 28 15:18:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5623a5a6-b488-41d1-a6e5-783dba5bcd0f tempest-ProjectReaderTests-1324819150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5623a5a6-b488-41d1-a6e5-783dba5bcd0f tempest-ProjectReaderTests-1324819150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:22 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5623a5a6-b488-41d1-a6e5-783dba5bcd0f tempest-ProjectReaderTests-1324819150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:18:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-378068016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='273c7ce63e9f4726b9a7f2413530bab9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:18:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:18:22Z,use_quota=True,user_id='ba52a6a8ee5c4884b4752c9851e71d85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:18:22 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-5623a5a6-b488-41d1-a6e5-783dba5bcd0f tempest-ProjectReaderTests-1324819150 None] Creating volume 1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:18:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5623a5a6-b488-41d1-a6e5-783dba5bcd0f tempest-ProjectReaderTests-1324819150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5623a5a6-b488-41d1-a6e5-783dba5bcd0f tempest-ProjectReaderTests-1324819150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:22 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5623a5a6-b488-41d1-a6e5-783dba5bcd0f tempest-ProjectReaderTests-1324819150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:18:22 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5623a5a6-b488-41d1-a6e5-783dba5bcd0f tempest-ProjectReaderTests-1324819150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:18:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5623a5a6-b488-41d1-a6e5-783dba5bcd0f tempest-ProjectReaderTests-1324819150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:22 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5623a5a6-b488-41d1-a6e5-783dba5bcd0f tempest-ProjectReaderTests-1324819150 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:18:22 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-5623a5a6-b488-41d1-a6e5-783dba5bcd0f tempest-ProjectReaderTests-1324819150 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:18:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5623a5a6-b488-41d1-a6e5-783dba5bcd0f tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:22 devstack sudo[109361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2 1073741824 Sep 28 15:18:22 devstack sudo[109361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:23 devstack sudo[109361]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5623a5a6-b488-41d1-a6e5-783dba5bcd0f tempest-ProjectReaderTests-1324819150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2 1073741824" returned: 0 in 0.444s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5623a5a6-b488-41d1-a6e5-783dba5bcd0f tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:23 devstack sudo[109367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2 Sep 28 15:18:23 devstack sudo[109367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:23 devstack sudo[109367]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5623a5a6-b488-41d1-a6e5-783dba5bcd0f tempest-ProjectReaderTests-1324819150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2" returned: 0 in 0.275s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:23 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5623a5a6-b488-41d1-a6e5-783dba5bcd0f tempest-ProjectReaderTests-1324819150 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:18:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5623a5a6-b488-41d1-a6e5-783dba5bcd0f tempest-ProjectReaderTests-1324819150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5623a5a6-b488-41d1-a6e5-783dba5bcd0f tempest-ProjectReaderTests-1324819150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (999a71c6-f9b6-496c-a12b-4a0c53200315) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5623a5a6-b488-41d1-a6e5-783dba5bcd0f tempest-ProjectReaderTests-1324819150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c826a4e1-c08f-46ef-94a8-474e8d0dfc37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:23 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-5623a5a6-b488-41d1-a6e5-783dba5bcd0f tempest-ProjectReaderTests-1324819150 None] Volume volume-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2 (1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2): created successfully Sep 28 15:18:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5623a5a6-b488-41d1-a6e5-783dba5bcd0f tempest-ProjectReaderTests-1324819150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c826a4e1-c08f-46ef-94a8-474e8d0dfc37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5623a5a6-b488-41d1-a6e5-783dba5bcd0f tempest-ProjectReaderTests-1324819150 None] Flow 'volume_create_manager' (cb735670-414b-49cc-8e1b-0952fcc53c29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:18:23 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-5623a5a6-b488-41d1-a6e5-783dba5bcd0f tempest-ProjectReaderTests-1324819150 None] Created volume successfully. Sep 28 15:18:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b7443692-154f-4d69-93dc-4f0ccb4519a9 tempest-ProjectReaderTests-1324819150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b7443692-154f-4d69-93dc-4f0ccb4519a9 tempest-ProjectReaderTests-1324819150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:23 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-b7443692-154f-4d69-93dc-4f0ccb4519a9 tempest-ProjectReaderTests-1324819150 None] Creating offline snapshot 722433ce-dd9d-4a2d-9188-5d3a983edcb7 of volume 1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2 {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:18:23 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[331b4419-07b7-47bc-8ecb-6ee5992f026b]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b7443692-154f-4d69-93dc-4f0ccb4519a9 tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:23 devstack sudo[109370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2 Sep 28 15:18:23 devstack sudo[109370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:24 devstack sudo[109370]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b7443692-154f-4d69-93dc-4f0ccb4519a9 tempest-ProjectReaderTests-1324819150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2" returned: 0 in 0.392s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b7443692-154f-4d69-93dc-4f0ccb4519a9 tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2.722433ce-dd9d-4a2d-9188-5d3a983edcb7 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:24 devstack sudo[109375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2.722433ce-dd9d-4a2d-9188-5d3a983edcb7 1G Sep 28 15:18:24 devstack sudo[109375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:24 devstack sudo[109375]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b7443692-154f-4d69-93dc-4f0ccb4519a9 tempest-ProjectReaderTests-1324819150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2.722433ce-dd9d-4a2d-9188-5d3a983edcb7 1G" returned: 0 in 0.431s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b7443692-154f-4d69-93dc-4f0ccb4519a9 tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2.722433ce-dd9d-4a2d-9188-5d3a983edcb7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:24 devstack sudo[109381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2.722433ce-dd9d-4a2d-9188-5d3a983edcb7 Sep 28 15:18:24 devstack sudo[109381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:24 devstack sudo[109381]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b7443692-154f-4d69-93dc-4f0ccb4519a9 tempest-ProjectReaderTests-1324819150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2.722433ce-dd9d-4a2d-9188-5d3a983edcb7" returned: 0 in 0.293s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:24 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-b7443692-154f-4d69-93dc-4f0ccb4519a9 tempest-ProjectReaderTests-1324819150 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2.722433ce-dd9d-4a2d-9188-5d3a983edcb7 is being set with open permissions: ugo+rw Sep 28 15:18:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b7443692-154f-4d69-93dc-4f0ccb4519a9 tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2.722433ce-dd9d-4a2d-9188-5d3a983edcb7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:24 devstack sudo[109386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2.722433ce-dd9d-4a2d-9188-5d3a983edcb7 Sep 28 15:18:24 devstack sudo[109386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:25 devstack sudo[109386]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b7443692-154f-4d69-93dc-4f0ccb4519a9 tempest-ProjectReaderTests-1324819150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2.722433ce-dd9d-4a2d-9188-5d3a983edcb7" returned: 0 in 0.242s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b7443692-154f-4d69-93dc-4f0ccb4519a9 tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:25 devstack sudo[109389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2.info Sep 28 15:18:25 devstack sudo[109389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:25 devstack sudo[109389]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b7443692-154f-4d69-93dc-4f0ccb4519a9 tempest-ProjectReaderTests-1324819150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2.info" returned: 0 in 0.254s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:25 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-b7443692-154f-4d69-93dc-4f0ccb4519a9 tempest-ProjectReaderTests-1324819150 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2.info is being set with open permissions: ugo+rw Sep 28 15:18:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b7443692-154f-4d69-93dc-4f0ccb4519a9 tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:25 devstack sudo[109392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2.info Sep 28 15:18:25 devstack sudo[109392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:25 devstack sudo[109392]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b7443692-154f-4d69-93dc-4f0ccb4519a9 tempest-ProjectReaderTests-1324819150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2.info" returned: 0 in 0.267s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b7443692-154f-4d69-93dc-4f0ccb4519a9 tempest-ProjectReaderTests-1324819150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.972s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:25 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-b7443692-154f-4d69-93dc-4f0ccb4519a9 tempest-ProjectReaderTests-1324819150 None] Create snapshot completed successfully Sep 28 15:18:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fe7d71a4-d2fc-4d73-b877-e522bb91503e tempest-ProjectReaderTests-1324819150 None] Acquiring lock "cinder-722433ce-dd9d-4a2d-9188-5d3a983edcb7-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fe7d71a4-d2fc-4d73-b877-e522bb91503e tempest-ProjectReaderTests-1324819150 None] Lock "cinder-722433ce-dd9d-4a2d-9188-5d3a983edcb7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fe7d71a4-d2fc-4d73-b877-e522bb91503e tempest-ProjectReaderTests-1324819150 None] Acquiring lock "cinder-quobyte-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fe7d71a4-d2fc-4d73-b877-e522bb91503e tempest-ProjectReaderTests-1324819150 None] Lock "cinder-quobyte-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fe7d71a4-d2fc-4d73-b877-e522bb91503e tempest-ProjectReaderTests-1324819150 None] Acquiring lock "cinder-quobyte-722433ce-dd9d-4a2d-9188-5d3a983edcb7" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fe7d71a4-d2fc-4d73-b877-e522bb91503e tempest-ProjectReaderTests-1324819150 None] Lock "cinder-quobyte-722433ce-dd9d-4a2d-9188-5d3a983edcb7" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-fe7d71a4-d2fc-4d73-b877-e522bb91503e tempest-ProjectReaderTests-1324819150 None] Deleting offline snapshot 722433ce-dd9d-4a2d-9188-5d3a983edcb7 of volume 1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:18:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-fe7d71a4-d2fc-4d73-b877-e522bb91503e tempest-ProjectReaderTests-1324819150 None] snapshot_file for this snap is: volume-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2.722433ce-dd9d-4a2d-9188-5d3a983edcb7 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:18:26 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e148aa5-0b98-49f0-b067-69cadadfe98f]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fe7d71a4-d2fc-4d73-b877-e522bb91503e tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2.722433ce-dd9d-4a2d-9188-5d3a983edcb7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:26 devstack sudo[109395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2.722433ce-dd9d-4a2d-9188-5d3a983edcb7 Sep 28 15:18:26 devstack sudo[109395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:26 devstack sudo[109395]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fe7d71a4-d2fc-4d73-b877-e522bb91503e tempest-ProjectReaderTests-1324819150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2.722433ce-dd9d-4a2d-9188-5d3a983edcb7" returned: 0 in 0.403s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-fe7d71a4-d2fc-4d73-b877-e522bb91503e tempest-ProjectReaderTests-1324819150 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:18:26 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96a9f39-3b46-4bfc-9fbc-691be0b2d01b]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fe7d71a4-d2fc-4d73-b877-e522bb91503e tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:26 devstack sudo[109400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2 Sep 28 15:18:26 devstack sudo[109400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:26 devstack sudo[109400]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fe7d71a4-d2fc-4d73-b877-e522bb91503e tempest-ProjectReaderTests-1324819150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2" returned: 0 in 0.422s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fe7d71a4-d2fc-4d73-b877-e522bb91503e tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2.722433ce-dd9d-4a2d-9188-5d3a983edcb7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:27 devstack sudo[109405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2.722433ce-dd9d-4a2d-9188-5d3a983edcb7 Sep 28 15:18:27 devstack sudo[109405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:27 devstack sudo[109405]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fe7d71a4-d2fc-4d73-b877-e522bb91503e tempest-ProjectReaderTests-1324819150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2.722433ce-dd9d-4a2d-9188-5d3a983edcb7" returned: 0 in 0.425s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fe7d71a4-d2fc-4d73-b877-e522bb91503e tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2.722433ce-dd9d-4a2d-9188-5d3a983edcb7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:27 devstack sudo[109410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2.722433ce-dd9d-4a2d-9188-5d3a983edcb7 Sep 28 15:18:27 devstack sudo[109410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:27 devstack sudo[109410]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fe7d71a4-d2fc-4d73-b877-e522bb91503e tempest-ProjectReaderTests-1324819150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2.722433ce-dd9d-4a2d-9188-5d3a983edcb7" returned: 0 in 0.332s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:27 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fe7d71a4-d2fc-4d73-b877-e522bb91503e tempest-ProjectReaderTests-1324819150 None] Lock "cinder-quobyte-722433ce-dd9d-4a2d-9188-5d3a983edcb7" released by "_delete_snapshot" :: held 1.730s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:27 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fe7d71a4-d2fc-4d73-b877-e522bb91503e tempest-ProjectReaderTests-1324819150 None] Lock "cinder-quobyte-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2" released by "delete_snapshot" :: held 1.760s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:27 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-fe7d71a4-d2fc-4d73-b877-e522bb91503e tempest-ProjectReaderTests-1324819150 None] Created reservations ['4e977d57-d6dc-4bd4-a44f-5f8a41c4d96b', '69ba170f-3cf9-47d2-9069-be106ae7723a', 'b6434c42-b1a7-47c8-8bd0-938f20f5a72d', 'e5734a47-5b4e-437d-9205-fefcf5dc44df'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:18:27 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-fe7d71a4-d2fc-4d73-b877-e522bb91503e tempest-ProjectReaderTests-1324819150 None] Delete snapshot completed successfully. Sep 28 15:18:27 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fe7d71a4-d2fc-4d73-b877-e522bb91503e tempest-ProjectReaderTests-1324819150 None] Lock "cinder-722433ce-dd9d-4a2d-9188-5d3a983edcb7-delete_snapshot" released by "delete_snapshot" :: held 1.925s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:28 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-78233eec-325d-4586-9112-dae7f51ddb69 tempest-ProjectReaderTests-1324819150 None] Acquiring lock "cinder-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:28 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-78233eec-325d-4586-9112-dae7f51ddb69 tempest-ProjectReaderTests-1324819150 None] Lock "cinder-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:28 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-78233eec-325d-4586-9112-dae7f51ddb69 tempest-ProjectReaderTests-1324819150 None] Acquiring lock "cinder-quobyte-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:28 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-78233eec-325d-4586-9112-dae7f51ddb69 tempest-ProjectReaderTests-1324819150 None] Lock "cinder-quobyte-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2" acquired by "delete_volume" :: waited 0.025s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:28 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[0911228b-3d24-4185-a7ab-d28ae29b969b]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-78233eec-325d-4586-9112-dae7f51ddb69 tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:28 devstack sudo[109413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2 Sep 28 15:18:28 devstack sudo[109413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:28 devstack sudo[109413]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-78233eec-325d-4586-9112-dae7f51ddb69 tempest-ProjectReaderTests-1324819150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2" returned: 0 in 0.387s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-78233eec-325d-4586-9112-dae7f51ddb69 tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:28 devstack sudo[109419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2 Sep 28 15:18:28 devstack sudo[109419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:29 devstack sudo[109419]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-78233eec-325d-4586-9112-dae7f51ddb69 tempest-ProjectReaderTests-1324819150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2" returned: 0 in 0.283s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:29 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-78233eec-325d-4586-9112-dae7f51ddb69 tempest-ProjectReaderTests-1324819150 None] Lock "cinder-quobyte-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2" released by "delete_volume" :: held 0.737s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:29 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-78233eec-325d-4586-9112-dae7f51ddb69 tempest-ProjectReaderTests-1324819150 None] Created reservations ['95842ae3-a4e6-4c1e-a09b-4d04128c4744', 'c257ca2a-1f56-4b96-b5e3-29d16ac7d78a', '7a9d5839-3f09-43d9-811b-9d01c275c5a8', 'bb4555e7-a01a-4063-829b-0254b82e4d2f'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:18:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-78233eec-325d-4586-9112-dae7f51ddb69 tempest-ProjectReaderTests-1324819150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-78233eec-325d-4586-9112-dae7f51ddb69 tempest-ProjectReaderTests-1324819150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:29 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-78233eec-325d-4586-9112-dae7f51ddb69 tempest-ProjectReaderTests-1324819150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:18:29 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-78233eec-325d-4586-9112-dae7f51ddb69 tempest-ProjectReaderTests-1324819150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:18:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-78233eec-325d-4586-9112-dae7f51ddb69 tempest-ProjectReaderTests-1324819150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-78233eec-325d-4586-9112-dae7f51ddb69 tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:29 devstack sudo[109422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:18:29 devstack sudo[109422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:29 devstack sudo[109422]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-78233eec-325d-4586-9112-dae7f51ddb69 tempest-ProjectReaderTests-1324819150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.290s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:29 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-78233eec-325d-4586-9112-dae7f51ddb69 tempest-ProjectReaderTests-1324819150 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:18:29 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-78233eec-325d-4586-9112-dae7f51ddb69 tempest-ProjectReaderTests-1324819150 None] Deleted volume successfully. Sep 28 15:18:29 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-78233eec-325d-4586-9112-dae7f51ddb69 tempest-ProjectReaderTests-1324819150 None] Lock "cinder-1afeb22f-7b5b-45cf-a7af-a9a1841a6bd2-delete_volume" released by "delete_volume" :: held 1.278s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:30 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dc0586b-91bd-431f-8986-d65d90f21615 tempest-ProjectReaderTests-1324819150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:18:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2dc0586b-91bd-431f-8986-d65d90f21615 tempest-ProjectReaderTests-1324819150 None] Flow 'volume_create_manager' (3cc77b98-2c7b-4009-82ae-aa199c270cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:18:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2dc0586b-91bd-431f-8986-d65d90f21615 tempest-ProjectReaderTests-1324819150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbcf0590-9e8b-4368-afcb-c982c78393be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2dc0586b-91bd-431f-8986-d65d90f21615 tempest-ProjectReaderTests-1324819150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbcf0590-9e8b-4368-afcb-c982c78393be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:18:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-245663166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f325b50-f9cd-4a85-a7da-485a280609f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='273c7ce63e9f4726b9a7f2413530bab9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:18:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:18:30Z,use_quota=True,user_id='ba52a6a8ee5c4884b4752c9851e71d85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2dc0586b-91bd-431f-8986-d65d90f21615 tempest-ProjectReaderTests-1324819150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (942e7677-6e90-4b3d-aa90-c37ff4bf59e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2dc0586b-91bd-431f-8986-d65d90f21615 tempest-ProjectReaderTests-1324819150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (942e7677-6e90-4b3d-aa90-c37ff4bf59e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2dc0586b-91bd-431f-8986-d65d90f21615 tempest-ProjectReaderTests-1324819150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4fcec65-170e-44a6-acc5-ed3e7bf76535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2dc0586b-91bd-431f-8986-d65d90f21615 tempest-ProjectReaderTests-1324819150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4fcec65-170e-44a6-acc5-ed3e7bf76535) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f325b50-f9cd-4a85-a7da-485a280609f5', 'volume_name': 'volume-3f325b50-f9cd-4a85-a7da-485a280609f5', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2dc0586b-91bd-431f-8986-d65d90f21615 tempest-ProjectReaderTests-1324819150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f20436c-563b-476f-b5dc-f57eb83d4dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2dc0586b-91bd-431f-8986-d65d90f21615 tempest-ProjectReaderTests-1324819150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f20436c-563b-476f-b5dc-f57eb83d4dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2dc0586b-91bd-431f-8986-d65d90f21615 tempest-ProjectReaderTests-1324819150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd034899-f998-42d3-baaf-024016b4a7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:30 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-2dc0586b-91bd-431f-8986-d65d90f21615 tempest-ProjectReaderTests-1324819150 None] Volume 3f325b50-f9cd-4a85-a7da-485a280609f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f325b50-f9cd-4a85-a7da-485a280609f5', 'volume_size': 1} Sep 28 15:18:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2dc0586b-91bd-431f-8986-d65d90f21615 tempest-ProjectReaderTests-1324819150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2dc0586b-91bd-431f-8986-d65d90f21615 tempest-ProjectReaderTests-1324819150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2dc0586b-91bd-431f-8986-d65d90f21615 tempest-ProjectReaderTests-1324819150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:18:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-245663166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f325b50-f9cd-4a85-a7da-485a280609f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='273c7ce63e9f4726b9a7f2413530bab9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:18:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:18:30Z,use_quota=True,user_id='ba52a6a8ee5c4884b4752c9851e71d85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:18:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-2dc0586b-91bd-431f-8986-d65d90f21615 tempest-ProjectReaderTests-1324819150 None] Creating volume 3f325b50-f9cd-4a85-a7da-485a280609f5 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:18:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2dc0586b-91bd-431f-8986-d65d90f21615 tempest-ProjectReaderTests-1324819150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2dc0586b-91bd-431f-8986-d65d90f21615 tempest-ProjectReaderTests-1324819150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2dc0586b-91bd-431f-8986-d65d90f21615 tempest-ProjectReaderTests-1324819150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:18:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2dc0586b-91bd-431f-8986-d65d90f21615 tempest-ProjectReaderTests-1324819150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:18:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2dc0586b-91bd-431f-8986-d65d90f21615 tempest-ProjectReaderTests-1324819150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2dc0586b-91bd-431f-8986-d65d90f21615 tempest-ProjectReaderTests-1324819150 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:18:30 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-2dc0586b-91bd-431f-8986-d65d90f21615 tempest-ProjectReaderTests-1324819150 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:18:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2dc0586b-91bd-431f-8986-d65d90f21615 tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3f325b50-f9cd-4a85-a7da-485a280609f5 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:30 devstack sudo[109425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3f325b50-f9cd-4a85-a7da-485a280609f5 1073741824 Sep 28 15:18:30 devstack sudo[109425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:30 devstack sudo[109425]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2dc0586b-91bd-431f-8986-d65d90f21615 tempest-ProjectReaderTests-1324819150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3f325b50-f9cd-4a85-a7da-485a280609f5 1073741824" returned: 0 in 0.484s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2dc0586b-91bd-431f-8986-d65d90f21615 tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3f325b50-f9cd-4a85-a7da-485a280609f5 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:30 devstack sudo[109430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3f325b50-f9cd-4a85-a7da-485a280609f5 Sep 28 15:18:30 devstack sudo[109430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:30 devstack sudo[109430]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2dc0586b-91bd-431f-8986-d65d90f21615 tempest-ProjectReaderTests-1324819150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3f325b50-f9cd-4a85-a7da-485a280609f5" returned: 0 in 0.263s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2dc0586b-91bd-431f-8986-d65d90f21615 tempest-ProjectReaderTests-1324819150 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:18:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2dc0586b-91bd-431f-8986-d65d90f21615 tempest-ProjectReaderTests-1324819150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2dc0586b-91bd-431f-8986-d65d90f21615 tempest-ProjectReaderTests-1324819150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd034899-f998-42d3-baaf-024016b4a7e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f325b50-f9cd-4a85-a7da-485a280609f5', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2dc0586b-91bd-431f-8986-d65d90f21615 tempest-ProjectReaderTests-1324819150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5342fdc-cbed-4ed2-90a5-8d830ebd6d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:30 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-2dc0586b-91bd-431f-8986-d65d90f21615 tempest-ProjectReaderTests-1324819150 None] Volume volume-3f325b50-f9cd-4a85-a7da-485a280609f5 (3f325b50-f9cd-4a85-a7da-485a280609f5): created successfully Sep 28 15:18:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2dc0586b-91bd-431f-8986-d65d90f21615 tempest-ProjectReaderTests-1324819150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5342fdc-cbed-4ed2-90a5-8d830ebd6d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2dc0586b-91bd-431f-8986-d65d90f21615 tempest-ProjectReaderTests-1324819150 None] Flow 'volume_create_manager' (3cc77b98-2c7b-4009-82ae-aa199c270cdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:18:30 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-2dc0586b-91bd-431f-8986-d65d90f21615 tempest-ProjectReaderTests-1324819150 None] Created volume successfully. Sep 28 15:18:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f50bd95f-3832-429e-8531-60f4a8d2e016 tempest-ProjectReaderTests-1324819150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f50bd95f-3832-429e-8531-60f4a8d2e016 tempest-ProjectReaderTests-1324819150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:32 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-f50bd95f-3832-429e-8531-60f4a8d2e016 tempest-ProjectReaderTests-1324819150 None] Creating offline snapshot d1a1b8c3-b4d4-4d8c-9e48-9fe294d0fcd1 of volume 3f325b50-f9cd-4a85-a7da-485a280609f5 {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:18:32 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2ead9b-71af-4b81-823e-80efcde9859b]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f50bd95f-3832-429e-8531-60f4a8d2e016 tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3f325b50-f9cd-4a85-a7da-485a280609f5 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:32 devstack sudo[109436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3f325b50-f9cd-4a85-a7da-485a280609f5 Sep 28 15:18:32 devstack sudo[109436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:32 devstack sudo[109436]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f50bd95f-3832-429e-8531-60f4a8d2e016 tempest-ProjectReaderTests-1324819150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3f325b50-f9cd-4a85-a7da-485a280609f5" returned: 0 in 0.430s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f50bd95f-3832-429e-8531-60f4a8d2e016 tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3f325b50-f9cd-4a85-a7da-485a280609f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3f325b50-f9cd-4a85-a7da-485a280609f5.d1a1b8c3-b4d4-4d8c-9e48-9fe294d0fcd1 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:32 devstack sudo[109441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3f325b50-f9cd-4a85-a7da-485a280609f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3f325b50-f9cd-4a85-a7da-485a280609f5.d1a1b8c3-b4d4-4d8c-9e48-9fe294d0fcd1 1G Sep 28 15:18:32 devstack sudo[109441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:33 devstack sudo[109441]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f50bd95f-3832-429e-8531-60f4a8d2e016 tempest-ProjectReaderTests-1324819150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3f325b50-f9cd-4a85-a7da-485a280609f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3f325b50-f9cd-4a85-a7da-485a280609f5.d1a1b8c3-b4d4-4d8c-9e48-9fe294d0fcd1 1G" returned: 0 in 0.479s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f50bd95f-3832-429e-8531-60f4a8d2e016 tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f325b50-f9cd-4a85-a7da-485a280609f5 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3f325b50-f9cd-4a85-a7da-485a280609f5.d1a1b8c3-b4d4-4d8c-9e48-9fe294d0fcd1 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:33 devstack sudo[109446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f325b50-f9cd-4a85-a7da-485a280609f5 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3f325b50-f9cd-4a85-a7da-485a280609f5.d1a1b8c3-b4d4-4d8c-9e48-9fe294d0fcd1 Sep 28 15:18:33 devstack sudo[109446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:33 devstack sudo[109446]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f50bd95f-3832-429e-8531-60f4a8d2e016 tempest-ProjectReaderTests-1324819150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f325b50-f9cd-4a85-a7da-485a280609f5 -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3f325b50-f9cd-4a85-a7da-485a280609f5.d1a1b8c3-b4d4-4d8c-9e48-9fe294d0fcd1" returned: 0 in 0.369s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:33 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-f50bd95f-3832-429e-8531-60f4a8d2e016 tempest-ProjectReaderTests-1324819150 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3f325b50-f9cd-4a85-a7da-485a280609f5.d1a1b8c3-b4d4-4d8c-9e48-9fe294d0fcd1 is being set with open permissions: ugo+rw Sep 28 15:18:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f50bd95f-3832-429e-8531-60f4a8d2e016 tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3f325b50-f9cd-4a85-a7da-485a280609f5.d1a1b8c3-b4d4-4d8c-9e48-9fe294d0fcd1 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:33 devstack sudo[109451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3f325b50-f9cd-4a85-a7da-485a280609f5.d1a1b8c3-b4d4-4d8c-9e48-9fe294d0fcd1 Sep 28 15:18:33 devstack sudo[109451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:33 devstack sudo[109451]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f50bd95f-3832-429e-8531-60f4a8d2e016 tempest-ProjectReaderTests-1324819150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3f325b50-f9cd-4a85-a7da-485a280609f5.d1a1b8c3-b4d4-4d8c-9e48-9fe294d0fcd1" returned: 0 in 0.293s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f50bd95f-3832-429e-8531-60f4a8d2e016 tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3f325b50-f9cd-4a85-a7da-485a280609f5.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:33 devstack sudo[109460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3f325b50-f9cd-4a85-a7da-485a280609f5.info Sep 28 15:18:33 devstack sudo[109460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:34 devstack sudo[109460]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f50bd95f-3832-429e-8531-60f4a8d2e016 tempest-ProjectReaderTests-1324819150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3f325b50-f9cd-4a85-a7da-485a280609f5.info" returned: 0 in 0.282s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:34 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-f50bd95f-3832-429e-8531-60f4a8d2e016 tempest-ProjectReaderTests-1324819150 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3f325b50-f9cd-4a85-a7da-485a280609f5.info is being set with open permissions: ugo+rw Sep 28 15:18:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f50bd95f-3832-429e-8531-60f4a8d2e016 tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3f325b50-f9cd-4a85-a7da-485a280609f5.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:34 devstack sudo[109463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3f325b50-f9cd-4a85-a7da-485a280609f5.info Sep 28 15:18:34 devstack sudo[109463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:34 devstack sudo[109463]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f50bd95f-3832-429e-8531-60f4a8d2e016 tempest-ProjectReaderTests-1324819150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3f325b50-f9cd-4a85-a7da-485a280609f5.info" returned: 0 in 0.260s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f50bd95f-3832-429e-8531-60f4a8d2e016 tempest-ProjectReaderTests-1324819150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.215s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:34 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-f50bd95f-3832-429e-8531-60f4a8d2e016 tempest-ProjectReaderTests-1324819150 None] Create snapshot completed successfully Sep 28 15:18:35 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7be56b83-e52d-4984-adfa-24b64d4a3584 tempest-ProjectReaderTests-1324819150 None] Acquiring lock "cinder-d1a1b8c3-b4d4-4d8c-9e48-9fe294d0fcd1-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:35 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7be56b83-e52d-4984-adfa-24b64d4a3584 tempest-ProjectReaderTests-1324819150 None] Lock "cinder-d1a1b8c3-b4d4-4d8c-9e48-9fe294d0fcd1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:35 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7be56b83-e52d-4984-adfa-24b64d4a3584 tempest-ProjectReaderTests-1324819150 None] Acquiring lock "cinder-quobyte-3f325b50-f9cd-4a85-a7da-485a280609f5" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:35 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7be56b83-e52d-4984-adfa-24b64d4a3584 tempest-ProjectReaderTests-1324819150 None] Lock "cinder-quobyte-3f325b50-f9cd-4a85-a7da-485a280609f5" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:35 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7be56b83-e52d-4984-adfa-24b64d4a3584 tempest-ProjectReaderTests-1324819150 None] Acquiring lock "cinder-quobyte-d1a1b8c3-b4d4-4d8c-9e48-9fe294d0fcd1" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:35 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7be56b83-e52d-4984-adfa-24b64d4a3584 tempest-ProjectReaderTests-1324819150 None] Lock "cinder-quobyte-d1a1b8c3-b4d4-4d8c-9e48-9fe294d0fcd1" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-7be56b83-e52d-4984-adfa-24b64d4a3584 tempest-ProjectReaderTests-1324819150 None] Deleting offline snapshot d1a1b8c3-b4d4-4d8c-9e48-9fe294d0fcd1 of volume 3f325b50-f9cd-4a85-a7da-485a280609f5 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:18:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-7be56b83-e52d-4984-adfa-24b64d4a3584 tempest-ProjectReaderTests-1324819150 None] snapshot_file for this snap is: volume-3f325b50-f9cd-4a85-a7da-485a280609f5.d1a1b8c3-b4d4-4d8c-9e48-9fe294d0fcd1 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:18:35 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[0744bf3a-ada7-4a56-8cff-9f20f2a63a68]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7be56b83-e52d-4984-adfa-24b64d4a3584 tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3f325b50-f9cd-4a85-a7da-485a280609f5.d1a1b8c3-b4d4-4d8c-9e48-9fe294d0fcd1 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:35 devstack sudo[109466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3f325b50-f9cd-4a85-a7da-485a280609f5.d1a1b8c3-b4d4-4d8c-9e48-9fe294d0fcd1 Sep 28 15:18:35 devstack sudo[109466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:35 devstack sudo[109466]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7be56b83-e52d-4984-adfa-24b64d4a3584 tempest-ProjectReaderTests-1324819150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3f325b50-f9cd-4a85-a7da-485a280609f5.d1a1b8c3-b4d4-4d8c-9e48-9fe294d0fcd1" returned: 0 in 0.447s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:36 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-7be56b83-e52d-4984-adfa-24b64d4a3584 tempest-ProjectReaderTests-1324819150 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f325b50-f9cd-4a85-a7da-485a280609f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:18:36 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[47053f38-022e-492b-96f1-22ff598a7498]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7be56b83-e52d-4984-adfa-24b64d4a3584 tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3f325b50-f9cd-4a85-a7da-485a280609f5 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:36 devstack sudo[109471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3f325b50-f9cd-4a85-a7da-485a280609f5 Sep 28 15:18:36 devstack sudo[109471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:36 devstack sudo[109471]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7be56b83-e52d-4984-adfa-24b64d4a3584 tempest-ProjectReaderTests-1324819150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3f325b50-f9cd-4a85-a7da-485a280609f5" returned: 0 in 0.390s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7be56b83-e52d-4984-adfa-24b64d4a3584 tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3f325b50-f9cd-4a85-a7da-485a280609f5.d1a1b8c3-b4d4-4d8c-9e48-9fe294d0fcd1 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:36 devstack sudo[109476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3f325b50-f9cd-4a85-a7da-485a280609f5.d1a1b8c3-b4d4-4d8c-9e48-9fe294d0fcd1 Sep 28 15:18:36 devstack sudo[109476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:36 devstack sudo[109476]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7be56b83-e52d-4984-adfa-24b64d4a3584 tempest-ProjectReaderTests-1324819150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3f325b50-f9cd-4a85-a7da-485a280609f5.d1a1b8c3-b4d4-4d8c-9e48-9fe294d0fcd1" returned: 0 in 0.418s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7be56b83-e52d-4984-adfa-24b64d4a3584 tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3f325b50-f9cd-4a85-a7da-485a280609f5.d1a1b8c3-b4d4-4d8c-9e48-9fe294d0fcd1 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:36 devstack sudo[109481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3f325b50-f9cd-4a85-a7da-485a280609f5.d1a1b8c3-b4d4-4d8c-9e48-9fe294d0fcd1 Sep 28 15:18:36 devstack sudo[109481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:37 devstack sudo[109481]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7be56b83-e52d-4984-adfa-24b64d4a3584 tempest-ProjectReaderTests-1324819150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3f325b50-f9cd-4a85-a7da-485a280609f5.d1a1b8c3-b4d4-4d8c-9e48-9fe294d0fcd1" returned: 0 in 0.309s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:37 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7be56b83-e52d-4984-adfa-24b64d4a3584 tempest-ProjectReaderTests-1324819150 None] Lock "cinder-quobyte-d1a1b8c3-b4d4-4d8c-9e48-9fe294d0fcd1" released by "_delete_snapshot" :: held 1.677s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:37 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7be56b83-e52d-4984-adfa-24b64d4a3584 tempest-ProjectReaderTests-1324819150 None] Lock "cinder-quobyte-3f325b50-f9cd-4a85-a7da-485a280609f5" released by "delete_snapshot" :: held 1.707s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:37 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-7be56b83-e52d-4984-adfa-24b64d4a3584 tempest-ProjectReaderTests-1324819150 None] Created reservations ['e2dc5c91-0797-4f88-8f62-f5348dea6967', '0d414e4b-e4b0-4f03-ac70-a4f2d08ad7be', 'a37e2696-c144-4892-8d7e-7ff20e38b194', '8778d059-53e5-446b-b6c3-c69442ba387b'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:18:37 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-7be56b83-e52d-4984-adfa-24b64d4a3584 tempest-ProjectReaderTests-1324819150 None] Delete snapshot completed successfully. Sep 28 15:18:37 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7be56b83-e52d-4984-adfa-24b64d4a3584 tempest-ProjectReaderTests-1324819150 None] Lock "cinder-d1a1b8c3-b4d4-4d8c-9e48-9fe294d0fcd1-delete_snapshot" released by "delete_snapshot" :: held 1.876s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:37 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a3fc56c2-bfa0-4719-8beb-afb96d3a463d tempest-ProjectReaderTests-1324819150 None] Acquiring lock "cinder-3f325b50-f9cd-4a85-a7da-485a280609f5-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:37 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a3fc56c2-bfa0-4719-8beb-afb96d3a463d tempest-ProjectReaderTests-1324819150 None] Lock "cinder-3f325b50-f9cd-4a85-a7da-485a280609f5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:37 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a3fc56c2-bfa0-4719-8beb-afb96d3a463d tempest-ProjectReaderTests-1324819150 None] Acquiring lock "cinder-quobyte-3f325b50-f9cd-4a85-a7da-485a280609f5" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:37 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a3fc56c2-bfa0-4719-8beb-afb96d3a463d tempest-ProjectReaderTests-1324819150 None] Lock "cinder-quobyte-3f325b50-f9cd-4a85-a7da-485a280609f5" acquired by "delete_volume" :: waited 0.016s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:37 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[4521c54c-4305-432f-876e-4e376ba76561]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a3fc56c2-bfa0-4719-8beb-afb96d3a463d tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3f325b50-f9cd-4a85-a7da-485a280609f5 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:37 devstack sudo[109484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3f325b50-f9cd-4a85-a7da-485a280609f5 Sep 28 15:18:37 devstack sudo[109484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:38 devstack sudo[109484]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a3fc56c2-bfa0-4719-8beb-afb96d3a463d tempest-ProjectReaderTests-1324819150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3f325b50-f9cd-4a85-a7da-485a280609f5" returned: 0 in 0.407s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a3fc56c2-bfa0-4719-8beb-afb96d3a463d tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3f325b50-f9cd-4a85-a7da-485a280609f5 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:38 devstack sudo[109489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3f325b50-f9cd-4a85-a7da-485a280609f5 Sep 28 15:18:38 devstack sudo[109489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:38 devstack sudo[109489]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a3fc56c2-bfa0-4719-8beb-afb96d3a463d tempest-ProjectReaderTests-1324819150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-3f325b50-f9cd-4a85-a7da-485a280609f5" returned: 0 in 0.297s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a3fc56c2-bfa0-4719-8beb-afb96d3a463d tempest-ProjectReaderTests-1324819150 None] Lock "cinder-quobyte-3f325b50-f9cd-4a85-a7da-485a280609f5" released by "delete_volume" :: held 0.774s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:38 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-a3fc56c2-bfa0-4719-8beb-afb96d3a463d tempest-ProjectReaderTests-1324819150 None] Created reservations ['d703ae1e-8a0b-4ea6-9701-90f67a1374f1', '9a1cd1e6-8240-4a17-978c-7eaf392e9dc5', '97ce0d85-118d-4bb4-9650-d22d329aabbb', 'e72e4b53-b1aa-4607-b01b-447df2cd30d1'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:18:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a3fc56c2-bfa0-4719-8beb-afb96d3a463d tempest-ProjectReaderTests-1324819150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a3fc56c2-bfa0-4719-8beb-afb96d3a463d tempest-ProjectReaderTests-1324819150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:38 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a3fc56c2-bfa0-4719-8beb-afb96d3a463d tempest-ProjectReaderTests-1324819150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:18:38 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a3fc56c2-bfa0-4719-8beb-afb96d3a463d tempest-ProjectReaderTests-1324819150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:18:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a3fc56c2-bfa0-4719-8beb-afb96d3a463d tempest-ProjectReaderTests-1324819150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a3fc56c2-bfa0-4719-8beb-afb96d3a463d tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:38 devstack sudo[109492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:18:38 devstack sudo[109492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:38 devstack sudo[109492]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a3fc56c2-bfa0-4719-8beb-afb96d3a463d tempest-ProjectReaderTests-1324819150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.283s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:38 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-a3fc56c2-bfa0-4719-8beb-afb96d3a463d tempest-ProjectReaderTests-1324819150 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:18:38 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-a3fc56c2-bfa0-4719-8beb-afb96d3a463d tempest-ProjectReaderTests-1324819150 None] Deleted volume successfully. Sep 28 15:18:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a3fc56c2-bfa0-4719-8beb-afb96d3a463d tempest-ProjectReaderTests-1324819150 None] Lock "cinder-3f325b50-f9cd-4a85-a7da-485a280609f5-delete_volume" released by "delete_volume" :: held 1.276s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:39 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-61267236-4590-4175-bd21-1ca93ce34a04 tempest-ProjectReaderTests-1324819150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:18:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-61267236-4590-4175-bd21-1ca93ce34a04 tempest-ProjectReaderTests-1324819150 None] Flow 'volume_create_manager' (e73e3cbb-de5a-4561-a5c6-ef8fa2fb85d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:18:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-61267236-4590-4175-bd21-1ca93ce34a04 tempest-ProjectReaderTests-1324819150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f37085b1-9d20-4b77-8df8-a5511feccf0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-61267236-4590-4175-bd21-1ca93ce34a04 tempest-ProjectReaderTests-1324819150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f37085b1-9d20-4b77-8df8-a5511feccf0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:18:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1343711281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69d061d5-653c-48e2-bcc8-779e4b24718c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='273c7ce63e9f4726b9a7f2413530bab9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:18:39Z,use_quota=True,user_id='ba52a6a8ee5c4884b4752c9851e71d85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-61267236-4590-4175-bd21-1ca93ce34a04 tempest-ProjectReaderTests-1324819150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b59c3b75-c626-49d2-9917-7da7861bab02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-61267236-4590-4175-bd21-1ca93ce34a04 tempest-ProjectReaderTests-1324819150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b59c3b75-c626-49d2-9917-7da7861bab02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-61267236-4590-4175-bd21-1ca93ce34a04 tempest-ProjectReaderTests-1324819150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94d98bd2-79e0-4155-b446-8f51073a7bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-61267236-4590-4175-bd21-1ca93ce34a04 tempest-ProjectReaderTests-1324819150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94d98bd2-79e0-4155-b446-8f51073a7bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69d061d5-653c-48e2-bcc8-779e4b24718c', 'volume_name': 'volume-69d061d5-653c-48e2-bcc8-779e4b24718c', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-61267236-4590-4175-bd21-1ca93ce34a04 tempest-ProjectReaderTests-1324819150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13b8518b-3404-4cb1-86c8-570c2084eef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-61267236-4590-4175-bd21-1ca93ce34a04 tempest-ProjectReaderTests-1324819150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13b8518b-3404-4cb1-86c8-570c2084eef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-61267236-4590-4175-bd21-1ca93ce34a04 tempest-ProjectReaderTests-1324819150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e370eab8-93ed-47cd-b0cb-3170be956564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:39 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-61267236-4590-4175-bd21-1ca93ce34a04 tempest-ProjectReaderTests-1324819150 None] Volume 69d061d5-653c-48e2-bcc8-779e4b24718c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69d061d5-653c-48e2-bcc8-779e4b24718c', 'volume_size': 1} Sep 28 15:18:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-61267236-4590-4175-bd21-1ca93ce34a04 tempest-ProjectReaderTests-1324819150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-61267236-4590-4175-bd21-1ca93ce34a04 tempest-ProjectReaderTests-1324819150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-61267236-4590-4175-bd21-1ca93ce34a04 tempest-ProjectReaderTests-1324819150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:18:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1343711281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69d061d5-653c-48e2-bcc8-779e4b24718c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='273c7ce63e9f4726b9a7f2413530bab9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:18:39Z,use_quota=True,user_id='ba52a6a8ee5c4884b4752c9851e71d85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:18:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-61267236-4590-4175-bd21-1ca93ce34a04 tempest-ProjectReaderTests-1324819150 None] Creating volume 69d061d5-653c-48e2-bcc8-779e4b24718c {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:18:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-61267236-4590-4175-bd21-1ca93ce34a04 tempest-ProjectReaderTests-1324819150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-61267236-4590-4175-bd21-1ca93ce34a04 tempest-ProjectReaderTests-1324819150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-61267236-4590-4175-bd21-1ca93ce34a04 tempest-ProjectReaderTests-1324819150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:18:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-61267236-4590-4175-bd21-1ca93ce34a04 tempest-ProjectReaderTests-1324819150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:18:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-61267236-4590-4175-bd21-1ca93ce34a04 tempest-ProjectReaderTests-1324819150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-61267236-4590-4175-bd21-1ca93ce34a04 tempest-ProjectReaderTests-1324819150 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:18:39 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-61267236-4590-4175-bd21-1ca93ce34a04 tempest-ProjectReaderTests-1324819150 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:18:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-61267236-4590-4175-bd21-1ca93ce34a04 tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-69d061d5-653c-48e2-bcc8-779e4b24718c 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:39 devstack sudo[109495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-69d061d5-653c-48e2-bcc8-779e4b24718c 1073741824 Sep 28 15:18:39 devstack sudo[109495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:40 devstack sudo[109495]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-61267236-4590-4175-bd21-1ca93ce34a04 tempest-ProjectReaderTests-1324819150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-69d061d5-653c-48e2-bcc8-779e4b24718c 1073741824" returned: 0 in 0.490s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-61267236-4590-4175-bd21-1ca93ce34a04 tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-69d061d5-653c-48e2-bcc8-779e4b24718c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:40 devstack sudo[109502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-69d061d5-653c-48e2-bcc8-779e4b24718c Sep 28 15:18:40 devstack sudo[109502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:40 devstack sudo[109502]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-61267236-4590-4175-bd21-1ca93ce34a04 tempest-ProjectReaderTests-1324819150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-69d061d5-653c-48e2-bcc8-779e4b24718c" returned: 0 in 0.330s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:40 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-61267236-4590-4175-bd21-1ca93ce34a04 tempest-ProjectReaderTests-1324819150 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:18:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-61267236-4590-4175-bd21-1ca93ce34a04 tempest-ProjectReaderTests-1324819150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-61267236-4590-4175-bd21-1ca93ce34a04 tempest-ProjectReaderTests-1324819150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e370eab8-93ed-47cd-b0cb-3170be956564) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69d061d5-653c-48e2-bcc8-779e4b24718c', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-61267236-4590-4175-bd21-1ca93ce34a04 tempest-ProjectReaderTests-1324819150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3242a53-f144-475b-9715-c7e206e1b12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:40 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-61267236-4590-4175-bd21-1ca93ce34a04 tempest-ProjectReaderTests-1324819150 None] Volume volume-69d061d5-653c-48e2-bcc8-779e4b24718c (69d061d5-653c-48e2-bcc8-779e4b24718c): created successfully Sep 28 15:18:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-61267236-4590-4175-bd21-1ca93ce34a04 tempest-ProjectReaderTests-1324819150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3242a53-f144-475b-9715-c7e206e1b12b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-61267236-4590-4175-bd21-1ca93ce34a04 tempest-ProjectReaderTests-1324819150 None] Flow 'volume_create_manager' (e73e3cbb-de5a-4561-a5c6-ef8fa2fb85d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:18:40 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-61267236-4590-4175-bd21-1ca93ce34a04 tempest-ProjectReaderTests-1324819150 None] Created volume successfully. Sep 28 15:18:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-fb5c491a-ad49-4310-9b00-4afaa7d9c1bf tempest-ProjectReaderTests-1324819150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-fb5c491a-ad49-4310-9b00-4afaa7d9c1bf tempest-ProjectReaderTests-1324819150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:41 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-fb5c491a-ad49-4310-9b00-4afaa7d9c1bf tempest-ProjectReaderTests-1324819150 None] Creating offline snapshot 24e526d4-109c-4b61-bd3d-6f00f7c24a50 of volume 69d061d5-653c-48e2-bcc8-779e4b24718c {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:18:41 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7fa86e-31d0-4140-ae4e-f798bf3966d5]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fb5c491a-ad49-4310-9b00-4afaa7d9c1bf tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-69d061d5-653c-48e2-bcc8-779e4b24718c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:41 devstack sudo[109506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-69d061d5-653c-48e2-bcc8-779e4b24718c Sep 28 15:18:41 devstack sudo[109506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:42 devstack sudo[109506]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fb5c491a-ad49-4310-9b00-4afaa7d9c1bf tempest-ProjectReaderTests-1324819150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-69d061d5-653c-48e2-bcc8-779e4b24718c" returned: 0 in 0.401s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fb5c491a-ad49-4310-9b00-4afaa7d9c1bf tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-69d061d5-653c-48e2-bcc8-779e4b24718c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-69d061d5-653c-48e2-bcc8-779e4b24718c.24e526d4-109c-4b61-bd3d-6f00f7c24a50 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:42 devstack sudo[109511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-69d061d5-653c-48e2-bcc8-779e4b24718c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-69d061d5-653c-48e2-bcc8-779e4b24718c.24e526d4-109c-4b61-bd3d-6f00f7c24a50 1G Sep 28 15:18:42 devstack sudo[109511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:42 devstack sudo[109511]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fb5c491a-ad49-4310-9b00-4afaa7d9c1bf tempest-ProjectReaderTests-1324819150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-69d061d5-653c-48e2-bcc8-779e4b24718c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-69d061d5-653c-48e2-bcc8-779e4b24718c.24e526d4-109c-4b61-bd3d-6f00f7c24a50 1G" returned: 0 in 0.428s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fb5c491a-ad49-4310-9b00-4afaa7d9c1bf tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69d061d5-653c-48e2-bcc8-779e4b24718c -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-69d061d5-653c-48e2-bcc8-779e4b24718c.24e526d4-109c-4b61-bd3d-6f00f7c24a50 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:42 devstack sudo[109516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69d061d5-653c-48e2-bcc8-779e4b24718c -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-69d061d5-653c-48e2-bcc8-779e4b24718c.24e526d4-109c-4b61-bd3d-6f00f7c24a50 Sep 28 15:18:42 devstack sudo[109516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:42 devstack sudo[109516]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fb5c491a-ad49-4310-9b00-4afaa7d9c1bf tempest-ProjectReaderTests-1324819150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69d061d5-653c-48e2-bcc8-779e4b24718c -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-69d061d5-653c-48e2-bcc8-779e4b24718c.24e526d4-109c-4b61-bd3d-6f00f7c24a50" returned: 0 in 0.329s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:42 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-fb5c491a-ad49-4310-9b00-4afaa7d9c1bf tempest-ProjectReaderTests-1324819150 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-69d061d5-653c-48e2-bcc8-779e4b24718c.24e526d4-109c-4b61-bd3d-6f00f7c24a50 is being set with open permissions: ugo+rw Sep 28 15:18:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fb5c491a-ad49-4310-9b00-4afaa7d9c1bf tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-69d061d5-653c-48e2-bcc8-779e4b24718c.24e526d4-109c-4b61-bd3d-6f00f7c24a50 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:42 devstack sudo[109521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-69d061d5-653c-48e2-bcc8-779e4b24718c.24e526d4-109c-4b61-bd3d-6f00f7c24a50 Sep 28 15:18:42 devstack sudo[109521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:43 devstack sudo[109521]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fb5c491a-ad49-4310-9b00-4afaa7d9c1bf tempest-ProjectReaderTests-1324819150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-69d061d5-653c-48e2-bcc8-779e4b24718c.24e526d4-109c-4b61-bd3d-6f00f7c24a50" returned: 0 in 0.264s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fb5c491a-ad49-4310-9b00-4afaa7d9c1bf tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-69d061d5-653c-48e2-bcc8-779e4b24718c.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:43 devstack sudo[109524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-69d061d5-653c-48e2-bcc8-779e4b24718c.info Sep 28 15:18:43 devstack sudo[109524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:43 devstack sudo[109524]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fb5c491a-ad49-4310-9b00-4afaa7d9c1bf tempest-ProjectReaderTests-1324819150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-69d061d5-653c-48e2-bcc8-779e4b24718c.info" returned: 0 in 0.318s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:43 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-fb5c491a-ad49-4310-9b00-4afaa7d9c1bf tempest-ProjectReaderTests-1324819150 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-69d061d5-653c-48e2-bcc8-779e4b24718c.info is being set with open permissions: ugo+rw Sep 28 15:18:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fb5c491a-ad49-4310-9b00-4afaa7d9c1bf tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-69d061d5-653c-48e2-bcc8-779e4b24718c.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:43 devstack sudo[109527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-69d061d5-653c-48e2-bcc8-779e4b24718c.info Sep 28 15:18:43 devstack sudo[109527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:43 devstack sudo[109527]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fb5c491a-ad49-4310-9b00-4afaa7d9c1bf tempest-ProjectReaderTests-1324819150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-69d061d5-653c-48e2-bcc8-779e4b24718c.info" returned: 0 in 0.291s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-fb5c491a-ad49-4310-9b00-4afaa7d9c1bf tempest-ProjectReaderTests-1324819150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.125s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:43 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-fb5c491a-ad49-4310-9b00-4afaa7d9c1bf tempest-ProjectReaderTests-1324819150 None] Create snapshot completed successfully Sep 28 15:18:44 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-269c312e-01fc-4ca9-8ea8-89a7c53927d5 tempest-ProjectReaderTests-1324819150 None] Acquiring lock "cinder-24e526d4-109c-4b61-bd3d-6f00f7c24a50-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:44 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-269c312e-01fc-4ca9-8ea8-89a7c53927d5 tempest-ProjectReaderTests-1324819150 None] Lock "cinder-24e526d4-109c-4b61-bd3d-6f00f7c24a50-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:44 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-269c312e-01fc-4ca9-8ea8-89a7c53927d5 tempest-ProjectReaderTests-1324819150 None] Acquiring lock "cinder-quobyte-69d061d5-653c-48e2-bcc8-779e4b24718c" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:44 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-269c312e-01fc-4ca9-8ea8-89a7c53927d5 tempest-ProjectReaderTests-1324819150 None] Lock "cinder-quobyte-69d061d5-653c-48e2-bcc8-779e4b24718c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:44 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-269c312e-01fc-4ca9-8ea8-89a7c53927d5 tempest-ProjectReaderTests-1324819150 None] Acquiring lock "cinder-quobyte-24e526d4-109c-4b61-bd3d-6f00f7c24a50" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:44 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-269c312e-01fc-4ca9-8ea8-89a7c53927d5 tempest-ProjectReaderTests-1324819150 None] Lock "cinder-quobyte-24e526d4-109c-4b61-bd3d-6f00f7c24a50" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:44 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-269c312e-01fc-4ca9-8ea8-89a7c53927d5 tempest-ProjectReaderTests-1324819150 None] Deleting offline snapshot 24e526d4-109c-4b61-bd3d-6f00f7c24a50 of volume 69d061d5-653c-48e2-bcc8-779e4b24718c {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:18:44 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-269c312e-01fc-4ca9-8ea8-89a7c53927d5 tempest-ProjectReaderTests-1324819150 None] snapshot_file for this snap is: volume-69d061d5-653c-48e2-bcc8-779e4b24718c.24e526d4-109c-4b61-bd3d-6f00f7c24a50 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:18:44 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8962d47-abff-44da-a763-edff428b5751]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-269c312e-01fc-4ca9-8ea8-89a7c53927d5 tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-69d061d5-653c-48e2-bcc8-779e4b24718c.24e526d4-109c-4b61-bd3d-6f00f7c24a50 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:45 devstack sudo[109568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-69d061d5-653c-48e2-bcc8-779e4b24718c.24e526d4-109c-4b61-bd3d-6f00f7c24a50 Sep 28 15:18:45 devstack sudo[109568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:45 devstack sudo[109568]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-269c312e-01fc-4ca9-8ea8-89a7c53927d5 tempest-ProjectReaderTests-1324819150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-69d061d5-653c-48e2-bcc8-779e4b24718c.24e526d4-109c-4b61-bd3d-6f00f7c24a50" returned: 0 in 0.395s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:45 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-269c312e-01fc-4ca9-8ea8-89a7c53927d5 tempest-ProjectReaderTests-1324819150 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69d061d5-653c-48e2-bcc8-779e4b24718c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:18:45 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c55ba9-86b8-4f03-8a7f-6dc79b759639]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-269c312e-01fc-4ca9-8ea8-89a7c53927d5 tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-69d061d5-653c-48e2-bcc8-779e4b24718c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:45 devstack sudo[109573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-69d061d5-653c-48e2-bcc8-779e4b24718c Sep 28 15:18:45 devstack sudo[109573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:45 devstack sudo[109573]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-269c312e-01fc-4ca9-8ea8-89a7c53927d5 tempest-ProjectReaderTests-1324819150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-69d061d5-653c-48e2-bcc8-779e4b24718c" returned: 0 in 0.404s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-269c312e-01fc-4ca9-8ea8-89a7c53927d5 tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-69d061d5-653c-48e2-bcc8-779e4b24718c.24e526d4-109c-4b61-bd3d-6f00f7c24a50 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:45 devstack sudo[109579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-69d061d5-653c-48e2-bcc8-779e4b24718c.24e526d4-109c-4b61-bd3d-6f00f7c24a50 Sep 28 15:18:45 devstack sudo[109579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:46 devstack sudo[109579]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-269c312e-01fc-4ca9-8ea8-89a7c53927d5 tempest-ProjectReaderTests-1324819150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-69d061d5-653c-48e2-bcc8-779e4b24718c.24e526d4-109c-4b61-bd3d-6f00f7c24a50" returned: 0 in 0.362s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-269c312e-01fc-4ca9-8ea8-89a7c53927d5 tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-69d061d5-653c-48e2-bcc8-779e4b24718c.24e526d4-109c-4b61-bd3d-6f00f7c24a50 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:46 devstack sudo[109584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-69d061d5-653c-48e2-bcc8-779e4b24718c.24e526d4-109c-4b61-bd3d-6f00f7c24a50 Sep 28 15:18:46 devstack sudo[109584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:46 devstack sudo[109584]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-269c312e-01fc-4ca9-8ea8-89a7c53927d5 tempest-ProjectReaderTests-1324819150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-69d061d5-653c-48e2-bcc8-779e4b24718c.24e526d4-109c-4b61-bd3d-6f00f7c24a50" returned: 0 in 0.271s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-269c312e-01fc-4ca9-8ea8-89a7c53927d5 tempest-ProjectReaderTests-1324819150 None] Lock "cinder-quobyte-24e526d4-109c-4b61-bd3d-6f00f7c24a50" released by "_delete_snapshot" :: held 1.544s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-269c312e-01fc-4ca9-8ea8-89a7c53927d5 tempest-ProjectReaderTests-1324819150 None] Lock "cinder-quobyte-69d061d5-653c-48e2-bcc8-779e4b24718c" released by "delete_snapshot" :: held 1.573s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:46 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=106,cinder:INSERT=33,cinder:UPDATE=129,cinder:DELETE=12 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:18:46 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-269c312e-01fc-4ca9-8ea8-89a7c53927d5 tempest-ProjectReaderTests-1324819150 None] Created reservations ['ccd2e150-1f48-455e-8d17-5e6bdd2f9231', 'ad1768e2-bf18-4788-b158-0423dc36b20f', '53e5afef-9ac5-4b17-843e-85d7c6eb2f8c', 'c7bdced1-bbfb-41e5-9d3c-1cdc437998c7'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:18:46 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-269c312e-01fc-4ca9-8ea8-89a7c53927d5 tempest-ProjectReaderTests-1324819150 None] Delete snapshot completed successfully. Sep 28 15:18:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-269c312e-01fc-4ca9-8ea8-89a7c53927d5 tempest-ProjectReaderTests-1324819150 None] Lock "cinder-24e526d4-109c-4b61-bd3d-6f00f7c24a50-delete_snapshot" released by "delete_snapshot" :: held 1.736s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:47 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-53efa9c4-6402-4195-8104-b1e4c6ab9182 tempest-ProjectReaderTests-1324819150 None] Acquiring lock "cinder-69d061d5-653c-48e2-bcc8-779e4b24718c-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:47 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-53efa9c4-6402-4195-8104-b1e4c6ab9182 tempest-ProjectReaderTests-1324819150 None] Lock "cinder-69d061d5-653c-48e2-bcc8-779e4b24718c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:47 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-53efa9c4-6402-4195-8104-b1e4c6ab9182 tempest-ProjectReaderTests-1324819150 None] Acquiring lock "cinder-quobyte-69d061d5-653c-48e2-bcc8-779e4b24718c" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:47 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-53efa9c4-6402-4195-8104-b1e4c6ab9182 tempest-ProjectReaderTests-1324819150 None] Lock "cinder-quobyte-69d061d5-653c-48e2-bcc8-779e4b24718c" acquired by "delete_volume" :: waited 0.018s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:47 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb669bc0-410c-44ba-b5e8-d2384b5c4e03]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-53efa9c4-6402-4195-8104-b1e4c6ab9182 tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-69d061d5-653c-48e2-bcc8-779e4b24718c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:47 devstack sudo[109587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-69d061d5-653c-48e2-bcc8-779e4b24718c Sep 28 15:18:47 devstack sudo[109587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:47 devstack sudo[109587]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-53efa9c4-6402-4195-8104-b1e4c6ab9182 tempest-ProjectReaderTests-1324819150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-69d061d5-653c-48e2-bcc8-779e4b24718c" returned: 0 in 0.374s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-53efa9c4-6402-4195-8104-b1e4c6ab9182 tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-69d061d5-653c-48e2-bcc8-779e4b24718c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:47 devstack sudo[109592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-69d061d5-653c-48e2-bcc8-779e4b24718c Sep 28 15:18:47 devstack sudo[109592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:47 devstack sudo[109592]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-53efa9c4-6402-4195-8104-b1e4c6ab9182 tempest-ProjectReaderTests-1324819150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-69d061d5-653c-48e2-bcc8-779e4b24718c" returned: 0 in 0.275s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:47 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-53efa9c4-6402-4195-8104-b1e4c6ab9182 tempest-ProjectReaderTests-1324819150 None] Lock "cinder-quobyte-69d061d5-653c-48e2-bcc8-779e4b24718c" released by "delete_volume" :: held 0.724s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:47 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-53efa9c4-6402-4195-8104-b1e4c6ab9182 tempest-ProjectReaderTests-1324819150 None] Created reservations ['05e3cc79-1695-4235-8e8f-083e1a896eea', 'd0f72060-3b5c-4d29-b4ee-8a2cf8c21313', '15a560d1-ceeb-4a6b-8489-5827eca46741', 'f4265199-0df6-4615-9323-e928b056fa43'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:18:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-53efa9c4-6402-4195-8104-b1e4c6ab9182 tempest-ProjectReaderTests-1324819150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-53efa9c4-6402-4195-8104-b1e4c6ab9182 tempest-ProjectReaderTests-1324819150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:47 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-53efa9c4-6402-4195-8104-b1e4c6ab9182 tempest-ProjectReaderTests-1324819150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:18:47 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-53efa9c4-6402-4195-8104-b1e4c6ab9182 tempest-ProjectReaderTests-1324819150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:18:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-53efa9c4-6402-4195-8104-b1e4c6ab9182 tempest-ProjectReaderTests-1324819150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-53efa9c4-6402-4195-8104-b1e4c6ab9182 tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:48 devstack sudo[109595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:18:48 devstack sudo[109595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:48 devstack sudo[109595]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-53efa9c4-6402-4195-8104-b1e4c6ab9182 tempest-ProjectReaderTests-1324819150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.254s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:48 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-53efa9c4-6402-4195-8104-b1e4c6ab9182 tempest-ProjectReaderTests-1324819150 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:18:48 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-53efa9c4-6402-4195-8104-b1e4c6ab9182 tempest-ProjectReaderTests-1324819150 None] Deleted volume successfully. Sep 28 15:18:48 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-53efa9c4-6402-4195-8104-b1e4c6ab9182 tempest-ProjectReaderTests-1324819150 None] Lock "cinder-69d061d5-653c-48e2-bcc8-779e4b24718c-delete_volume" released by "delete_volume" :: held 1.188s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:48 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-3df4eb6c-1834-434f-ac0e-c90aa31d0bf9 tempest-ProjectReaderTests-1324819150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:18:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3df4eb6c-1834-434f-ac0e-c90aa31d0bf9 tempest-ProjectReaderTests-1324819150 None] Flow 'volume_create_manager' (625bbadf-6dbc-46ce-b53f-99fe960973a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:18:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3df4eb6c-1834-434f-ac0e-c90aa31d0bf9 tempest-ProjectReaderTests-1324819150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ec17c68-204f-4781-be50-a630d5893445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3df4eb6c-1834-434f-ac0e-c90aa31d0bf9 tempest-ProjectReaderTests-1324819150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ec17c68-204f-4781-be50-a630d5893445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:18:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-103428641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02863f57-67cb-4441-9970-1a1ece78d5eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='273c7ce63e9f4726b9a7f2413530bab9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:18:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:18:49Z,use_quota=True,user_id='ba52a6a8ee5c4884b4752c9851e71d85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3df4eb6c-1834-434f-ac0e-c90aa31d0bf9 tempest-ProjectReaderTests-1324819150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f3a12c8-6a43-4c88-8e07-4ad0f428da45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3df4eb6c-1834-434f-ac0e-c90aa31d0bf9 tempest-ProjectReaderTests-1324819150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f3a12c8-6a43-4c88-8e07-4ad0f428da45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3df4eb6c-1834-434f-ac0e-c90aa31d0bf9 tempest-ProjectReaderTests-1324819150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80936c7d-73db-44fe-b2da-433a5b937bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3df4eb6c-1834-434f-ac0e-c90aa31d0bf9 tempest-ProjectReaderTests-1324819150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80936c7d-73db-44fe-b2da-433a5b937bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02863f57-67cb-4441-9970-1a1ece78d5eb', 'volume_name': 'volume-02863f57-67cb-4441-9970-1a1ece78d5eb', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3df4eb6c-1834-434f-ac0e-c90aa31d0bf9 tempest-ProjectReaderTests-1324819150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf9567d9-4c26-4ae2-9bd8-e60278d528a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3df4eb6c-1834-434f-ac0e-c90aa31d0bf9 tempest-ProjectReaderTests-1324819150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf9567d9-4c26-4ae2-9bd8-e60278d528a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3df4eb6c-1834-434f-ac0e-c90aa31d0bf9 tempest-ProjectReaderTests-1324819150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c631877-4fce-4b3d-98b2-92c9b0516c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:48 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-3df4eb6c-1834-434f-ac0e-c90aa31d0bf9 tempest-ProjectReaderTests-1324819150 None] Volume 02863f57-67cb-4441-9970-1a1ece78d5eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02863f57-67cb-4441-9970-1a1ece78d5eb', 'volume_size': 1} Sep 28 15:18:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3df4eb6c-1834-434f-ac0e-c90aa31d0bf9 tempest-ProjectReaderTests-1324819150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3df4eb6c-1834-434f-ac0e-c90aa31d0bf9 tempest-ProjectReaderTests-1324819150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:48 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3df4eb6c-1834-434f-ac0e-c90aa31d0bf9 tempest-ProjectReaderTests-1324819150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:18:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-103428641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02863f57-67cb-4441-9970-1a1ece78d5eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='273c7ce63e9f4726b9a7f2413530bab9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:18:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:18:49Z,use_quota=True,user_id='ba52a6a8ee5c4884b4752c9851e71d85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:18:48 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-3df4eb6c-1834-434f-ac0e-c90aa31d0bf9 tempest-ProjectReaderTests-1324819150 None] Creating volume 02863f57-67cb-4441-9970-1a1ece78d5eb {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:18:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3df4eb6c-1834-434f-ac0e-c90aa31d0bf9 tempest-ProjectReaderTests-1324819150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3df4eb6c-1834-434f-ac0e-c90aa31d0bf9 tempest-ProjectReaderTests-1324819150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:48 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3df4eb6c-1834-434f-ac0e-c90aa31d0bf9 tempest-ProjectReaderTests-1324819150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:18:48 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3df4eb6c-1834-434f-ac0e-c90aa31d0bf9 tempest-ProjectReaderTests-1324819150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:18:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3df4eb6c-1834-434f-ac0e-c90aa31d0bf9 tempest-ProjectReaderTests-1324819150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:48 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3df4eb6c-1834-434f-ac0e-c90aa31d0bf9 tempest-ProjectReaderTests-1324819150 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:18:48 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-3df4eb6c-1834-434f-ac0e-c90aa31d0bf9 tempest-ProjectReaderTests-1324819150 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:18:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3df4eb6c-1834-434f-ac0e-c90aa31d0bf9 tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-02863f57-67cb-4441-9970-1a1ece78d5eb 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:48 devstack sudo[109598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-02863f57-67cb-4441-9970-1a1ece78d5eb 1073741824 Sep 28 15:18:48 devstack sudo[109598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:49 devstack sudo[109598]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3df4eb6c-1834-434f-ac0e-c90aa31d0bf9 tempest-ProjectReaderTests-1324819150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-02863f57-67cb-4441-9970-1a1ece78d5eb 1073741824" returned: 0 in 0.439s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3df4eb6c-1834-434f-ac0e-c90aa31d0bf9 tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-02863f57-67cb-4441-9970-1a1ece78d5eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:49 devstack sudo[109603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-02863f57-67cb-4441-9970-1a1ece78d5eb Sep 28 15:18:49 devstack sudo[109603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:49 devstack sudo[109603]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3df4eb6c-1834-434f-ac0e-c90aa31d0bf9 tempest-ProjectReaderTests-1324819150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-02863f57-67cb-4441-9970-1a1ece78d5eb" returned: 0 in 0.308s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3df4eb6c-1834-434f-ac0e-c90aa31d0bf9 tempest-ProjectReaderTests-1324819150 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:18:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3df4eb6c-1834-434f-ac0e-c90aa31d0bf9 tempest-ProjectReaderTests-1324819150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3df4eb6c-1834-434f-ac0e-c90aa31d0bf9 tempest-ProjectReaderTests-1324819150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c631877-4fce-4b3d-98b2-92c9b0516c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02863f57-67cb-4441-9970-1a1ece78d5eb', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3df4eb6c-1834-434f-ac0e-c90aa31d0bf9 tempest-ProjectReaderTests-1324819150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d5924a5-1a7e-4ab3-8b96-ce5e7a499348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:49 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-3df4eb6c-1834-434f-ac0e-c90aa31d0bf9 tempest-ProjectReaderTests-1324819150 None] Volume volume-02863f57-67cb-4441-9970-1a1ece78d5eb (02863f57-67cb-4441-9970-1a1ece78d5eb): created successfully Sep 28 15:18:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3df4eb6c-1834-434f-ac0e-c90aa31d0bf9 tempest-ProjectReaderTests-1324819150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d5924a5-1a7e-4ab3-8b96-ce5e7a499348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3df4eb6c-1834-434f-ac0e-c90aa31d0bf9 tempest-ProjectReaderTests-1324819150 None] Flow 'volume_create_manager' (625bbadf-6dbc-46ce-b53f-99fe960973a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:18:49 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-3df4eb6c-1834-434f-ac0e-c90aa31d0bf9 tempest-ProjectReaderTests-1324819150 None] Created volume successfully. Sep 28 15:18:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-93355496-7c30-49c6-8e57-65df815ea2e9 tempest-ProjectReaderTests-1324819150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-93355496-7c30-49c6-8e57-65df815ea2e9 tempest-ProjectReaderTests-1324819150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:51 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-93355496-7c30-49c6-8e57-65df815ea2e9 tempest-ProjectReaderTests-1324819150 None] Creating offline snapshot 2133bc37-99ac-482f-a09f-babb6fd11ead of volume 02863f57-67cb-4441-9970-1a1ece78d5eb {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:18:51 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[111ccaa5-f091-4308-999f-2d4542bb5fd7]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-93355496-7c30-49c6-8e57-65df815ea2e9 tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-02863f57-67cb-4441-9970-1a1ece78d5eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:51 devstack sudo[109606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-02863f57-67cb-4441-9970-1a1ece78d5eb Sep 28 15:18:51 devstack sudo[109606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:51 devstack sudo[109606]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-93355496-7c30-49c6-8e57-65df815ea2e9 tempest-ProjectReaderTests-1324819150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-02863f57-67cb-4441-9970-1a1ece78d5eb" returned: 0 in 0.417s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-93355496-7c30-49c6-8e57-65df815ea2e9 tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-02863f57-67cb-4441-9970-1a1ece78d5eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-02863f57-67cb-4441-9970-1a1ece78d5eb.2133bc37-99ac-482f-a09f-babb6fd11ead 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:51 devstack sudo[109612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-02863f57-67cb-4441-9970-1a1ece78d5eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-02863f57-67cb-4441-9970-1a1ece78d5eb.2133bc37-99ac-482f-a09f-babb6fd11ead 1G Sep 28 15:18:51 devstack sudo[109612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:52 devstack sudo[109612]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-93355496-7c30-49c6-8e57-65df815ea2e9 tempest-ProjectReaderTests-1324819150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-02863f57-67cb-4441-9970-1a1ece78d5eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-02863f57-67cb-4441-9970-1a1ece78d5eb.2133bc37-99ac-482f-a09f-babb6fd11ead 1G" returned: 0 in 0.436s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-93355496-7c30-49c6-8e57-65df815ea2e9 tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02863f57-67cb-4441-9970-1a1ece78d5eb -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-02863f57-67cb-4441-9970-1a1ece78d5eb.2133bc37-99ac-482f-a09f-babb6fd11ead {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:52 devstack sudo[109618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02863f57-67cb-4441-9970-1a1ece78d5eb -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-02863f57-67cb-4441-9970-1a1ece78d5eb.2133bc37-99ac-482f-a09f-babb6fd11ead Sep 28 15:18:52 devstack sudo[109618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:52 devstack sudo[109618]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-93355496-7c30-49c6-8e57-65df815ea2e9 tempest-ProjectReaderTests-1324819150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02863f57-67cb-4441-9970-1a1ece78d5eb -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-02863f57-67cb-4441-9970-1a1ece78d5eb.2133bc37-99ac-482f-a09f-babb6fd11ead" returned: 0 in 0.321s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:52 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-93355496-7c30-49c6-8e57-65df815ea2e9 tempest-ProjectReaderTests-1324819150 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-02863f57-67cb-4441-9970-1a1ece78d5eb.2133bc37-99ac-482f-a09f-babb6fd11ead is being set with open permissions: ugo+rw Sep 28 15:18:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-93355496-7c30-49c6-8e57-65df815ea2e9 tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-02863f57-67cb-4441-9970-1a1ece78d5eb.2133bc37-99ac-482f-a09f-babb6fd11ead {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:52 devstack sudo[109623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-02863f57-67cb-4441-9970-1a1ece78d5eb.2133bc37-99ac-482f-a09f-babb6fd11ead Sep 28 15:18:52 devstack sudo[109623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:52 devstack sudo[109623]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-93355496-7c30-49c6-8e57-65df815ea2e9 tempest-ProjectReaderTests-1324819150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-02863f57-67cb-4441-9970-1a1ece78d5eb.2133bc37-99ac-482f-a09f-babb6fd11ead" returned: 0 in 0.275s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-93355496-7c30-49c6-8e57-65df815ea2e9 tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-02863f57-67cb-4441-9970-1a1ece78d5eb.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:52 devstack sudo[109626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-02863f57-67cb-4441-9970-1a1ece78d5eb.info Sep 28 15:18:52 devstack sudo[109626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:52 devstack sudo[109626]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-93355496-7c30-49c6-8e57-65df815ea2e9 tempest-ProjectReaderTests-1324819150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-02863f57-67cb-4441-9970-1a1ece78d5eb.info" returned: 0 in 0.277s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:52 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-93355496-7c30-49c6-8e57-65df815ea2e9 tempest-ProjectReaderTests-1324819150 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-02863f57-67cb-4441-9970-1a1ece78d5eb.info is being set with open permissions: ugo+rw Sep 28 15:18:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-93355496-7c30-49c6-8e57-65df815ea2e9 tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-02863f57-67cb-4441-9970-1a1ece78d5eb.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:52 devstack sudo[109629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-02863f57-67cb-4441-9970-1a1ece78d5eb.info Sep 28 15:18:52 devstack sudo[109629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:53 devstack sudo[109629]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-93355496-7c30-49c6-8e57-65df815ea2e9 tempest-ProjectReaderTests-1324819150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-02863f57-67cb-4441-9970-1a1ece78d5eb.info" returned: 0 in 0.265s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-93355496-7c30-49c6-8e57-65df815ea2e9 tempest-ProjectReaderTests-1324819150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.089s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:53 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-93355496-7c30-49c6-8e57-65df815ea2e9 tempest-ProjectReaderTests-1324819150 None] Create snapshot completed successfully Sep 28 15:18:54 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fdbe34e8-0e9b-4242-ba53-fafc61ed757d tempest-ProjectReaderTests-1324819150 None] Acquiring lock "cinder-2133bc37-99ac-482f-a09f-babb6fd11ead-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:54 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fdbe34e8-0e9b-4242-ba53-fafc61ed757d tempest-ProjectReaderTests-1324819150 None] Lock "cinder-2133bc37-99ac-482f-a09f-babb6fd11ead-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:54 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fdbe34e8-0e9b-4242-ba53-fafc61ed757d tempest-ProjectReaderTests-1324819150 None] Acquiring lock "cinder-quobyte-02863f57-67cb-4441-9970-1a1ece78d5eb" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:54 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fdbe34e8-0e9b-4242-ba53-fafc61ed757d tempest-ProjectReaderTests-1324819150 None] Lock "cinder-quobyte-02863f57-67cb-4441-9970-1a1ece78d5eb" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:54 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fdbe34e8-0e9b-4242-ba53-fafc61ed757d tempest-ProjectReaderTests-1324819150 None] Acquiring lock "cinder-quobyte-2133bc37-99ac-482f-a09f-babb6fd11ead" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:54 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fdbe34e8-0e9b-4242-ba53-fafc61ed757d tempest-ProjectReaderTests-1324819150 None] Lock "cinder-quobyte-2133bc37-99ac-482f-a09f-babb6fd11ead" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:54 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-fdbe34e8-0e9b-4242-ba53-fafc61ed757d tempest-ProjectReaderTests-1324819150 None] Deleting offline snapshot 2133bc37-99ac-482f-a09f-babb6fd11ead of volume 02863f57-67cb-4441-9970-1a1ece78d5eb {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:18:54 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-fdbe34e8-0e9b-4242-ba53-fafc61ed757d tempest-ProjectReaderTests-1324819150 None] snapshot_file for this snap is: volume-02863f57-67cb-4441-9970-1a1ece78d5eb.2133bc37-99ac-482f-a09f-babb6fd11ead {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:18:54 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97af735-dab9-4d13-8562-467b0a2105b3]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fdbe34e8-0e9b-4242-ba53-fafc61ed757d tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-02863f57-67cb-4441-9970-1a1ece78d5eb.2133bc37-99ac-482f-a09f-babb6fd11ead {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:54 devstack sudo[109632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-02863f57-67cb-4441-9970-1a1ece78d5eb.2133bc37-99ac-482f-a09f-babb6fd11ead Sep 28 15:18:54 devstack sudo[109632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:54 devstack sudo[109632]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fdbe34e8-0e9b-4242-ba53-fafc61ed757d tempest-ProjectReaderTests-1324819150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-02863f57-67cb-4441-9970-1a1ece78d5eb.2133bc37-99ac-482f-a09f-babb6fd11ead" returned: 0 in 0.382s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:54 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-fdbe34e8-0e9b-4242-ba53-fafc61ed757d tempest-ProjectReaderTests-1324819150 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02863f57-67cb-4441-9970-1a1ece78d5eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:18:54 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdbbab26-3c5b-4b44-8252-b550e6b66b0f]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fdbe34e8-0e9b-4242-ba53-fafc61ed757d tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-02863f57-67cb-4441-9970-1a1ece78d5eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:54 devstack sudo[109637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-02863f57-67cb-4441-9970-1a1ece78d5eb Sep 28 15:18:54 devstack sudo[109637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:55 devstack sudo[109637]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fdbe34e8-0e9b-4242-ba53-fafc61ed757d tempest-ProjectReaderTests-1324819150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-02863f57-67cb-4441-9970-1a1ece78d5eb" returned: 0 in 0.397s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fdbe34e8-0e9b-4242-ba53-fafc61ed757d tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-02863f57-67cb-4441-9970-1a1ece78d5eb.2133bc37-99ac-482f-a09f-babb6fd11ead {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:55 devstack sudo[109642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-02863f57-67cb-4441-9970-1a1ece78d5eb.2133bc37-99ac-482f-a09f-babb6fd11ead Sep 28 15:18:55 devstack sudo[109642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:55 devstack sudo[109642]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fdbe34e8-0e9b-4242-ba53-fafc61ed757d tempest-ProjectReaderTests-1324819150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-02863f57-67cb-4441-9970-1a1ece78d5eb.2133bc37-99ac-482f-a09f-babb6fd11ead" returned: 0 in 0.375s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fdbe34e8-0e9b-4242-ba53-fafc61ed757d tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-02863f57-67cb-4441-9970-1a1ece78d5eb.2133bc37-99ac-482f-a09f-babb6fd11ead {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:55 devstack sudo[109647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-02863f57-67cb-4441-9970-1a1ece78d5eb.2133bc37-99ac-482f-a09f-babb6fd11ead Sep 28 15:18:55 devstack sudo[109647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:55 devstack sudo[109647]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fdbe34e8-0e9b-4242-ba53-fafc61ed757d tempest-ProjectReaderTests-1324819150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-02863f57-67cb-4441-9970-1a1ece78d5eb.2133bc37-99ac-482f-a09f-babb6fd11ead" returned: 0 in 0.311s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:55 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fdbe34e8-0e9b-4242-ba53-fafc61ed757d tempest-ProjectReaderTests-1324819150 None] Lock "cinder-quobyte-2133bc37-99ac-482f-a09f-babb6fd11ead" released by "_delete_snapshot" :: held 1.569s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:55 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fdbe34e8-0e9b-4242-ba53-fafc61ed757d tempest-ProjectReaderTests-1324819150 None] Lock "cinder-quobyte-02863f57-67cb-4441-9970-1a1ece78d5eb" released by "delete_snapshot" :: held 1.596s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:56 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-fdbe34e8-0e9b-4242-ba53-fafc61ed757d tempest-ProjectReaderTests-1324819150 None] Created reservations ['f22ef274-3e27-4a9e-afa4-b7d71321774a', '26754cb5-f9ec-4fae-b18b-1c378c231e25', 'ab9d287f-ebfe-4548-9022-a228d80586ac', '960437df-bfc4-462a-94f1-d70e100f9c8e'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:18:56 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-fdbe34e8-0e9b-4242-ba53-fafc61ed757d tempest-ProjectReaderTests-1324819150 None] Delete snapshot completed successfully. Sep 28 15:18:56 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fdbe34e8-0e9b-4242-ba53-fafc61ed757d tempest-ProjectReaderTests-1324819150 None] Lock "cinder-2133bc37-99ac-482f-a09f-babb6fd11ead-delete_snapshot" released by "delete_snapshot" :: held 1.782s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:56 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-05d83413-e234-42ad-8acc-c91483ed81da tempest-ProjectReaderTests-1324819150 None] Acquiring lock "cinder-02863f57-67cb-4441-9970-1a1ece78d5eb-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:56 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-05d83413-e234-42ad-8acc-c91483ed81da tempest-ProjectReaderTests-1324819150 None] Lock "cinder-02863f57-67cb-4441-9970-1a1ece78d5eb-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:56 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-05d83413-e234-42ad-8acc-c91483ed81da tempest-ProjectReaderTests-1324819150 None] Acquiring lock "cinder-quobyte-02863f57-67cb-4441-9970-1a1ece78d5eb" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:56 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-05d83413-e234-42ad-8acc-c91483ed81da tempest-ProjectReaderTests-1324819150 None] Lock "cinder-quobyte-02863f57-67cb-4441-9970-1a1ece78d5eb" acquired by "delete_volume" :: waited 0.018s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:56 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[152ae9fb-ec4b-407d-a4dd-9f39f2737068]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-05d83413-e234-42ad-8acc-c91483ed81da tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-02863f57-67cb-4441-9970-1a1ece78d5eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:56 devstack sudo[109650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-02863f57-67cb-4441-9970-1a1ece78d5eb Sep 28 15:18:56 devstack sudo[109650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:57 devstack sudo[109650]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-05d83413-e234-42ad-8acc-c91483ed81da tempest-ProjectReaderTests-1324819150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-02863f57-67cb-4441-9970-1a1ece78d5eb" returned: 0 in 0.424s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-05d83413-e234-42ad-8acc-c91483ed81da tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-02863f57-67cb-4441-9970-1a1ece78d5eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:57 devstack sudo[109655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-02863f57-67cb-4441-9970-1a1ece78d5eb Sep 28 15:18:57 devstack sudo[109655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:57 devstack sudo[109655]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-05d83413-e234-42ad-8acc-c91483ed81da tempest-ProjectReaderTests-1324819150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-02863f57-67cb-4441-9970-1a1ece78d5eb" returned: 0 in 0.270s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:57 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-05d83413-e234-42ad-8acc-c91483ed81da tempest-ProjectReaderTests-1324819150 None] Lock "cinder-quobyte-02863f57-67cb-4441-9970-1a1ece78d5eb" released by "delete_volume" :: held 0.774s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:57 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-05d83413-e234-42ad-8acc-c91483ed81da tempest-ProjectReaderTests-1324819150 None] Created reservations ['8013ac4f-fe83-4052-9bfc-8e3fc34e6f7e', '3a2c9cce-109c-40f9-b708-fcd35c36f19c', '059d215e-d2c5-48ab-9be0-48f60cca71ca', '1765e4ac-9957-44e2-bbae-709a6198ef25'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:18:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-05d83413-e234-42ad-8acc-c91483ed81da tempest-ProjectReaderTests-1324819150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-05d83413-e234-42ad-8acc-c91483ed81da tempest-ProjectReaderTests-1324819150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-05d83413-e234-42ad-8acc-c91483ed81da tempest-ProjectReaderTests-1324819150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:18:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-05d83413-e234-42ad-8acc-c91483ed81da tempest-ProjectReaderTests-1324819150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:18:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-05d83413-e234-42ad-8acc-c91483ed81da tempest-ProjectReaderTests-1324819150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-05d83413-e234-42ad-8acc-c91483ed81da tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:57 devstack sudo[109659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:18:57 devstack sudo[109659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:57 devstack sudo[109659]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-05d83413-e234-42ad-8acc-c91483ed81da tempest-ProjectReaderTests-1324819150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.282s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:57 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-05d83413-e234-42ad-8acc-c91483ed81da tempest-ProjectReaderTests-1324819150 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:18:57 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-05d83413-e234-42ad-8acc-c91483ed81da tempest-ProjectReaderTests-1324819150 None] Deleted volume successfully. Sep 28 15:18:57 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-05d83413-e234-42ad-8acc-c91483ed81da tempest-ProjectReaderTests-1324819150 None] Lock "cinder-02863f57-67cb-4441-9970-1a1ece78d5eb-delete_volume" released by "delete_volume" :: held 1.284s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:58 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-b867bd68-bfb9-4f30-a985-f9c278b103e1 tempest-ProjectReaderTests-1324819150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:18:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b867bd68-bfb9-4f30-a985-f9c278b103e1 tempest-ProjectReaderTests-1324819150 None] Flow 'volume_create_manager' (b8a614d9-adcf-433d-b27d-defa99f278e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:18:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b867bd68-bfb9-4f30-a985-f9c278b103e1 tempest-ProjectReaderTests-1324819150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (211d466e-8320-4c39-bae0-b826895ee022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b867bd68-bfb9-4f30-a985-f9c278b103e1 tempest-ProjectReaderTests-1324819150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (211d466e-8320-4c39-bae0-b826895ee022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1846020212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eb9e00e-f411-4225-bb79-030f7be1308d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='273c7ce63e9f4726b9a7f2413530bab9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:18:58Z,use_quota=True,user_id='ba52a6a8ee5c4884b4752c9851e71d85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b867bd68-bfb9-4f30-a985-f9c278b103e1 tempest-ProjectReaderTests-1324819150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3afcb7e3-bb91-4ec1-ab06-87a53b8b44d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b867bd68-bfb9-4f30-a985-f9c278b103e1 tempest-ProjectReaderTests-1324819150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3afcb7e3-bb91-4ec1-ab06-87a53b8b44d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b867bd68-bfb9-4f30-a985-f9c278b103e1 tempest-ProjectReaderTests-1324819150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6371e762-cdde-4ec0-91fe-cd9ac5cd8225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b867bd68-bfb9-4f30-a985-f9c278b103e1 tempest-ProjectReaderTests-1324819150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6371e762-cdde-4ec0-91fe-cd9ac5cd8225) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6eb9e00e-f411-4225-bb79-030f7be1308d', 'volume_name': 'volume-6eb9e00e-f411-4225-bb79-030f7be1308d', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b867bd68-bfb9-4f30-a985-f9c278b103e1 tempest-ProjectReaderTests-1324819150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e2ba7f4-a123-486a-9748-d172b60cd938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b867bd68-bfb9-4f30-a985-f9c278b103e1 tempest-ProjectReaderTests-1324819150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e2ba7f4-a123-486a-9748-d172b60cd938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b867bd68-bfb9-4f30-a985-f9c278b103e1 tempest-ProjectReaderTests-1324819150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff9c9f6b-beeb-42f1-bb55-e2f7ddcd8862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:58 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-b867bd68-bfb9-4f30-a985-f9c278b103e1 tempest-ProjectReaderTests-1324819150 None] Volume 6eb9e00e-f411-4225-bb79-030f7be1308d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6eb9e00e-f411-4225-bb79-030f7be1308d', 'volume_size': 1} Sep 28 15:18:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b867bd68-bfb9-4f30-a985-f9c278b103e1 tempest-ProjectReaderTests-1324819150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b867bd68-bfb9-4f30-a985-f9c278b103e1 tempest-ProjectReaderTests-1324819150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b867bd68-bfb9-4f30-a985-f9c278b103e1 tempest-ProjectReaderTests-1324819150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1846020212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eb9e00e-f411-4225-bb79-030f7be1308d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='273c7ce63e9f4726b9a7f2413530bab9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:18:58Z,use_quota=True,user_id='ba52a6a8ee5c4884b4752c9851e71d85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:18:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-b867bd68-bfb9-4f30-a985-f9c278b103e1 tempest-ProjectReaderTests-1324819150 None] Creating volume 6eb9e00e-f411-4225-bb79-030f7be1308d {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:18:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b867bd68-bfb9-4f30-a985-f9c278b103e1 tempest-ProjectReaderTests-1324819150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b867bd68-bfb9-4f30-a985-f9c278b103e1 tempest-ProjectReaderTests-1324819150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b867bd68-bfb9-4f30-a985-f9c278b103e1 tempest-ProjectReaderTests-1324819150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:18:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b867bd68-bfb9-4f30-a985-f9c278b103e1 tempest-ProjectReaderTests-1324819150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:18:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b867bd68-bfb9-4f30-a985-f9c278b103e1 tempest-ProjectReaderTests-1324819150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b867bd68-bfb9-4f30-a985-f9c278b103e1 tempest-ProjectReaderTests-1324819150 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:18:58 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-b867bd68-bfb9-4f30-a985-f9c278b103e1 tempest-ProjectReaderTests-1324819150 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:18:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b867bd68-bfb9-4f30-a985-f9c278b103e1 tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6eb9e00e-f411-4225-bb79-030f7be1308d 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:58 devstack sudo[109662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6eb9e00e-f411-4225-bb79-030f7be1308d 1073741824 Sep 28 15:18:58 devstack sudo[109662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:58 devstack sudo[109662]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b867bd68-bfb9-4f30-a985-f9c278b103e1 tempest-ProjectReaderTests-1324819150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6eb9e00e-f411-4225-bb79-030f7be1308d 1073741824" returned: 0 in 0.465s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b867bd68-bfb9-4f30-a985-f9c278b103e1 tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6eb9e00e-f411-4225-bb79-030f7be1308d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:58 devstack sudo[109667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6eb9e00e-f411-4225-bb79-030f7be1308d Sep 28 15:18:58 devstack sudo[109667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:58 devstack sudo[109667]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b867bd68-bfb9-4f30-a985-f9c278b103e1 tempest-ProjectReaderTests-1324819150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6eb9e00e-f411-4225-bb79-030f7be1308d" returned: 0 in 0.249s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b867bd68-bfb9-4f30-a985-f9c278b103e1 tempest-ProjectReaderTests-1324819150 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:18:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b867bd68-bfb9-4f30-a985-f9c278b103e1 tempest-ProjectReaderTests-1324819150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b867bd68-bfb9-4f30-a985-f9c278b103e1 tempest-ProjectReaderTests-1324819150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff9c9f6b-beeb-42f1-bb55-e2f7ddcd8862) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6eb9e00e-f411-4225-bb79-030f7be1308d', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b867bd68-bfb9-4f30-a985-f9c278b103e1 tempest-ProjectReaderTests-1324819150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d76e9893-b034-4806-bc93-0fe46b51ecd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:59 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-b867bd68-bfb9-4f30-a985-f9c278b103e1 tempest-ProjectReaderTests-1324819150 None] Volume volume-6eb9e00e-f411-4225-bb79-030f7be1308d (6eb9e00e-f411-4225-bb79-030f7be1308d): created successfully Sep 28 15:18:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b867bd68-bfb9-4f30-a985-f9c278b103e1 tempest-ProjectReaderTests-1324819150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d76e9893-b034-4806-bc93-0fe46b51ecd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b867bd68-bfb9-4f30-a985-f9c278b103e1 tempest-ProjectReaderTests-1324819150 None] Flow 'volume_create_manager' (b8a614d9-adcf-433d-b27d-defa99f278e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:18:59 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-b867bd68-bfb9-4f30-a985-f9c278b103e1 tempest-ProjectReaderTests-1324819150 None] Created volume successfully. Sep 28 15:19:00 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:UPDATE=128,cinder:SELECT=94,cinder:INSERT=39,cinder:DELETE=11 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:19:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dabe69e2-68c9-44cf-9b16-861a8d93403e tempest-ProjectReaderTests-1324819150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:19:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dabe69e2-68c9-44cf-9b16-861a8d93403e tempest-ProjectReaderTests-1324819150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:19:00 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-dabe69e2-68c9-44cf-9b16-861a8d93403e tempest-ProjectReaderTests-1324819150 None] Creating offline snapshot 9bcc7641-746e-42f0-89dc-3d0dccae6485 of volume 6eb9e00e-f411-4225-bb79-030f7be1308d {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:19:00 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[2174fb09-d7ab-4c67-8083-c5ac1e402e64]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:19:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dabe69e2-68c9-44cf-9b16-861a8d93403e tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6eb9e00e-f411-4225-bb79-030f7be1308d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:00 devstack sudo[109670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6eb9e00e-f411-4225-bb79-030f7be1308d Sep 28 15:19:00 devstack sudo[109670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:00 devstack sudo[109670]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dabe69e2-68c9-44cf-9b16-861a8d93403e tempest-ProjectReaderTests-1324819150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6eb9e00e-f411-4225-bb79-030f7be1308d" returned: 0 in 0.452s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dabe69e2-68c9-44cf-9b16-861a8d93403e tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6eb9e00e-f411-4225-bb79-030f7be1308d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6eb9e00e-f411-4225-bb79-030f7be1308d.9bcc7641-746e-42f0-89dc-3d0dccae6485 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:00 devstack sudo[109675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6eb9e00e-f411-4225-bb79-030f7be1308d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6eb9e00e-f411-4225-bb79-030f7be1308d.9bcc7641-746e-42f0-89dc-3d0dccae6485 1G Sep 28 15:19:00 devstack sudo[109675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:01 devstack sudo[109675]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dabe69e2-68c9-44cf-9b16-861a8d93403e tempest-ProjectReaderTests-1324819150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6eb9e00e-f411-4225-bb79-030f7be1308d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6eb9e00e-f411-4225-bb79-030f7be1308d.9bcc7641-746e-42f0-89dc-3d0dccae6485 1G" returned: 0 in 0.475s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dabe69e2-68c9-44cf-9b16-861a8d93403e tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6eb9e00e-f411-4225-bb79-030f7be1308d -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6eb9e00e-f411-4225-bb79-030f7be1308d.9bcc7641-746e-42f0-89dc-3d0dccae6485 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:01 devstack sudo[109680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6eb9e00e-f411-4225-bb79-030f7be1308d -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6eb9e00e-f411-4225-bb79-030f7be1308d.9bcc7641-746e-42f0-89dc-3d0dccae6485 Sep 28 15:19:01 devstack sudo[109680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:01 devstack sudo[109680]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dabe69e2-68c9-44cf-9b16-861a8d93403e tempest-ProjectReaderTests-1324819150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6eb9e00e-f411-4225-bb79-030f7be1308d -F qcow2 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6eb9e00e-f411-4225-bb79-030f7be1308d.9bcc7641-746e-42f0-89dc-3d0dccae6485" returned: 0 in 0.329s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:01 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-dabe69e2-68c9-44cf-9b16-861a8d93403e tempest-ProjectReaderTests-1324819150 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6eb9e00e-f411-4225-bb79-030f7be1308d.9bcc7641-746e-42f0-89dc-3d0dccae6485 is being set with open permissions: ugo+rw Sep 28 15:19:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dabe69e2-68c9-44cf-9b16-861a8d93403e tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6eb9e00e-f411-4225-bb79-030f7be1308d.9bcc7641-746e-42f0-89dc-3d0dccae6485 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:01 devstack sudo[109686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6eb9e00e-f411-4225-bb79-030f7be1308d.9bcc7641-746e-42f0-89dc-3d0dccae6485 Sep 28 15:19:01 devstack sudo[109686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:01 devstack sudo[109686]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dabe69e2-68c9-44cf-9b16-861a8d93403e tempest-ProjectReaderTests-1324819150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6eb9e00e-f411-4225-bb79-030f7be1308d.9bcc7641-746e-42f0-89dc-3d0dccae6485" returned: 0 in 0.263s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dabe69e2-68c9-44cf-9b16-861a8d93403e tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6eb9e00e-f411-4225-bb79-030f7be1308d.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:02 devstack sudo[109689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6eb9e00e-f411-4225-bb79-030f7be1308d.info Sep 28 15:19:02 devstack sudo[109689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:02 devstack sudo[109689]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dabe69e2-68c9-44cf-9b16-861a8d93403e tempest-ProjectReaderTests-1324819150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6eb9e00e-f411-4225-bb79-030f7be1308d.info" returned: 0 in 0.289s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:02 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-dabe69e2-68c9-44cf-9b16-861a8d93403e tempest-ProjectReaderTests-1324819150 None] /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6eb9e00e-f411-4225-bb79-030f7be1308d.info is being set with open permissions: ugo+rw Sep 28 15:19:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dabe69e2-68c9-44cf-9b16-861a8d93403e tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6eb9e00e-f411-4225-bb79-030f7be1308d.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:02 devstack sudo[109692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6eb9e00e-f411-4225-bb79-030f7be1308d.info Sep 28 15:19:02 devstack sudo[109692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:02 devstack sudo[109692]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dabe69e2-68c9-44cf-9b16-861a8d93403e tempest-ProjectReaderTests-1324819150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6eb9e00e-f411-4225-bb79-030f7be1308d.info" returned: 0 in 0.259s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dabe69e2-68c9-44cf-9b16-861a8d93403e tempest-ProjectReaderTests-1324819150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.165s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:02 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-dabe69e2-68c9-44cf-9b16-861a8d93403e tempest-ProjectReaderTests-1324819150 None] Create snapshot completed successfully Sep 28 15:19:03 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-dc7ae267-6b19-466b-83c0-82f42c875335 tempest-ProjectReaderTests-1324819150 None] Acquiring lock "cinder-9bcc7641-746e-42f0-89dc-3d0dccae6485-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:19:03 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-dc7ae267-6b19-466b-83c0-82f42c875335 tempest-ProjectReaderTests-1324819150 None] Lock "cinder-9bcc7641-746e-42f0-89dc-3d0dccae6485-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:19:03 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-dc7ae267-6b19-466b-83c0-82f42c875335 tempest-ProjectReaderTests-1324819150 None] Acquiring lock "cinder-quobyte-6eb9e00e-f411-4225-bb79-030f7be1308d" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:19:03 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-dc7ae267-6b19-466b-83c0-82f42c875335 tempest-ProjectReaderTests-1324819150 None] Lock "cinder-quobyte-6eb9e00e-f411-4225-bb79-030f7be1308d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:19:03 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-dc7ae267-6b19-466b-83c0-82f42c875335 tempest-ProjectReaderTests-1324819150 None] Acquiring lock "cinder-quobyte-9bcc7641-746e-42f0-89dc-3d0dccae6485" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:19:03 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-dc7ae267-6b19-466b-83c0-82f42c875335 tempest-ProjectReaderTests-1324819150 None] Lock "cinder-quobyte-9bcc7641-746e-42f0-89dc-3d0dccae6485" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:19:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-dc7ae267-6b19-466b-83c0-82f42c875335 tempest-ProjectReaderTests-1324819150 None] Deleting offline snapshot 9bcc7641-746e-42f0-89dc-3d0dccae6485 of volume 6eb9e00e-f411-4225-bb79-030f7be1308d {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:19:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-dc7ae267-6b19-466b-83c0-82f42c875335 tempest-ProjectReaderTests-1324819150 None] snapshot_file for this snap is: volume-6eb9e00e-f411-4225-bb79-030f7be1308d.9bcc7641-746e-42f0-89dc-3d0dccae6485 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:19:03 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[42556c39-0484-4396-bb27-7eeb62236dc8]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:19:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dc7ae267-6b19-466b-83c0-82f42c875335 tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6eb9e00e-f411-4225-bb79-030f7be1308d.9bcc7641-746e-42f0-89dc-3d0dccae6485 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:03 devstack sudo[109695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6eb9e00e-f411-4225-bb79-030f7be1308d.9bcc7641-746e-42f0-89dc-3d0dccae6485 Sep 28 15:19:03 devstack sudo[109695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:04 devstack sudo[109695]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dc7ae267-6b19-466b-83c0-82f42c875335 tempest-ProjectReaderTests-1324819150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6eb9e00e-f411-4225-bb79-030f7be1308d.9bcc7641-746e-42f0-89dc-3d0dccae6485" returned: 0 in 0.467s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:04 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-dc7ae267-6b19-466b-83c0-82f42c875335 tempest-ProjectReaderTests-1324819150 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6eb9e00e-f411-4225-bb79-030f7be1308d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:19:04 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c69f0f1-e6d0-4920-b81f-a289b890f406]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:19:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dc7ae267-6b19-466b-83c0-82f42c875335 tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6eb9e00e-f411-4225-bb79-030f7be1308d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:04 devstack sudo[109700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6eb9e00e-f411-4225-bb79-030f7be1308d Sep 28 15:19:04 devstack sudo[109700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:04 devstack sudo[109700]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dc7ae267-6b19-466b-83c0-82f42c875335 tempest-ProjectReaderTests-1324819150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6eb9e00e-f411-4225-bb79-030f7be1308d" returned: 0 in 0.416s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dc7ae267-6b19-466b-83c0-82f42c875335 tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6eb9e00e-f411-4225-bb79-030f7be1308d.9bcc7641-746e-42f0-89dc-3d0dccae6485 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:04 devstack sudo[109705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6eb9e00e-f411-4225-bb79-030f7be1308d.9bcc7641-746e-42f0-89dc-3d0dccae6485 Sep 28 15:19:04 devstack sudo[109705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:04 devstack sudo[109705]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dc7ae267-6b19-466b-83c0-82f42c875335 tempest-ProjectReaderTests-1324819150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6eb9e00e-f411-4225-bb79-030f7be1308d.9bcc7641-746e-42f0-89dc-3d0dccae6485" returned: 0 in 0.354s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dc7ae267-6b19-466b-83c0-82f42c875335 tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6eb9e00e-f411-4225-bb79-030f7be1308d.9bcc7641-746e-42f0-89dc-3d0dccae6485 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:04 devstack sudo[109710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6eb9e00e-f411-4225-bb79-030f7be1308d.9bcc7641-746e-42f0-89dc-3d0dccae6485 Sep 28 15:19:04 devstack sudo[109710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:05 devstack sudo[109710]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dc7ae267-6b19-466b-83c0-82f42c875335 tempest-ProjectReaderTests-1324819150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6eb9e00e-f411-4225-bb79-030f7be1308d.9bcc7641-746e-42f0-89dc-3d0dccae6485" returned: 0 in 0.274s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:05 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-dc7ae267-6b19-466b-83c0-82f42c875335 tempest-ProjectReaderTests-1324819150 None] Lock "cinder-quobyte-9bcc7641-746e-42f0-89dc-3d0dccae6485" released by "_delete_snapshot" :: held 1.626s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:19:05 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-dc7ae267-6b19-466b-83c0-82f42c875335 tempest-ProjectReaderTests-1324819150 None] Lock "cinder-quobyte-6eb9e00e-f411-4225-bb79-030f7be1308d" released by "delete_snapshot" :: held 1.655s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:19:05 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-dc7ae267-6b19-466b-83c0-82f42c875335 tempest-ProjectReaderTests-1324819150 None] Created reservations ['1542334c-1300-404b-9b91-3873e41f7bf2', 'ca1d0bfb-72a4-4117-a352-4a9d2882f06a', '073b0b90-3b94-4be6-b1f1-91ae5e0b6614', '271ad67e-89d7-4b4b-8ed2-5035c9e49873'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:19:05 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-dc7ae267-6b19-466b-83c0-82f42c875335 tempest-ProjectReaderTests-1324819150 None] Delete snapshot completed successfully. Sep 28 15:19:05 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-dc7ae267-6b19-466b-83c0-82f42c875335 tempest-ProjectReaderTests-1324819150 None] Lock "cinder-9bcc7641-746e-42f0-89dc-3d0dccae6485-delete_snapshot" released by "delete_snapshot" :: held 1.822s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:19:05 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-51e199e4-9024-46d7-9bf7-ee616a9abbba tempest-ProjectReaderTests-1324819150 None] Acquiring lock "cinder-6eb9e00e-f411-4225-bb79-030f7be1308d-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:19:05 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-51e199e4-9024-46d7-9bf7-ee616a9abbba tempest-ProjectReaderTests-1324819150 None] Lock "cinder-6eb9e00e-f411-4225-bb79-030f7be1308d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:19:05 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-51e199e4-9024-46d7-9bf7-ee616a9abbba tempest-ProjectReaderTests-1324819150 None] Acquiring lock "cinder-quobyte-6eb9e00e-f411-4225-bb79-030f7be1308d" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:19:05 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-51e199e4-9024-46d7-9bf7-ee616a9abbba tempest-ProjectReaderTests-1324819150 None] Lock "cinder-quobyte-6eb9e00e-f411-4225-bb79-030f7be1308d" acquired by "delete_volume" :: waited 0.018s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:19:05 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b728ef-49e4-4944-bd7e-1e3f590e1982]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:19:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-51e199e4-9024-46d7-9bf7-ee616a9abbba tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6eb9e00e-f411-4225-bb79-030f7be1308d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:06 devstack sudo[109713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6eb9e00e-f411-4225-bb79-030f7be1308d Sep 28 15:19:06 devstack sudo[109713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:06 devstack sudo[109713]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-51e199e4-9024-46d7-9bf7-ee616a9abbba tempest-ProjectReaderTests-1324819150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6eb9e00e-f411-4225-bb79-030f7be1308d" returned: 0 in 0.461s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-51e199e4-9024-46d7-9bf7-ee616a9abbba tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6eb9e00e-f411-4225-bb79-030f7be1308d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:06 devstack sudo[109718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6eb9e00e-f411-4225-bb79-030f7be1308d Sep 28 15:19:06 devstack sudo[109718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:06 devstack sudo[109718]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-51e199e4-9024-46d7-9bf7-ee616a9abbba tempest-ProjectReaderTests-1324819150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-6eb9e00e-f411-4225-bb79-030f7be1308d" returned: 0 in 0.282s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-51e199e4-9024-46d7-9bf7-ee616a9abbba tempest-ProjectReaderTests-1324819150 None] Lock "cinder-quobyte-6eb9e00e-f411-4225-bb79-030f7be1308d" released by "delete_volume" :: held 0.819s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:19:06 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-51e199e4-9024-46d7-9bf7-ee616a9abbba tempest-ProjectReaderTests-1324819150 None] Created reservations ['a34590f1-777b-4563-a4f6-fc5c2dc87446', '8a54d8c7-237c-4e62-aa27-38d5b6737132', 'fb6b72f9-dd03-4ce0-bbbd-f8dfcc23c19a', 'aafbe9ed-1f8a-4715-bfbf-631d824f830c'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:19:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-51e199e4-9024-46d7-9bf7-ee616a9abbba tempest-ProjectReaderTests-1324819150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:19:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-51e199e4-9024-46d7-9bf7-ee616a9abbba tempest-ProjectReaderTests-1324819150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:19:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-51e199e4-9024-46d7-9bf7-ee616a9abbba tempest-ProjectReaderTests-1324819150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:19:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-51e199e4-9024-46d7-9bf7-ee616a9abbba tempest-ProjectReaderTests-1324819150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:19:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-51e199e4-9024-46d7-9bf7-ee616a9abbba tempest-ProjectReaderTests-1324819150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-51e199e4-9024-46d7-9bf7-ee616a9abbba tempest-ProjectReaderTests-1324819150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:06 devstack sudo[109721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:19:06 devstack sudo[109721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:07 devstack sudo[109721]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-51e199e4-9024-46d7-9bf7-ee616a9abbba tempest-ProjectReaderTests-1324819150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.338s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:07 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-51e199e4-9024-46d7-9bf7-ee616a9abbba tempest-ProjectReaderTests-1324819150 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:19:07 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-51e199e4-9024-46d7-9bf7-ee616a9abbba tempest-ProjectReaderTests-1324819150 None] Deleted volume successfully. Sep 28 15:19:07 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-51e199e4-9024-46d7-9bf7-ee616a9abbba tempest-ProjectReaderTests-1324819150 None] Lock "cinder-6eb9e00e-f411-4225-bb79-030f7be1308d-delete_volume" released by "delete_volume" :: held 1.400s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:19:16 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:UPDATE=16,cinder:SELECT=9,cinder:INSERT=4 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:19:17 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:19:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:19:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:19:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:19:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:19:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:17 devstack sudo[109726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:19:17 devstack sudo[109726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:17 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=39,cinder:INSERT=12,cinder:UPDATE=46,cinder:DELETE=3 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:19:17 devstack sudo[109726]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.335s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:17 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:19:17 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] Running periodic task VolumeManager._thread_info {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:19:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] thread count: 28 {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:19:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-216e51e7-e9ec-4e80-a7db-362c260cb850 None None] thread info: [<_MainThread(MainThread, started 135146735652992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:19:24 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f617301-8fd3-442d-bb95-e6daf3f2ef95 tempest-ProjectReaderTests-1365408668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:19:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1f617301-8fd3-442d-bb95-e6daf3f2ef95 tempest-ProjectReaderTests-1365408668 None] Flow 'volume_create_manager' (67e86ac5-eeb5-465e-b900-5a3502606dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:19:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1f617301-8fd3-442d-bb95-e6daf3f2ef95 tempest-ProjectReaderTests-1365408668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b16df02-b4c2-4925-bf9c-02965274ed0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1f617301-8fd3-442d-bb95-e6daf3f2ef95 tempest-ProjectReaderTests-1365408668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b16df02-b4c2-4925-bf9c-02965274ed0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1122457334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2956960-7851-4d8c-abe9-928e4d024cc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f48e06c516934af09b41914c260c6138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:19:25Z,use_quota=True,user_id='eb960f83d6574ee9b18d07632126f4b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1f617301-8fd3-442d-bb95-e6daf3f2ef95 tempest-ProjectReaderTests-1365408668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37fd3e81-7375-45be-bf93-0ea4638ed3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1f617301-8fd3-442d-bb95-e6daf3f2ef95 tempest-ProjectReaderTests-1365408668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37fd3e81-7375-45be-bf93-0ea4638ed3af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1f617301-8fd3-442d-bb95-e6daf3f2ef95 tempest-ProjectReaderTests-1365408668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ae0218a-bd5d-4c18-98a8-277da3e1086e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1f617301-8fd3-442d-bb95-e6daf3f2ef95 tempest-ProjectReaderTests-1365408668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ae0218a-bd5d-4c18-98a8-277da3e1086e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2956960-7851-4d8c-abe9-928e4d024cc5', 'volume_name': 'volume-a2956960-7851-4d8c-abe9-928e4d024cc5', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1f617301-8fd3-442d-bb95-e6daf3f2ef95 tempest-ProjectReaderTests-1365408668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c43b44b8-0a8f-4f22-9538-2f702622f91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1f617301-8fd3-442d-bb95-e6daf3f2ef95 tempest-ProjectReaderTests-1365408668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c43b44b8-0a8f-4f22-9538-2f702622f91a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1f617301-8fd3-442d-bb95-e6daf3f2ef95 tempest-ProjectReaderTests-1365408668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (058bc23d-93de-4351-adc4-e3e9fe314373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:24 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-1f617301-8fd3-442d-bb95-e6daf3f2ef95 tempest-ProjectReaderTests-1365408668 None] Volume a2956960-7851-4d8c-abe9-928e4d024cc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2956960-7851-4d8c-abe9-928e4d024cc5', 'volume_size': 1} Sep 28 15:19:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1f617301-8fd3-442d-bb95-e6daf3f2ef95 tempest-ProjectReaderTests-1365408668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:19:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1f617301-8fd3-442d-bb95-e6daf3f2ef95 tempest-ProjectReaderTests-1365408668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:19:24 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1f617301-8fd3-442d-bb95-e6daf3f2ef95 tempest-ProjectReaderTests-1365408668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1122457334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2956960-7851-4d8c-abe9-928e4d024cc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f48e06c516934af09b41914c260c6138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:19:25Z,use_quota=True,user_id='eb960f83d6574ee9b18d07632126f4b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:19:24 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-1f617301-8fd3-442d-bb95-e6daf3f2ef95 tempest-ProjectReaderTests-1365408668 None] Creating volume a2956960-7851-4d8c-abe9-928e4d024cc5 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:19:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1f617301-8fd3-442d-bb95-e6daf3f2ef95 tempest-ProjectReaderTests-1365408668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:19:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1f617301-8fd3-442d-bb95-e6daf3f2ef95 tempest-ProjectReaderTests-1365408668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:19:24 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1f617301-8fd3-442d-bb95-e6daf3f2ef95 tempest-ProjectReaderTests-1365408668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:19:24 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1f617301-8fd3-442d-bb95-e6daf3f2ef95 tempest-ProjectReaderTests-1365408668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:19:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1f617301-8fd3-442d-bb95-e6daf3f2ef95 tempest-ProjectReaderTests-1365408668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:24 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1f617301-8fd3-442d-bb95-e6daf3f2ef95 tempest-ProjectReaderTests-1365408668 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:19:24 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-1f617301-8fd3-442d-bb95-e6daf3f2ef95 tempest-ProjectReaderTests-1365408668 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:19:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1f617301-8fd3-442d-bb95-e6daf3f2ef95 tempest-ProjectReaderTests-1365408668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a2956960-7851-4d8c-abe9-928e4d024cc5 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:24 devstack sudo[109731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a2956960-7851-4d8c-abe9-928e4d024cc5 1073741824 Sep 28 15:19:24 devstack sudo[109731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:25 devstack sudo[109731]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1f617301-8fd3-442d-bb95-e6daf3f2ef95 tempest-ProjectReaderTests-1365408668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a2956960-7851-4d8c-abe9-928e4d024cc5 1073741824" returned: 0 in 0.426s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1f617301-8fd3-442d-bb95-e6daf3f2ef95 tempest-ProjectReaderTests-1365408668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a2956960-7851-4d8c-abe9-928e4d024cc5 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:25 devstack sudo[109736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a2956960-7851-4d8c-abe9-928e4d024cc5 Sep 28 15:19:25 devstack sudo[109736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:25 devstack sudo[109736]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1f617301-8fd3-442d-bb95-e6daf3f2ef95 tempest-ProjectReaderTests-1365408668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a2956960-7851-4d8c-abe9-928e4d024cc5" returned: 0 in 0.255s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:25 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1f617301-8fd3-442d-bb95-e6daf3f2ef95 tempest-ProjectReaderTests-1365408668 None] <== create_volume: return (726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:19:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1f617301-8fd3-442d-bb95-e6daf3f2ef95 tempest-ProjectReaderTests-1365408668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1f617301-8fd3-442d-bb95-e6daf3f2ef95 tempest-ProjectReaderTests-1365408668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (058bc23d-93de-4351-adc4-e3e9fe314373) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2956960-7851-4d8c-abe9-928e4d024cc5', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1f617301-8fd3-442d-bb95-e6daf3f2ef95 tempest-ProjectReaderTests-1365408668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89c3470e-b19a-433b-87ee-cdb09b02b429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:25 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-1f617301-8fd3-442d-bb95-e6daf3f2ef95 tempest-ProjectReaderTests-1365408668 None] Volume volume-a2956960-7851-4d8c-abe9-928e4d024cc5 (a2956960-7851-4d8c-abe9-928e4d024cc5): created successfully Sep 28 15:19:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1f617301-8fd3-442d-bb95-e6daf3f2ef95 tempest-ProjectReaderTests-1365408668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89c3470e-b19a-433b-87ee-cdb09b02b429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1f617301-8fd3-442d-bb95-e6daf3f2ef95 tempest-ProjectReaderTests-1365408668 None] Flow 'volume_create_manager' (67e86ac5-eeb5-465e-b900-5a3502606dd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:19:25 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-1f617301-8fd3-442d-bb95-e6daf3f2ef95 tempest-ProjectReaderTests-1365408668 None] Created volume successfully. Sep 28 15:19:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fa6641e7-1a91-4813-a531-a6707121017f tempest-ProjectReaderTests-1365408668 None] Acquiring lock "cinder-a2956960-7851-4d8c-abe9-928e4d024cc5-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:19:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fa6641e7-1a91-4813-a531-a6707121017f tempest-ProjectReaderTests-1365408668 None] Lock "cinder-a2956960-7851-4d8c-abe9-928e4d024cc5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:19:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fa6641e7-1a91-4813-a531-a6707121017f tempest-ProjectReaderTests-1365408668 None] Acquiring lock "cinder-quobyte-a2956960-7851-4d8c-abe9-928e4d024cc5" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:19:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fa6641e7-1a91-4813-a531-a6707121017f tempest-ProjectReaderTests-1365408668 None] Lock "cinder-quobyte-a2956960-7851-4d8c-abe9-928e4d024cc5" acquired by "delete_volume" :: waited 0.018s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:19:26 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[349c0c63-62ff-4ab4-b895-8d9b15122c46]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:19:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fa6641e7-1a91-4813-a531-a6707121017f tempest-ProjectReaderTests-1365408668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a2956960-7851-4d8c-abe9-928e4d024cc5 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:26 devstack sudo[109739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a2956960-7851-4d8c-abe9-928e4d024cc5 Sep 28 15:19:26 devstack sudo[109739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:26 devstack sudo[109739]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fa6641e7-1a91-4813-a531-a6707121017f tempest-ProjectReaderTests-1365408668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a2956960-7851-4d8c-abe9-928e4d024cc5" returned: 0 in 0.370s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fa6641e7-1a91-4813-a531-a6707121017f tempest-ProjectReaderTests-1365408668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a2956960-7851-4d8c-abe9-928e4d024cc5 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:26 devstack sudo[109744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a2956960-7851-4d8c-abe9-928e4d024cc5 Sep 28 15:19:26 devstack sudo[109744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:26 devstack sudo[109744]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fa6641e7-1a91-4813-a531-a6707121017f tempest-ProjectReaderTests-1365408668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-a2956960-7851-4d8c-abe9-928e4d024cc5" returned: 0 in 0.253s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fa6641e7-1a91-4813-a531-a6707121017f tempest-ProjectReaderTests-1365408668 None] Lock "cinder-quobyte-a2956960-7851-4d8c-abe9-928e4d024cc5" released by "delete_volume" :: held 0.664s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:19:26 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-fa6641e7-1a91-4813-a531-a6707121017f tempest-ProjectReaderTests-1365408668 None] Created reservations ['3c715b63-b7fc-4e78-91ed-de58cf52c490', 'b224f2c6-3a15-468a-a981-9d9ef94b3232', 'efb8fa5a-8b90-436c-a3a9-6449242f2974', '6704eebe-6f79-4143-98cc-22da07d6f9d9'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:19:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-fa6641e7-1a91-4813-a531-a6707121017f tempest-ProjectReaderTests-1365408668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:19:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-fa6641e7-1a91-4813-a531-a6707121017f tempest-ProjectReaderTests-1365408668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:19:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-fa6641e7-1a91-4813-a531-a6707121017f tempest-ProjectReaderTests-1365408668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:19:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-fa6641e7-1a91-4813-a531-a6707121017f tempest-ProjectReaderTests-1365408668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:19:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-fa6641e7-1a91-4813-a531-a6707121017f tempest-ProjectReaderTests-1365408668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fa6641e7-1a91-4813-a531-a6707121017f tempest-ProjectReaderTests-1365408668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:26 devstack sudo[109747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:19:26 devstack sudo[109747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:27 devstack sudo[109747]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fa6641e7-1a91-4813-a531-a6707121017f tempest-ProjectReaderTests-1365408668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.276s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:27 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-fa6641e7-1a91-4813-a531-a6707121017f tempest-ProjectReaderTests-1365408668 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:19:27 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-fa6641e7-1a91-4813-a531-a6707121017f tempest-ProjectReaderTests-1365408668 None] Deleted volume successfully. Sep 28 15:19:27 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fa6641e7-1a91-4813-a531-a6707121017f tempest-ProjectReaderTests-1365408668 None] Lock "cinder-a2956960-7851-4d8c-abe9-928e4d024cc5-delete_volume" released by "delete_volume" :: held 1.160s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:19:27 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-5398bd32-e375-4bb3-9785-18e0c97e3277 tempest-ProjectReaderTests-1365408668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:19:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5398bd32-e375-4bb3-9785-18e0c97e3277 tempest-ProjectReaderTests-1365408668 None] Flow 'volume_create_manager' (01e3e929-09ad-4807-935a-d432d3774d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:19:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5398bd32-e375-4bb3-9785-18e0c97e3277 tempest-ProjectReaderTests-1365408668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de16f7d7-3708-4c75-ae3a-1a730047c3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5398bd32-e375-4bb3-9785-18e0c97e3277 tempest-ProjectReaderTests-1365408668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de16f7d7-3708-4c75-ae3a-1a730047c3d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-153094747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5f4965e-acfa-439b-875d-5f9d0b7ae594,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f48e06c516934af09b41914c260c6138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:19:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:19:28Z,use_quota=True,user_id='eb960f83d6574ee9b18d07632126f4b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5398bd32-e375-4bb3-9785-18e0c97e3277 tempest-ProjectReaderTests-1365408668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d706b52-4cd6-4608-ae6d-39d449676226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5398bd32-e375-4bb3-9785-18e0c97e3277 tempest-ProjectReaderTests-1365408668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d706b52-4cd6-4608-ae6d-39d449676226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5398bd32-e375-4bb3-9785-18e0c97e3277 tempest-ProjectReaderTests-1365408668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a13f64fe-c088-40d0-963d-e622f4c39e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5398bd32-e375-4bb3-9785-18e0c97e3277 tempest-ProjectReaderTests-1365408668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a13f64fe-c088-40d0-963d-e622f4c39e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5f4965e-acfa-439b-875d-5f9d0b7ae594', 'volume_name': 'volume-e5f4965e-acfa-439b-875d-5f9d0b7ae594', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5398bd32-e375-4bb3-9785-18e0c97e3277 tempest-ProjectReaderTests-1365408668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e2d605e-c97a-4a50-bc05-21eb33ab7224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5398bd32-e375-4bb3-9785-18e0c97e3277 tempest-ProjectReaderTests-1365408668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e2d605e-c97a-4a50-bc05-21eb33ab7224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5398bd32-e375-4bb3-9785-18e0c97e3277 tempest-ProjectReaderTests-1365408668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf18ec5e-ea62-4d3f-96ab-e0b389aef9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:27 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-5398bd32-e375-4bb3-9785-18e0c97e3277 tempest-ProjectReaderTests-1365408668 None] Volume e5f4965e-acfa-439b-875d-5f9d0b7ae594: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5f4965e-acfa-439b-875d-5f9d0b7ae594', 'volume_size': 1} Sep 28 15:19:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5398bd32-e375-4bb3-9785-18e0c97e3277 tempest-ProjectReaderTests-1365408668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:19:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5398bd32-e375-4bb3-9785-18e0c97e3277 tempest-ProjectReaderTests-1365408668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:19:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5398bd32-e375-4bb3-9785-18e0c97e3277 tempest-ProjectReaderTests-1365408668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-153094747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5f4965e-acfa-439b-875d-5f9d0b7ae594,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f48e06c516934af09b41914c260c6138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:19:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:19:28Z,use_quota=True,user_id='eb960f83d6574ee9b18d07632126f4b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:19:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-5398bd32-e375-4bb3-9785-18e0c97e3277 tempest-ProjectReaderTests-1365408668 None] Creating volume e5f4965e-acfa-439b-875d-5f9d0b7ae594 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:19:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5398bd32-e375-4bb3-9785-18e0c97e3277 tempest-ProjectReaderTests-1365408668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:19:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5398bd32-e375-4bb3-9785-18e0c97e3277 tempest-ProjectReaderTests-1365408668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:19:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5398bd32-e375-4bb3-9785-18e0c97e3277 tempest-ProjectReaderTests-1365408668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:19:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5398bd32-e375-4bb3-9785-18e0c97e3277 tempest-ProjectReaderTests-1365408668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:19:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5398bd32-e375-4bb3-9785-18e0c97e3277 tempest-ProjectReaderTests-1365408668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5398bd32-e375-4bb3-9785-18e0c97e3277 tempest-ProjectReaderTests-1365408668 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:19:27 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-5398bd32-e375-4bb3-9785-18e0c97e3277 tempest-ProjectReaderTests-1365408668 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:19:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5398bd32-e375-4bb3-9785-18e0c97e3277 tempest-ProjectReaderTests-1365408668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e5f4965e-acfa-439b-875d-5f9d0b7ae594 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:27 devstack sudo[109750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e5f4965e-acfa-439b-875d-5f9d0b7ae594 1073741824 Sep 28 15:19:27 devstack sudo[109750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:28 devstack sudo[109750]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5398bd32-e375-4bb3-9785-18e0c97e3277 tempest-ProjectReaderTests-1365408668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e5f4965e-acfa-439b-875d-5f9d0b7ae594 1073741824" returned: 0 in 0.467s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5398bd32-e375-4bb3-9785-18e0c97e3277 tempest-ProjectReaderTests-1365408668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e5f4965e-acfa-439b-875d-5f9d0b7ae594 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:28 devstack sudo[109755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e5f4965e-acfa-439b-875d-5f9d0b7ae594 Sep 28 15:19:28 devstack sudo[109755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:28 devstack sudo[109755]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5398bd32-e375-4bb3-9785-18e0c97e3277 tempest-ProjectReaderTests-1365408668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e5f4965e-acfa-439b-875d-5f9d0b7ae594" returned: 0 in 0.249s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:28 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5398bd32-e375-4bb3-9785-18e0c97e3277 tempest-ProjectReaderTests-1365408668 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:19:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5398bd32-e375-4bb3-9785-18e0c97e3277 tempest-ProjectReaderTests-1365408668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5398bd32-e375-4bb3-9785-18e0c97e3277 tempest-ProjectReaderTests-1365408668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf18ec5e-ea62-4d3f-96ab-e0b389aef9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5f4965e-acfa-439b-875d-5f9d0b7ae594', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5398bd32-e375-4bb3-9785-18e0c97e3277 tempest-ProjectReaderTests-1365408668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3b8624e-b5b7-4669-89b8-eacbce9dc24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:28 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-5398bd32-e375-4bb3-9785-18e0c97e3277 tempest-ProjectReaderTests-1365408668 None] Volume volume-e5f4965e-acfa-439b-875d-5f9d0b7ae594 (e5f4965e-acfa-439b-875d-5f9d0b7ae594): created successfully Sep 28 15:19:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5398bd32-e375-4bb3-9785-18e0c97e3277 tempest-ProjectReaderTests-1365408668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3b8624e-b5b7-4669-89b8-eacbce9dc24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5398bd32-e375-4bb3-9785-18e0c97e3277 tempest-ProjectReaderTests-1365408668 None] Flow 'volume_create_manager' (01e3e929-09ad-4807-935a-d432d3774d00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:19:28 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-5398bd32-e375-4bb3-9785-18e0c97e3277 tempest-ProjectReaderTests-1365408668 None] Created volume successfully. Sep 28 15:19:29 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2f830b00-45bf-4bfc-80c2-80cd8a066361 tempest-ProjectReaderTests-1365408668 None] Acquiring lock "cinder-e5f4965e-acfa-439b-875d-5f9d0b7ae594-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:19:29 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2f830b00-45bf-4bfc-80c2-80cd8a066361 tempest-ProjectReaderTests-1365408668 None] Lock "cinder-e5f4965e-acfa-439b-875d-5f9d0b7ae594-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:19:29 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2f830b00-45bf-4bfc-80c2-80cd8a066361 tempest-ProjectReaderTests-1365408668 None] Acquiring lock "cinder-quobyte-e5f4965e-acfa-439b-875d-5f9d0b7ae594" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:19:29 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2f830b00-45bf-4bfc-80c2-80cd8a066361 tempest-ProjectReaderTests-1365408668 None] Lock "cinder-quobyte-e5f4965e-acfa-439b-875d-5f9d0b7ae594" acquired by "delete_volume" :: waited 0.017s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:19:30 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b617a6b-a39d-415d-911b-23eca7517c9b]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:19:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2f830b00-45bf-4bfc-80c2-80cd8a066361 tempest-ProjectReaderTests-1365408668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e5f4965e-acfa-439b-875d-5f9d0b7ae594 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:30 devstack sudo[109759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e5f4965e-acfa-439b-875d-5f9d0b7ae594 Sep 28 15:19:30 devstack sudo[109759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:30 devstack sudo[109759]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2f830b00-45bf-4bfc-80c2-80cd8a066361 tempest-ProjectReaderTests-1365408668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e5f4965e-acfa-439b-875d-5f9d0b7ae594" returned: 0 in 0.404s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2f830b00-45bf-4bfc-80c2-80cd8a066361 tempest-ProjectReaderTests-1365408668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e5f4965e-acfa-439b-875d-5f9d0b7ae594 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:30 devstack sudo[109764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e5f4965e-acfa-439b-875d-5f9d0b7ae594 Sep 28 15:19:30 devstack sudo[109764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:30 devstack sudo[109764]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2f830b00-45bf-4bfc-80c2-80cd8a066361 tempest-ProjectReaderTests-1365408668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-e5f4965e-acfa-439b-875d-5f9d0b7ae594" returned: 0 in 0.280s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2f830b00-45bf-4bfc-80c2-80cd8a066361 tempest-ProjectReaderTests-1365408668 None] Lock "cinder-quobyte-e5f4965e-acfa-439b-875d-5f9d0b7ae594" released by "delete_volume" :: held 0.728s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:19:30 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-2f830b00-45bf-4bfc-80c2-80cd8a066361 tempest-ProjectReaderTests-1365408668 None] Created reservations ['d357cd15-0564-4abc-b84d-2ffcebcf87ef', 'cb37b008-a938-4524-9229-bf286aebeae6', 'd5732acc-6b26-4f4b-9bfc-c194d92bdc5e', '113550be-ce62-4c28-b782-800f26ce3e42'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:19:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2f830b00-45bf-4bfc-80c2-80cd8a066361 tempest-ProjectReaderTests-1365408668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:19:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2f830b00-45bf-4bfc-80c2-80cd8a066361 tempest-ProjectReaderTests-1365408668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:19:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2f830b00-45bf-4bfc-80c2-80cd8a066361 tempest-ProjectReaderTests-1365408668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:19:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2f830b00-45bf-4bfc-80c2-80cd8a066361 tempest-ProjectReaderTests-1365408668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:19:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2f830b00-45bf-4bfc-80c2-80cd8a066361 tempest-ProjectReaderTests-1365408668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2f830b00-45bf-4bfc-80c2-80cd8a066361 tempest-ProjectReaderTests-1365408668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:30 devstack sudo[109767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:19:30 devstack sudo[109767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:31 devstack sudo[109767]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2f830b00-45bf-4bfc-80c2-80cd8a066361 tempest-ProjectReaderTests-1365408668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.317s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:31 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-2f830b00-45bf-4bfc-80c2-80cd8a066361 tempest-ProjectReaderTests-1365408668 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:19:31 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-2f830b00-45bf-4bfc-80c2-80cd8a066361 tempest-ProjectReaderTests-1365408668 None] Deleted volume successfully. Sep 28 15:19:31 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2f830b00-45bf-4bfc-80c2-80cd8a066361 tempest-ProjectReaderTests-1365408668 None] Lock "cinder-e5f4965e-acfa-439b-875d-5f9d0b7ae594-delete_volume" released by "delete_volume" :: held 1.274s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:19:31 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7d93c95-9de2-4b23-b1f4-9c44a2f06583 tempest-ProjectReaderTests-1365408668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:19:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e7d93c95-9de2-4b23-b1f4-9c44a2f06583 tempest-ProjectReaderTests-1365408668 None] Flow 'volume_create_manager' (3e38021f-14e1-4cbb-bd79-f8e41d666512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:19:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e7d93c95-9de2-4b23-b1f4-9c44a2f06583 tempest-ProjectReaderTests-1365408668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdae63b8-c666-40e3-8dcf-d85e02533dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e7d93c95-9de2-4b23-b1f4-9c44a2f06583 tempest-ProjectReaderTests-1365408668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdae63b8-c666-40e3-8dcf-d85e02533dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1582337048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d75b729-a211-418a-803d-e6e87fadb2c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f48e06c516934af09b41914c260c6138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:19:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:19:32Z,use_quota=True,user_id='eb960f83d6574ee9b18d07632126f4b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e7d93c95-9de2-4b23-b1f4-9c44a2f06583 tempest-ProjectReaderTests-1365408668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d5aa8a5-d8eb-405c-a4c6-954ab703640a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e7d93c95-9de2-4b23-b1f4-9c44a2f06583 tempest-ProjectReaderTests-1365408668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d5aa8a5-d8eb-405c-a4c6-954ab703640a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e7d93c95-9de2-4b23-b1f4-9c44a2f06583 tempest-ProjectReaderTests-1365408668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34358f32-d1c3-4ccd-8e89-f2c81af71638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e7d93c95-9de2-4b23-b1f4-9c44a2f06583 tempest-ProjectReaderTests-1365408668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34358f32-d1c3-4ccd-8e89-f2c81af71638) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d75b729-a211-418a-803d-e6e87fadb2c0', 'volume_name': 'volume-5d75b729-a211-418a-803d-e6e87fadb2c0', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e7d93c95-9de2-4b23-b1f4-9c44a2f06583 tempest-ProjectReaderTests-1365408668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89a00b8b-c6f1-41cb-8eaa-a27ef357b857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e7d93c95-9de2-4b23-b1f4-9c44a2f06583 tempest-ProjectReaderTests-1365408668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89a00b8b-c6f1-41cb-8eaa-a27ef357b857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e7d93c95-9de2-4b23-b1f4-9c44a2f06583 tempest-ProjectReaderTests-1365408668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d974c914-11fb-40ba-845c-75df2abe7535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:31 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-e7d93c95-9de2-4b23-b1f4-9c44a2f06583 tempest-ProjectReaderTests-1365408668 None] Volume 5d75b729-a211-418a-803d-e6e87fadb2c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d75b729-a211-418a-803d-e6e87fadb2c0', 'volume_size': 1} Sep 28 15:19:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e7d93c95-9de2-4b23-b1f4-9c44a2f06583 tempest-ProjectReaderTests-1365408668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:19:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e7d93c95-9de2-4b23-b1f4-9c44a2f06583 tempest-ProjectReaderTests-1365408668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:19:31 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e7d93c95-9de2-4b23-b1f4-9c44a2f06583 tempest-ProjectReaderTests-1365408668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1582337048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d75b729-a211-418a-803d-e6e87fadb2c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f48e06c516934af09b41914c260c6138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:19:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:19:32Z,use_quota=True,user_id='eb960f83d6574ee9b18d07632126f4b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:19:31 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-e7d93c95-9de2-4b23-b1f4-9c44a2f06583 tempest-ProjectReaderTests-1365408668 None] Creating volume 5d75b729-a211-418a-803d-e6e87fadb2c0 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:19:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e7d93c95-9de2-4b23-b1f4-9c44a2f06583 tempest-ProjectReaderTests-1365408668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:19:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e7d93c95-9de2-4b23-b1f4-9c44a2f06583 tempest-ProjectReaderTests-1365408668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:19:31 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e7d93c95-9de2-4b23-b1f4-9c44a2f06583 tempest-ProjectReaderTests-1365408668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:19:31 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e7d93c95-9de2-4b23-b1f4-9c44a2f06583 tempest-ProjectReaderTests-1365408668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:19:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e7d93c95-9de2-4b23-b1f4-9c44a2f06583 tempest-ProjectReaderTests-1365408668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:31 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e7d93c95-9de2-4b23-b1f4-9c44a2f06583 tempest-ProjectReaderTests-1365408668 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:19:31 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-e7d93c95-9de2-4b23-b1f4-9c44a2f06583 tempest-ProjectReaderTests-1365408668 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:19:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e7d93c95-9de2-4b23-b1f4-9c44a2f06583 tempest-ProjectReaderTests-1365408668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5d75b729-a211-418a-803d-e6e87fadb2c0 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:31 devstack sudo[109773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5d75b729-a211-418a-803d-e6e87fadb2c0 1073741824 Sep 28 15:19:31 devstack sudo[109773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:32 devstack sudo[109773]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e7d93c95-9de2-4b23-b1f4-9c44a2f06583 tempest-ProjectReaderTests-1365408668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5d75b729-a211-418a-803d-e6e87fadb2c0 1073741824" returned: 0 in 0.473s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e7d93c95-9de2-4b23-b1f4-9c44a2f06583 tempest-ProjectReaderTests-1365408668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5d75b729-a211-418a-803d-e6e87fadb2c0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:32 devstack sudo[109778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5d75b729-a211-418a-803d-e6e87fadb2c0 Sep 28 15:19:32 devstack sudo[109778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:32 devstack sudo[109778]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e7d93c95-9de2-4b23-b1f4-9c44a2f06583 tempest-ProjectReaderTests-1365408668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5d75b729-a211-418a-803d-e6e87fadb2c0" returned: 0 in 0.266s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:32 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e7d93c95-9de2-4b23-b1f4-9c44a2f06583 tempest-ProjectReaderTests-1365408668 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:19:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e7d93c95-9de2-4b23-b1f4-9c44a2f06583 tempest-ProjectReaderTests-1365408668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:32 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e7d93c95-9de2-4b23-b1f4-9c44a2f06583 tempest-ProjectReaderTests-1365408668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d974c914-11fb-40ba-845c-75df2abe7535) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d75b729-a211-418a-803d-e6e87fadb2c0', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:32 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e7d93c95-9de2-4b23-b1f4-9c44a2f06583 tempest-ProjectReaderTests-1365408668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (813315ef-5abd-4c4f-a905-0aea37a62aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:32 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-e7d93c95-9de2-4b23-b1f4-9c44a2f06583 tempest-ProjectReaderTests-1365408668 None] Volume volume-5d75b729-a211-418a-803d-e6e87fadb2c0 (5d75b729-a211-418a-803d-e6e87fadb2c0): created successfully Sep 28 15:19:32 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e7d93c95-9de2-4b23-b1f4-9c44a2f06583 tempest-ProjectReaderTests-1365408668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (813315ef-5abd-4c4f-a905-0aea37a62aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:32 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e7d93c95-9de2-4b23-b1f4-9c44a2f06583 tempest-ProjectReaderTests-1365408668 None] Flow 'volume_create_manager' (3e38021f-14e1-4cbb-bd79-f8e41d666512) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:19:32 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-e7d93c95-9de2-4b23-b1f4-9c44a2f06583 tempest-ProjectReaderTests-1365408668 None] Created volume successfully. Sep 28 15:19:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d577a1a8-9f6b-4026-9908-0ff8459858da tempest-ProjectReaderTests-1365408668 None] Acquiring lock "cinder-5d75b729-a211-418a-803d-e6e87fadb2c0-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:19:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d577a1a8-9f6b-4026-9908-0ff8459858da tempest-ProjectReaderTests-1365408668 None] Lock "cinder-5d75b729-a211-418a-803d-e6e87fadb2c0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:19:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d577a1a8-9f6b-4026-9908-0ff8459858da tempest-ProjectReaderTests-1365408668 None] Acquiring lock "cinder-quobyte-5d75b729-a211-418a-803d-e6e87fadb2c0" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:19:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d577a1a8-9f6b-4026-9908-0ff8459858da tempest-ProjectReaderTests-1365408668 None] Lock "cinder-quobyte-5d75b729-a211-418a-803d-e6e87fadb2c0" acquired by "delete_volume" :: waited 0.019s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:19:33 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f9e6b4-2540-4fcd-8ed0-1aaf136efbfa]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:19:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d577a1a8-9f6b-4026-9908-0ff8459858da tempest-ProjectReaderTests-1365408668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5d75b729-a211-418a-803d-e6e87fadb2c0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:34 devstack sudo[109787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5d75b729-a211-418a-803d-e6e87fadb2c0 Sep 28 15:19:34 devstack sudo[109787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:34 devstack sudo[109787]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d577a1a8-9f6b-4026-9908-0ff8459858da tempest-ProjectReaderTests-1365408668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5d75b729-a211-418a-803d-e6e87fadb2c0" returned: 0 in 0.409s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d577a1a8-9f6b-4026-9908-0ff8459858da tempest-ProjectReaderTests-1365408668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5d75b729-a211-418a-803d-e6e87fadb2c0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:34 devstack sudo[109792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5d75b729-a211-418a-803d-e6e87fadb2c0 Sep 28 15:19:34 devstack sudo[109792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:34 devstack sudo[109792]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d577a1a8-9f6b-4026-9908-0ff8459858da tempest-ProjectReaderTests-1365408668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-5d75b729-a211-418a-803d-e6e87fadb2c0" returned: 0 in 0.267s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:34 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d577a1a8-9f6b-4026-9908-0ff8459858da tempest-ProjectReaderTests-1365408668 None] Lock "cinder-quobyte-5d75b729-a211-418a-803d-e6e87fadb2c0" released by "delete_volume" :: held 0.732s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:19:34 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-d577a1a8-9f6b-4026-9908-0ff8459858da tempest-ProjectReaderTests-1365408668 None] Created reservations ['31df34a9-747e-4ea1-b389-c113956c7d49', '7308812d-6f9f-4e80-ad80-0a90f715ae80', '70f3a038-2a97-4b52-813d-d8013405fa1b', '5e96222f-be28-433c-a68c-88a7183cb693'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:19:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d577a1a8-9f6b-4026-9908-0ff8459858da tempest-ProjectReaderTests-1365408668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:19:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d577a1a8-9f6b-4026-9908-0ff8459858da tempest-ProjectReaderTests-1365408668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:19:34 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d577a1a8-9f6b-4026-9908-0ff8459858da tempest-ProjectReaderTests-1365408668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:19:34 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d577a1a8-9f6b-4026-9908-0ff8459858da tempest-ProjectReaderTests-1365408668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:19:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d577a1a8-9f6b-4026-9908-0ff8459858da tempest-ProjectReaderTests-1365408668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d577a1a8-9f6b-4026-9908-0ff8459858da tempest-ProjectReaderTests-1365408668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:34 devstack sudo[109795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:19:34 devstack sudo[109795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:35 devstack sudo[109795]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d577a1a8-9f6b-4026-9908-0ff8459858da tempest-ProjectReaderTests-1365408668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.256s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:35 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-d577a1a8-9f6b-4026-9908-0ff8459858da tempest-ProjectReaderTests-1365408668 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:19:35 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-d577a1a8-9f6b-4026-9908-0ff8459858da tempest-ProjectReaderTests-1365408668 None] Deleted volume successfully. Sep 28 15:19:35 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d577a1a8-9f6b-4026-9908-0ff8459858da tempest-ProjectReaderTests-1365408668 None] Lock "cinder-5d75b729-a211-418a-803d-e6e87fadb2c0-delete_volume" released by "delete_volume" :: held 1.229s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:19:35 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0a53ca5-1bfc-4ba2-9afa-f65231e4b336 tempest-ProjectReaderTests-1365408668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:19:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d0a53ca5-1bfc-4ba2-9afa-f65231e4b336 tempest-ProjectReaderTests-1365408668 None] Flow 'volume_create_manager' (9621e76a-d676-462f-928c-fb2c26cffeff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:19:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d0a53ca5-1bfc-4ba2-9afa-f65231e4b336 tempest-ProjectReaderTests-1365408668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13bfc798-4a17-4faa-aa41-1431213546cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d0a53ca5-1bfc-4ba2-9afa-f65231e4b336 tempest-ProjectReaderTests-1365408668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13bfc798-4a17-4faa-aa41-1431213546cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:19:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2027285371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ad8e911-b2e8-44fa-9010-de13e8b88fc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f48e06c516934af09b41914c260c6138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:19:35Z,use_quota=True,user_id='eb960f83d6574ee9b18d07632126f4b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d0a53ca5-1bfc-4ba2-9afa-f65231e4b336 tempest-ProjectReaderTests-1365408668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e618def-f8ce-40ba-936a-95508527266d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d0a53ca5-1bfc-4ba2-9afa-f65231e4b336 tempest-ProjectReaderTests-1365408668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e618def-f8ce-40ba-936a-95508527266d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d0a53ca5-1bfc-4ba2-9afa-f65231e4b336 tempest-ProjectReaderTests-1365408668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f61a95ac-e8af-4b2d-aefe-fe5e4f362a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d0a53ca5-1bfc-4ba2-9afa-f65231e4b336 tempest-ProjectReaderTests-1365408668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f61a95ac-e8af-4b2d-aefe-fe5e4f362a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ad8e911-b2e8-44fa-9010-de13e8b88fc5', 'volume_name': 'volume-9ad8e911-b2e8-44fa-9010-de13e8b88fc5', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d0a53ca5-1bfc-4ba2-9afa-f65231e4b336 tempest-ProjectReaderTests-1365408668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72a04894-c04c-4b57-b2fb-883695da455e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d0a53ca5-1bfc-4ba2-9afa-f65231e4b336 tempest-ProjectReaderTests-1365408668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72a04894-c04c-4b57-b2fb-883695da455e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d0a53ca5-1bfc-4ba2-9afa-f65231e4b336 tempest-ProjectReaderTests-1365408668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa246175-538f-4796-bce5-688fed67d678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:35 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-d0a53ca5-1bfc-4ba2-9afa-f65231e4b336 tempest-ProjectReaderTests-1365408668 None] Volume 9ad8e911-b2e8-44fa-9010-de13e8b88fc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ad8e911-b2e8-44fa-9010-de13e8b88fc5', 'volume_size': 1} Sep 28 15:19:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d0a53ca5-1bfc-4ba2-9afa-f65231e4b336 tempest-ProjectReaderTests-1365408668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:19:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d0a53ca5-1bfc-4ba2-9afa-f65231e4b336 tempest-ProjectReaderTests-1365408668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:19:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d0a53ca5-1bfc-4ba2-9afa-f65231e4b336 tempest-ProjectReaderTests-1365408668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:19:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2027285371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ad8e911-b2e8-44fa-9010-de13e8b88fc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f48e06c516934af09b41914c260c6138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:19:35Z,use_quota=True,user_id='eb960f83d6574ee9b18d07632126f4b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4a5c7cc-036a-495f-b043-c5768bd34d7f),volume_type_id=e4a5c7cc-036a-495f-b043-c5768bd34d7f)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1517}} Sep 28 15:19:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-d0a53ca5-1bfc-4ba2-9afa-f65231e4b336 tempest-ProjectReaderTests-1365408668 None] Creating volume 9ad8e911-b2e8-44fa-9010-de13e8b88fc5 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:19:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d0a53ca5-1bfc-4ba2-9afa-f65231e4b336 tempest-ProjectReaderTests-1365408668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:19:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d0a53ca5-1bfc-4ba2-9afa-f65231e4b336 tempest-ProjectReaderTests-1365408668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:19:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d0a53ca5-1bfc-4ba2-9afa-f65231e4b336 tempest-ProjectReaderTests-1365408668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:19:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d0a53ca5-1bfc-4ba2-9afa-f65231e4b336 tempest-ProjectReaderTests-1365408668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:19:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d0a53ca5-1bfc-4ba2-9afa-f65231e4b336 tempest-ProjectReaderTests-1365408668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d0a53ca5-1bfc-4ba2-9afa-f65231e4b336 tempest-ProjectReaderTests-1365408668 None] Selected osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:19:35 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-d0a53ca5-1bfc-4ba2-9afa-f65231e4b336 tempest-ProjectReaderTests-1365408668 None] casted to osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1 Sep 28 15:19:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d0a53ca5-1bfc-4ba2-9afa-f65231e4b336 tempest-ProjectReaderTests-1365408668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9ad8e911-b2e8-44fa-9010-de13e8b88fc5 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:35 devstack sudo[109798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9ad8e911-b2e8-44fa-9010-de13e8b88fc5 1073741824 Sep 28 15:19:35 devstack sudo[109798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:35 devstack sudo[109798]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d0a53ca5-1bfc-4ba2-9afa-f65231e4b336 tempest-ProjectReaderTests-1365408668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9ad8e911-b2e8-44fa-9010-de13e8b88fc5 1073741824" returned: 0 in 0.423s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d0a53ca5-1bfc-4ba2-9afa-f65231e4b336 tempest-ProjectReaderTests-1365408668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9ad8e911-b2e8-44fa-9010-de13e8b88fc5 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:36 devstack sudo[109804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9ad8e911-b2e8-44fa-9010-de13e8b88fc5 Sep 28 15:19:36 devstack sudo[109804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:36 devstack sudo[109804]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d0a53ca5-1bfc-4ba2-9afa-f65231e4b336 tempest-ProjectReaderTests-1365408668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9ad8e911-b2e8-44fa-9010-de13e8b88fc5" returned: 0 in 0.243s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:36 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d0a53ca5-1bfc-4ba2-9afa-f65231e4b336 tempest-ProjectReaderTests-1365408668 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1542}} Sep 28 15:19:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d0a53ca5-1bfc-4ba2-9afa-f65231e4b336 tempest-ProjectReaderTests-1365408668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:36 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d0a53ca5-1bfc-4ba2-9afa-f65231e4b336 tempest-ProjectReaderTests-1365408668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa246175-538f-4796-bce5-688fed67d678) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ad8e911-b2e8-44fa-9010-de13e8b88fc5', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:36 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d0a53ca5-1bfc-4ba2-9afa-f65231e4b336 tempest-ProjectReaderTests-1365408668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b12ef2b5-01bd-41ca-8564-089a64cfd436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:36 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-d0a53ca5-1bfc-4ba2-9afa-f65231e4b336 tempest-ProjectReaderTests-1365408668 None] Volume volume-9ad8e911-b2e8-44fa-9010-de13e8b88fc5 (9ad8e911-b2e8-44fa-9010-de13e8b88fc5): created successfully Sep 28 15:19:36 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d0a53ca5-1bfc-4ba2-9afa-f65231e4b336 tempest-ProjectReaderTests-1365408668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b12ef2b5-01bd-41ca-8564-089a64cfd436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:36 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d0a53ca5-1bfc-4ba2-9afa-f65231e4b336 tempest-ProjectReaderTests-1365408668 None] Flow 'volume_create_manager' (9621e76a-d676-462f-928c-fb2c26cffeff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:19:36 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-d0a53ca5-1bfc-4ba2-9afa-f65231e4b336 tempest-ProjectReaderTests-1365408668 None] Created volume successfully. Sep 28 15:19:36 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-803677ab-6db4-4de9-a4f7-3884c5f4a6db tempest-ProjectReaderTests-1365408668 None] Acquiring lock "cinder-9ad8e911-b2e8-44fa-9010-de13e8b88fc5-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:19:36 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-803677ab-6db4-4de9-a4f7-3884c5f4a6db tempest-ProjectReaderTests-1365408668 None] Lock "cinder-9ad8e911-b2e8-44fa-9010-de13e8b88fc5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:19:36 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-803677ab-6db4-4de9-a4f7-3884c5f4a6db tempest-ProjectReaderTests-1365408668 None] Acquiring lock "cinder-quobyte-9ad8e911-b2e8-44fa-9010-de13e8b88fc5" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:19:36 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-803677ab-6db4-4de9-a4f7-3884c5f4a6db tempest-ProjectReaderTests-1365408668 None] Lock "cinder-quobyte-9ad8e911-b2e8-44fa-9010-de13e8b88fc5" acquired by "delete_volume" :: waited 0.015s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:19:36 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[0398e14a-4a04-400b-a4d7-f13b0184fddb]: (4, 'qcow2') {{(pid=88822) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:19:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-803677ab-6db4-4de9-a4f7-3884c5f4a6db tempest-ProjectReaderTests-1365408668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9ad8e911-b2e8-44fa-9010-de13e8b88fc5 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:36 devstack sudo[109807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9ad8e911-b2e8-44fa-9010-de13e8b88fc5 Sep 28 15:19:36 devstack sudo[109807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:37 devstack sudo[109807]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-803677ab-6db4-4de9-a4f7-3884c5f4a6db tempest-ProjectReaderTests-1365408668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9ad8e911-b2e8-44fa-9010-de13e8b88fc5" returned: 0 in 0.391s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-803677ab-6db4-4de9-a4f7-3884c5f4a6db tempest-ProjectReaderTests-1365408668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9ad8e911-b2e8-44fa-9010-de13e8b88fc5 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:37 devstack sudo[109812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9ad8e911-b2e8-44fa-9010-de13e8b88fc5 Sep 28 15:19:37 devstack sudo[109812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:37 devstack sudo[109812]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-803677ab-6db4-4de9-a4f7-3884c5f4a6db tempest-ProjectReaderTests-1365408668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb/volume-9ad8e911-b2e8-44fa-9010-de13e8b88fc5" returned: 0 in 0.251s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:37 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-803677ab-6db4-4de9-a4f7-3884c5f4a6db tempest-ProjectReaderTests-1365408668 None] Lock "cinder-quobyte-9ad8e911-b2e8-44fa-9010-de13e8b88fc5" released by "delete_volume" :: held 0.691s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:19:37 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-803677ab-6db4-4de9-a4f7-3884c5f4a6db tempest-ProjectReaderTests-1365408668 None] Created reservations ['b0bd49a0-0335-433b-a478-40015ac409c3', 'fa1badb4-49a3-45f6-b0fc-a15fe1cc6a9e', '049449da-e01c-4006-82b4-42a80f7206bc', '4f87769a-c555-4e7f-9009-3ff7ea47fa49'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:19:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-803677ab-6db4-4de9-a4f7-3884c5f4a6db tempest-ProjectReaderTests-1365408668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:19:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-803677ab-6db4-4de9-a4f7-3884c5f4a6db tempest-ProjectReaderTests-1365408668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:19:37 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-803677ab-6db4-4de9-a4f7-3884c5f4a6db tempest-ProjectReaderTests-1365408668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:19:37 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-803677ab-6db4-4de9-a4f7-3884c5f4a6db tempest-ProjectReaderTests-1365408668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-02ae793b-8328-4e6e-9d7b-cc8040f342c1'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:19:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-803677ab-6db4-4de9-a4f7-3884c5f4a6db tempest-ProjectReaderTests-1365408668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-803677ab-6db4-4de9-a4f7-3884c5f4a6db tempest-ProjectReaderTests-1365408668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:37 devstack sudo[109815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb Sep 28 15:19:37 devstack sudo[109815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:37 devstack sudo[109815]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-803677ab-6db4-4de9-a4f7-3884c5f4a6db tempest-ProjectReaderTests-1365408668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7e8e2c4bd89c941f1e85edfb79b792eb" returned: 0 in 0.274s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:37 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-803677ab-6db4-4de9-a4f7-3884c5f4a6db tempest-ProjectReaderTests-1365408668 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:19:37 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-803677ab-6db4-4de9-a4f7-3884c5f4a6db tempest-ProjectReaderTests-1365408668 None] Deleted volume successfully. Sep 28 15:19:37 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-803677ab-6db4-4de9-a4f7-3884c5f4a6db tempest-ProjectReaderTests-1365408668 None] Lock "cinder-9ad8e911-b2e8-44fa-9010-de13e8b88fc5-delete_volume" released by "delete_volume" :: held 1.179s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:19:50 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:UPDATE=43,cinder:INSERT=12,cinder:SELECT=25,cinder:DELETE=3 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:19:50 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=32,cinder:UPDATE=46,cinder:DELETE=5,cinder:INSERT=8 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}